How to process a very large (4Gb) tarfile from python?

Uwe Schmitt rocksportrocker at
Fri Jul 18 08:41:50 CEST 2008

On 17 Jul., 22:21, Lars Gustäbel <l... at> wrote:
> > Maybe we should post this issue to python-dev mailing list.
> > Parsing large tar-files is not uncommon.
> This issue is known and was fixed for Python 3.0, see

The proposed patch does not avoid caching the previous values of the
iterator, it just
reduces the size of each cached object.
It would be nice to be able to avoid caching on demand, which would
iteration independent of the size of the tar file.

Greetings Uwe

More information about the Python-list mailing list