How to process a very large (4Gb) tarfile from python?

Uwe Schmitt rocksportrocker at googlemail.com
Fri Jul 18 02:41:50 EDT 2008


On 17 Jul., 22:21, Lars Gustäbel <l... at gustaebel.de> wrote:
>
> > Maybe we should post this issue to python-dev mailing list.
> > Parsing large tar-files is not uncommon.
>
> This issue is known and was fixed for Python 3.0, seehttp://bugs.python.org/issue2058.

The proposed patch does not avoid caching the previous values of the
iterator, it just
reduces the size of each cached object.
It would be nice to be able to avoid caching on demand, which would
make
iteration independent of the size of the tar file.

Greetings Uwe



More information about the Python-list mailing list