How to process a very large (4Gb) tarfile from python?
Uwe Schmitt
rocksportrocker at googlemail.com
Fri Jul 18 02:41:50 EDT 2008
On 17 Jul., 22:21, Lars Gustäbel <l... at gustaebel.de> wrote:
>
> > Maybe we should post this issue to python-dev mailing list.
> > Parsing large tar-files is not uncommon.
>
> This issue is known and was fixed for Python 3.0, seehttp://bugs.python.org/issue2058.
The proposed patch does not avoid caching the previous values of the
iterator, it just
reduces the size of each cached object.
It would be nice to be able to avoid caching on demand, which would
make
iteration independent of the size of the tar file.
Greetings Uwe
More information about the Python-list
mailing list