How to process a very large (4Gb) tarfile from python?
rocksportrocker at googlemail.com
Fri Jul 18 08:41:50 CEST 2008
On 17 Jul., 22:21, Lars Gustäbel <l... at gustaebel.de> wrote:
> > Maybe we should post this issue to python-dev mailing list.
> > Parsing large tar-files is not uncommon.
> This issue is known and was fixed for Python 3.0, seehttp://bugs.python.org/issue2058.
The proposed patch does not avoid caching the previous values of the
iterator, it just
reduces the size of each cached object.
It would be nice to be able to avoid caching on demand, which would
iteration independent of the size of the tar file.
More information about the Python-list