[issue10900] bz2 module fails to uncompress large files

Eric Wolf report at bugs.python.org
Tue Mar 1 19:18:17 CET 2011


Eric Wolf <ebwolf at gmail.com> added the comment:

I tried the change you suggested. It still fails but now at 572,320 bytes instead of 900,000. I'm not sure why the difference in bytes read. I'll explore this more in a bit.

I also converted the BZ2 to GZ and used the gzip module. It's failing after reading 46628864 bytes. The GZ file is 33GB compared to the 22GB BZ2.

I've attached the strace output. I was getting an error with the sbrk parameter, so I left it out. Let me know if there's anything else I can provide.

----------
versions: +Python 2.5
Added file: http://bugs.python.org/file20961/strace_bz2.txt

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue10900>
_______________________________________


More information about the Python-bugs-list mailing list