[New-bugs-announce] [issue10040] GZipFile failure on large files

Robert Rohde report at bugs.python.org
Thu Oct 7 03:57:13 CEST 2010

New submission from Robert Rohde <rohde at robertrohde.com>:

I attempted to use GZipFile to process a 1.93 GB file that expands to 18.8 GB.

This consistently produces the same corrupted output file that has approximately, but not exactly, the right output file size.

I bypassed GZipFile by calling the 7-Zip executable to open the compressed file.  This works correctly and consistently.

I haven't tried to figure out how GZipFile works, but I assume that this failure is probably related to the very large size of the files I am working with.  I've used GZipFile before on much smaller files with no apparent problems.  I have no idea what precisely goes wrong, or how to fix it, but I felt it was important to note that GZipFile isn't working for at least some very large files.

components: Library (Lib)
messages: 118091
nosy: Robert.Rohde
priority: normal
severity: normal
status: open
title: GZipFile failure on large files
type: behavior
versions: Python 2.7

Python tracker <report at bugs.python.org>

More information about the New-bugs-announce mailing list