Reading a large bz2 textfile exits early

Lie Ryan lie.1296 at gmail.com
Mon Feb 22 08:29:55 EST 2010


On 02/22/10 19:43, Norman Rieß wrote:
> Am 02/22/10 09:02, schrieb Steven D'Aprano:
>> On Mon, 22 Feb 2010 07:49:51 +0100, Norman Rieß wrote:
>>
>>   
>>> This is the actual code:
>>>
>>> source_file = bz2.BZ2File(file, "r")
>>> for line in source_file:
>>>       print line.strip()
>>>
>>> print "Exiting"
>>> print "I used file: " + file
>>>      
>>
>> Have you verified that the bz file is good by opening it in another
>> application?
>>
>>
>>
>>    
> 
> Yes, bzcat is running through the file fine. And piping bzcat output
> into the python script reading stdin works fine, too.

test with using something other than bzcat; bzcat does certain things
differently because of the way it works (a cat for bzipped file). Try
using plain "bunzip2 filename.bz2"



More information about the Python-list mailing list