[Tutor] Trying to parse a HUGE(1gb) xml file in python

Alan Gauld alan.gauld at btinternet.com
Tue Dec 21 18:57:22 CET 2010


"Stefan Behnel" <stefan_ml at behnel.de> wrote

>> But I don't understand how uncompressing a file before parsing it 
>> can
>> be faster than parsing the original uncompressed file?
>
> I didn't say "uncompressing a file *before* parsing it". I meant 
> uncompressing the data *while* parsing it.

Ah, ok that can work, although it does add a layer of processing
to identify compressed v uncompressed data, but if I/O is the
bottleneck then it could give an advantage.

Alan g. 




More information about the Tutor mailing list