[Tutor] Trying to parse a HUGE(1gb) xml file in python
Alan Gauld
alan.gauld at btinternet.com
Tue Dec 21 18:57:22 CET 2010
"Stefan Behnel" <stefan_ml at behnel.de> wrote
>> But I don't understand how uncompressing a file before parsing it
>> can
>> be faster than parsing the original uncompressed file?
>
> I didn't say "uncompressing a file *before* parsing it". I meant
> uncompressing the data *while* parsing it.
Ah, ok that can work, although it does add a layer of processing
to identify compressed v uncompressed data, but if I/O is the
bottleneck then it could give an advantage.
Alan g.
More information about the Tutor
mailing list