[Tutor] Trying to parse a HUGE(1gb) xml file in python

Stefan Behnel stefan_ml at behnel.de
Wed Dec 22 09:19:18 CET 2010


Walter Prins, 21.12.2010 22:13:
> On 21 December 2010 17:57, Alan Gauld wrote:
>> "Stefan Behnel" wrote
>>
>>>> But I don't understand how uncompressing a file before parsing it can
>>>> be faster than parsing the original uncompressed file?
>>>>
>>>
>>> I didn't say "uncompressing a file *before* parsing it". I meant
>>> uncompressing the data *while* parsing it.
>>>
>>
>> Ah, ok that can work, although it does add a layer of processing
>> to identify compressed v uncompressed data, but if I/O is the
>> bottleneck then it could give an advantage.
>>
>
> OK my apologies, I see my previous response was already circumscribed by
> later emails (which I had not read yet.)  Feel free to ignore it. :)

Not much of a reason to apologize. Especially on a newbee list like 
python-tutor, a few words more or a different way of describing things may 
help in widening the set of readers who understand and manage to follow 
other people's arguments.

Stefan



More information about the Tutor mailing list