[Tutor] Trying to parse a HUGE(1gb) xml file in python
Stefan Behnel
stefan_ml at behnel.de
Wed Dec 22 09:19:18 CET 2010
Walter Prins, 21.12.2010 22:13:
> On 21 December 2010 17:57, Alan Gauld wrote:
>> "Stefan Behnel" wrote
>>
>>>> But I don't understand how uncompressing a file before parsing it can
>>>> be faster than parsing the original uncompressed file?
>>>>
>>>
>>> I didn't say "uncompressing a file *before* parsing it". I meant
>>> uncompressing the data *while* parsing it.
>>>
>>
>> Ah, ok that can work, although it does add a layer of processing
>> to identify compressed v uncompressed data, but if I/O is the
>> bottleneck then it could give an advantage.
>>
>
> OK my apologies, I see my previous response was already circumscribed by
> later emails (which I had not read yet.) Feel free to ignore it. :)
Not much of a reason to apologize. Especially on a newbee list like
python-tutor, a few words more or a different way of describing things may
help in widening the set of readers who understand and manage to follow
other people's arguments.
Stefan
More information about the Tutor
mailing list