[Tutor] Trying to parse a HUGE(1gb) xml file in python

Walter Prins wprins at gmail.com
Tue Dec 21 22:13:16 CET 2010


On 21 December 2010 17:57, Alan Gauld <alan.gauld at btinternet.com> wrote:

>
> "Stefan Behnel" <stefan_ml at behnel.de> wrote
>
>  But I don't understand how uncompressing a file before parsing it can
>>> be faster than parsing the original uncompressed file?
>>>
>>
>> I didn't say "uncompressing a file *before* parsing it". I meant
>> uncompressing the data *while* parsing it.
>>
>
> Ah, ok that can work, although it does add a layer of processing
> to identify compressed v uncompressed data, but if I/O is the
> bottleneck then it could give an advantage.
>

OK my apologies, I see my previous response was already circumscribed by
later emails (which I had not read yet.)  Feel free to ignore it. :)

Walter
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/tutor/attachments/20101221/225d58ba/attachment.html>


More information about the Tutor mailing list