really slow gzip decompress, why?
ivanov.maxim at gmail.com
Mon Jan 26 16:22:25 CET 2009
I've one big (6.9 Gb) .gz file with text inside it.
zcat bigfile.gz > /dev/null does the job in 4 minutes 50 seconds
python code have been doing the same job for 25 minutes and still
doesn't finish =( the code is simpliest I could ever imagine:
fh = gzip.open(sys.argv)
As far as I understand most of the time it executes C code, so pythons
no overhead should be noticible. Why is it so slow?
More information about the Python-list