How pickle helps in reading huge files?
Mark Lawrence
breamoreboy at yahoo.co.uk
Wed Oct 16 03:39:57 EDT 2013
On 16/10/2013 07:55, Harsh Jha wrote:
> I've a huge csv file and I want to read stuff from it again and again. Is it useful to pickle it and keep and then unpickle it whenever I need to use that data? Is it faster that accessing that file simply by opening it again and again? Please explain, why?
>
> Thank you.
>
What's your definition of huge? Maybe it would be effective to pickle
and unpickle but until you try it, perhaps with a relatively small data
sample, how can you know? Why can't you leave the file open and keep
iterating over the contents?
--
Roses are red,
Violets are blue,
Most poems rhyme,
But this one doesn't.
Mark Lawrence
More information about the Python-list
mailing list