dict is really slow for big truck

forrest yang Gforrest.yang at gmail.com
Tue Apr 28 14:54:49 CEST 2009

i try to load a big file into a dict, which is about 9,000,000 lines,
something like
1 2 3 4
2 2 3 4
3 4 5 6

for line in open(file)

but, the dict is really slow as i load more data into the memory, by
the way the mac i use have 16G memory.
is this cased by the low performace for dict to extend memory or
something other reason.
is there any one can provide a better solution

More information about the Python-list mailing list