Large Amount of Data
Marc 'BlackJack' Rintsch
bj_666 at gmx.net
Fri May 25 14:03:09 EDT 2007
In <H8udnTwG_s1QvMrbnZ2dnUVZ_o2vnZ2d at comcast.com>, Jack wrote:
> I need to process large amount of data. The data structure fits well
> in a dictionary but the amount is large - close to or more than the size
> of physical memory. I wonder what will happen if I try to load the data
> into a dictionary. Will Python use swap memory or will it fail?
What about putting the data into a database? If the keys are strings the
`shelve` module might be a solution.
Ciao,
Marc 'BlackJack' Rintsch
More information about the Python-list
mailing list