very large dictionary

Sean seandc at att.net
Sat Aug 2 03:39:48 CEST 2008


Simon Strobl wrote:
> Hello,
> 
> I tried to load a 6.8G large dictionary on a server that has 128G of
> memory. I got a memory error. I used Python 2.5.2. How can I load my
> data?
> 
> SImon

Take a look at the python bsddb module.  Uing btree tables is fast, and 
it has the benefit that once the table is open, the programing interface 
is identical to a normal dictionary.

http://docs.python.org/lib/bsddb-objects.html

Sean



More information about the Python-list mailing list