key/value store optimized for disk storage

Paul Rubin no.email at nospam.invalid
Wed May 2 22:46:20 EDT 2012


Steve Howell <showell30 at yahoo.com> writes:
>   keys are file paths
>   directories are 2 levels deep (30 dirs w/100k files each)
>   values are file contents

> The current solution isn't horrible, 

Yes it is ;-)

> As I mention up top, I'm mostly hoping folks can point me toward
> sources they trust, whether it be other mailing lists, good tools,

cdb sounds reasonable for your purposes.  I'm sure there are python
bindings for it.

http://cr.yp.to/cdb.html mentions a 4gb limit (2**32) but I
half-remember something about a 64 bit version.



More information about the Python-list mailing list