[issue4679] Fork + shelve causes shelve corruption and backtrace

Alex Roper report at bugs.python.org
Mon Jul 5 06:02:42 CEST 2010


Alex Roper <alexr at ugcs.caltech.edu> added the comment:

I've just been using the sq_dict module, which is a drop-in replacement for shelve written 
using sqlite3. BDB is a pretty squirraly piece of software in my experience. It may or may 
not be stable on it's own, but its APIs are pretty poorly documented and programmers tend 
to misuse them without knowing it.

Every job I've done with it has involved major hacks such as API interception and 
replacement with sqlite3, cronjobs to rebuild hte database every hour, etc. It's also nice 
to have databases that are platform independent, and in all the applications I use the 
slight slowdown for sqlite is acceptable (I mean I /am/ using Python)

YMMV of course. Also I know at one point Python 3 was going to use sqlite. The sq_dict I 
mention is on Bugzilla somewhere, or email me if you need a copy.

Alex

Alexander Belopolsky wrote:
> Alexander Belopolsky <belopolsky at users.sourceforge.net> added the comment:
> 
> The wikisource file in the report is no longer available, but with latest wikisource and python 2.7,
> 
> 
> $ curl http://download.wikimedia.org/enwikisource/latest/enwikisource-latest-pages-articles.xml.bz2| bzip2 -cd | ./python.exe convert.py /tmp 8388608
> 
> went through first 50MiB without an error.   I am not sure I'll have the patience to run this to completion, but it looks like this is out of date.
> 
> ----------
> nosy: +belopolsky
> resolution:  -> out of date
> stage:  -> unit test needed
> status: open -> pending
> 
> _______________________________________
> Python tracker <report at bugs.python.org>
> <http://bugs.python.org/issue4679>
> _______________________________________

----------
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue4679>
_______________________________________


More information about the Python-bugs-list mailing list