[spambayes-bugs] [ spambayes-Feature Requests-859339 ] Add sqlite storage option

[SourceForge.net]

Feature Requests item #859339, was opened at 2003-12-12 23:45
Message generated for change (Comment added) made by kpitt
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=498106&aid=859339&group_id=61702

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Priority: 5
Submitted By: Vladimir Ulogov (vulogov)
Assigned to: Nobody/Anonymous (nobody)
Summary: Add sqlite storage option

Initial Comment:
In addition to the BerkleyDB, I'd like to use sqlite as
well

----------------------------------------------------------------------

>Comment By: Kenny Pitt (kpitt)
Date: 2005-12-05 10:04

Message:
Logged In: YES 
user_id=859086

I actually had a mostly working SQLite storage class back 
when SQLite 2.x was current, but the performance was so 
abysmal that I didn't go any further with it.  I never got 
around to digging it out and testing it with the 3.x 
version of SQLite, which is supposed to have better 
performance.

SQLite generally performs pretty well for reads and for 
writes that are batched together in a transaction.  
Unfortunately, the current SpamBayes database access 
includes a fairly large number of writes (especially when 
training, although it also tracks statistics on every 
message received), and the writes are generally committed 
after each change rather than batched until the end of a 
large operation.  This mode of access is pretty much the 
worst case scenario for SQLite performance.

If anyone is interested in doing any more work with this, 
I'll see if I can locate my old code and post it as a 
patch.

----------------------------------------------------------------------

Comment By: Tony Meyer (anadelonbrin)
Date: 2005-12-05 04:11

Message:
Logged In: YES 
user_id=552329

Note also that there have been a few people on the mailing
list that have mentioned intending to do this.  You could
try seeing if any have, and if they'd be willing to
contribute the code either to you or back to the project.

----------------------------------------------------------------------

Comment By: Tony Meyer (anadelonbrin)
Date: 2004-07-15 21:40

Message:
Logged In: YES 
user_id=552329

This is a feature request, not a patch, so changing type.

----------------------------------------------------------------------

Comment By: Tony Meyer (anadelonbrin)
Date: 2004-02-05 03:45

Message:
Logged In: YES 
user_id=552329

Note that you can use mysql or postgresql.  Are either of
those good enough?  If not, then you could maybe write your
own SQLiteClassifier class, based on the other SQL ones in
storage.py.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=498106&aid=859339&group_id=61702