[Spambayes] The database question that would not die
Brad Clements
bkc at murkworks.com
Mon Dec 2 20:40:20 2002
On 2 Dec 2002 at 12:19, Neale Pickett wrote:
> Unless your "database instance" is something the rest of us would be
> interested in? You've piqued my interest, Brad, now you gotta tell us what
> you're up to ;)
Just playing around with compressing the token list.
So, I take 315680 tokens from my training database, stored as a pickle is 4,597,551
bytes, but I can get it down to 2,105,046 bytes with almost no decompression
overhead.
But .. What I really want to do is replicate the pickle/db speed trials so I can do some
real testing, both on linux and windows, memory mapped or not.
I think the "database interface" should be abstract, regardless of what I do.
Brad Clements, bkc@murkworks.com (315)268-1000
http://www.murkworks.com (315)268-9812 Fax
AOL-IM: BKClements
More information about the Spambayes
mailing list