[Spambayes] The database question that would not die

[Brad Clements]

On 2 Dec 2002 at 12:19, Neale Pickett wrote:

> Unless your "database instance" is something the rest of us would be
> interested in?  You've piqued my interest, Brad, now you gotta tell us what
> you're up to ;)

Just playing around with compressing the token list.

So, I take 315680 tokens from my training database, stored as a pickle is 4,597,551 
bytes, but I can get it down to 2,105,046 bytes with almost no decompression 
overhead.

But .. What I really want to do is replicate the pickle/db speed trials so I can do some 
real testing, both on linux and windows, memory mapped or not. 

I think the "database interface" should be abstract, regardless of what I do. 


Brad Clements,                bkc@murkworks.com   (315)268-1000
http://www.murkworks.com                          (315)268-9812 Fax
AOL-IM: BKClements