[spambayes-dev] RE: [Spambayes] How low can you go?

[T. Alexander Popiel]

In message:  <LNBBLJKPBEHFEDALKOLCEEIJIAAB.tim.one at comcast.net>
             "Tim Peters" <tim.one at comcast.net> writes:
>
>So what may be more important now, building on Alex's incremental testers,
>isn't the sheer number of messages so much as the span of time they cover.

I've been having this supposition, too, but was afraid of scaring
people off by voicing it.  After all, I don't know if anyone else
has been anal enough to have been maintaining growing corpora for
over a year...

>OTOH, I don't have enough exhaustive personal email saved away to measure
>anything other than how the system performs across a few days, and a scheme
>that "learns fast" starting from nothing *may* also be slow to adapt to
>changes over time (we all know a bright kid who never outgrew their
>6th-grade worldview, right <wink>?).

Heh.  I could be convinced to run the bigram scheme over my dataset
after I'm done with my current set of tests... though I may need
a gig of memory to do it. ;-)  My current 256 meg is dying under
the load of TOE with expiry.

- Alex