[Spambayes] Need testers!

Neale Pickett neale@woozle.org
15 Sep 2002 23:51:13 -0700


Here's the result of my inbox vs. spambox.  The inbox is my 1000
personal messages, and some back posts to the thttpd list and the
virgule-dev list.  I've checked them all over for spam and I'm pretty
sure (but not certain) that they're clean.  The spambox is my spam
folder, which I'm pretty sure (but again not certain) is totally dirty.
For the second run I added the lines:

  [Classifier]
  adjust_probs_by_evidence_mass: True
  min_spamprob: 0.001
  max_spamprob: 0.999
  hambias: 1.5

to bayescustomize.ini.


results1s -> results2s
-> <stat> tested 382 hams & 417 spams against 1002 hams & 1000 spams
-> <stat> tested 327 hams & 690 spams against 1002 hams & 1000 spams
-> <stat> tested 1002 hams & 1000 spams against 382 hams & 417 spams
-> <stat> tested 327 hams & 690 spams against 382 hams & 417 spams
-> <stat> tested 1002 hams & 1000 spams against 327 hams & 690 spams
-> <stat> tested 382 hams & 417 spams against 327 hams & 690 spams
-> <stat> tested 382 hams & 417 spams against 1002 hams & 1000 spams
-> <stat> tested 327 hams & 690 spams against 1002 hams & 1000 spams
-> <stat> tested 1002 hams & 1000 spams against 382 hams & 417 spams
-> <stat> tested 327 hams & 690 spams against 382 hams & 417 spams
-> <stat> tested 1002 hams & 1000 spams against 327 hams & 690 spams
-> <stat> tested 382 hams & 417 spams against 327 hams & 690 spams

false positive percentages
    2.094  3.665  lost   +75.02%
    0.612  2.141  lost  +249.84%
    34.331  40.419  lost   +17.73%
    13.456  11.927  won    -11.36%
    52.695  59.481  lost   +12.88%
    44.503  57.330  lost   +28.82%

won   1 times
tied  0 times
lost  5 times

total unique fp went from 798 to 898 lost   +12.53%
mean fp % went from 24.6150141717 to 29.1603737144 lost   +18.47%

false negative percentages
    0.959  0.480  won    -49.95%
    1.014  1.014  tied
    0.800  0.700  won    -12.50%
    1.449  1.304  won    -10.01%
    0.100  0.100  tied
    0.240  0.240  tied

won   3 times
tied  3 times
lost  0 times

total unique fn went from 29 to 25 won    -13.79%
mean fn % went from 0.760468147221 to 0.639710840023 won    -15.88%