Mailman 3 April 2003 - SpamBayes

Outlook plugin - training
by Moore, Paul Dec. 3, 2003

Dec. 3, 2003

When the Outlook plugin filters mails, it classifies them as either spam or potential spam, and can put them in appropriate folders. In the spam/potential spam folders, there is a "Recover from Spam" button available, and in other folders there is a "Delete as spam" button. These buttons add the message to the training database as well as taking the appropriate action. One thing I don't see, however, is a means of confirming the classifier's decisions as correct. A "yes, that is spam" button for the spam folder, and a "yes, that's ham" button in non-spam folders. As I'm starting from a very small message base, I worry that correct classifications are still somewhat based on "luck", and training based on correct decisions would help to increase both my and the classifier's confidence level. I can do this by regular retraining, but that has 2 disadvantages: it's much clumsier than simply clicking on a "clever boy!" button, and it relies on me not deleting messages until I do a training run. Much of the ham I get is "read and forget", so I'd rather delete immediately. When I get a chance to dive into the code, I'll see how hard this would be to implement. Paul.

7 8

RE: [Spambayes] Outlook plugin - training
by Piers Haken Dec. 3, 2003

Dec. 3, 2003

I don't believe you need this. I think that the classifier automatically trains on messages as they arrive (or at least on messages that it's sure about). You only need to retrain if it has made a mistake, or if it's unsure. Piers. > -----Original Message----- > From: Moore, Paul [mailto:Paul.Moore@atosorigin.com] > Sent: Wednesday, November 06, 2002 2:09 AM > To: Spambayes (E-mail) > Subject: [Spambayes] Outlook plugin - training > > > When the Outlook plugin filters mails, it classifies them as > either spam or potential spam, and can put them in > appropriate folders. > > In the spam/potential spam folders, there is a "Recover from > Spam" button available, and in other folders there is a > "Delete as spam" button. These buttons add the message to the > training database as well as taking the appropriate action. > > One thing I don't see, however, is a means of confirming the > classifier's decisions as correct. A "yes, that is spam" > button for the spam folder, and a "yes, that's ham" button in > non-spam folders. > > As I'm starting from a very small message base, I worry that > correct classifications are still somewhat based on "luck", > and training based on correct decisions would help to > increase both my and the classifier's confidence level. > > I can do this by regular retraining, but that has 2 > disadvantages: it's much clumsier than simply clicking on a > "clever boy!" button, and it relies on me not deleting > messages until I do a training run. Much of the ham I get is > "read and forget", so I'd rather delete immediately. > > When I get a chance to dive into the code, I'll see how hard > this would be to implement. > > Paul. > > _______________________________________________ > Spambayes mailing list > Spambayes(a)python.org http://mail.python.org/mailman/listinfo/spambayes >

10 18

Lost database
by Greg Scott May 20, 2003

May 20, 2003

I had performed the initial training for the utility, and had around 1100 spam examples and 400+ ham examples. Outlook hung, and I had to abnormally terminate it and reboot in order for the computer to function properly. When I opened Outlook again, SpamBayes indicated there were no spam and no ham instances in its database. Unfortunately, I had already deleted my spam examples, and now don't have them for re-training. Is there a way to import that information from a backup file or anything? I am running XP, Outlook XP, and the binary version of the Outlook plugin. My Python version is ActiveState 2.2.4. Thanks in advance, Greg

7 14

RE: [Spambayes] Re: big imapfilter.py problem
by Meyer, Tony May 1, 2003

May 1, 2003

> The problem appears to be that imapfilter.py added an > X-Spambayes-Classification: header to the message, but failed > to add a newline afterwards, which is required to separate it > from the message body. That's definitely what it was - except that message.py (which does the adding for imapfilter.py) doesn't add it as a string, it adds an entry to the headers dict in the email.Message.Message object. It looks like the email package didn't add the separating newline when it flattened the message. > ...err, but I forgot to set PYTHONPATH to use email-2.5. > Training works when I do that. What version of the email package does it use if you don't see the PYTHONPATH? If this sort of thing is going to happen, it might be worth noting somewhere. (Currently, the docs say that you need "the latest" version of the email package, or whatever comes with Python 2.2.2 (email.__version__ == '2.4.3') or later. =Tony Meyer

2 1

Training corrupts mbox files
by David McLaughlin May 1, 2003

May 1, 2003

I've been using spambayes for a couple of months now, and its results are spectacular. On my email setup, it easily catches 300 spams out of a total 400 messages each day, with virtually no false positives or negatives. I love it! My only problem with it is that it seems to trash my mbox files when I train it. I use the following training command to train it on ham and spam mboxes: mboxtrain.py -d $HOME/.hammiedb -g $HOME/mail_processing/caught/bayes_good -s $HOME/mail_processing/caught/spam It correctly learns the messages, but the two mbox files have a bunch of erroneous "messages" at the end, and opening the mbox up in mutt gives a series of errors concerning invalid uid sequences. Has anyone else had problems training spambayes on mbox files? Is there anything else I should be doing to prevent spambayes from rewriting the mbox file? It if helps, I can post a sample of the before and after mbox files to a webpage for perusal. Thanks, -- David McLaughlin david(a)dsmcl.net

7 15

Error on proxy connection & smtp proxy doesn't see spam
by sean darcy May 1, 2003

May 1, 2003

I'm trying out sb on a linux redhat 9.0 machine using evolution. The web based configuration doesn't work, so I created this for the .ini file: [pop3proxy] servers:mailhost.mydomain.com <---- this is a real domain ports:120 persistent_storage_file:/opt/spam/spambayes/data/hammie.db add_mailid_to:header include_prob:True [smtpproxy] servers:mail.optonline.net ports:220 ham_address:ham@spam spam_address:spam@spam In evolution, the mail server is set to localhost:120. The smtp server is set to localhost:220 I start up pop3proxy: pop3proxy.py Loading database... Done. SMTP Listener on port 220 is proxying mail.optonline.net:25 Listener on port 120 is proxying mailhost.mydomain.com:110 User interface url is http://localhost:8880/ When evol gets the mail, it says getting pop summary, then hangs waiting for the first message. at the terminal window where I ran pop3proxy I get: error: uncaptured python exception, closing channel <__main__.ServerLineReader connected at 0x8353a4c> (exceptions.TypeError:len() of unsized object [/usr/lib/python2.2/asyncore.py|poll|99] [/usr/lib/python2.2/asyncore.py|handle_read_event|396] [/usr/lib/python2.2/asynchat.py|handle_read|130] [/usr/bin/pop3proxy.py|found_terminator|147] [/usr/bin/pop3proxy.py|onServerLine|215] [/usr/bin/pop3proxy.py|onResponse|289] [/usr/bin/pop3proxy.py|onTransaction|390] [/usr/bin/pop3proxy.py|onRetr|459] [/usr/lib/python2.2/site-packages/spambayes/message.py|as_string|193] [/usr/lib/python2.2/site-packages/email/Message.py|as_string|109] [/usr/lib/python2.2/site-packages/email/Generator.py|flatten|102] [/usr/lib/python2.2/site-packages/email/Generator.py|_write|137] [/usr/lib/python2.2/site-packages/email/Generator.py|_write_headers|183] [/usr/lib/python2.2/site-packages/email/Header.py|encode|412] [/usr/lib/python2.2/site-packages/email/Header.py|_split|297] [/usr/lib/python2.2/site-packages/email/Charset.py|encoded_header_len|341]) Is this a bug - or did I misconfigure spambayes/ Second: I tried to "train" sb by sending spam to spam@spam. This seemed to go OK, but when I go to the web page the "Review Messages" shows no untrained messages. How do these training messages show up? thanks for any help sean _________________________________________________________________ Add photos to your messages with MSN 8. Get 2 months FREE*. http://join.msn.com/?page=features/featuredemail

2 1

[ spambayes-Bugs-730151 ] Outlook fails to classify
by SourceForge.net April 30, 2003

April 30, 2003

Bugs item #730151, was opened at 2003-04-30 21:55 Message generated for change (Comment added) made by mhammond You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=730151&group_i… Category: Outlook Group: None Status: Open Resolution: None Priority: 5 Submitted By: Fredrik Rodland (fmmr) Assigned to: Mark Hammond (mhammond) Summary: Outlook fails to classify Initial Comment: After updating to the latest CVS version today, I get the following tracebacks whenever a mails arrives: pythoncom error: Python error invoking COM method. Traceback (most recent call last): File "C:\PROGRA~1\_DEV\Python22\lib\site- packages\win32com\server\policy.py", line 275, in _Invoke_ return self._invoke_(dispid, lcid, wFlags, args) File "C:\PROGRA~1\_DEV\Python22\lib\site- packages\win32com\server\policy.py", line 280, in _invoke_ return S_OK, -1, self._invokeex_(dispid, lcid, wFlags, args, None, None) File "C:\PROGRA~1\_DEV\Python22\lib\site- packages\win32com\server\policy.py", line 601, in _invokeex_ return DesignatedWrapPolicy._invokeex_( self, dispid, lcid, wFlags, args, kwArgs, serviceProvider) File "C:\PROGRA~1\_DEV\Python22\lib\site- packages\win32com\server\policy.py", line 541, in _invokeex_ return apply(func, args) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\ Outlook2000\addin.py", line 210, in OnItemAdd ProcessMessage(msgstore_message, self.manager) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\ Outlook2000\addin.py", line 170, in ProcessMessage disposition = filter.filter_message (msgstore_message, manager) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\ Outlook2000\filter.py", line 15, in filter_message prob = mgr.score(msg) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\ Outlook2000\manager.py", line 440, in score return self.bayes.spamprob(bayes_tokenize(email), evidence) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\s pambayes\classifier.py", line 217, in chi2_spamprob clues = self._getclues(wordstream) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\s pambayes\classifier.py", line 441, in _getclues prob = self.probability(record) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\s pambayes\classifier.py", line 301, in probability assert hamcount <= nham exceptions.AssertionError: ---------------------------------------------------------------------- >Comment By: Mark Hammond (mhammond) Date: 2003-05-01 07:55 Message: Logged In: YES user_id=14198 This has come up before - I am afraid you really must re-train ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=730151&group_i…

1 0

Spambayes disappeared!
by Roberts, Denny April 30, 2003

April 30, 2003

We are testing Spambayes on several machines in our IS department. We have it loaded on W2K Prof. / Outlook 2000 which is running very well, whacking spam left and right (Love it!!!). But on the WXP Prof. / Outlook XP machine Spambayes ran fine for two weeks then disappeared from Outlook this morning. It still shows up in Add/Remove programs, the directory is still there but won't load with Outlook XP. We have deinstalled then reinstalled to no avail. We are using version 002 of the plugin from Mark Hammond. Any ideas on where to look for the problem? Denny Roberts Technical Services Administrator, IS Paramount Care, Inc. Office: (419) 887-2101 Fax: (419) 887-2019 <mailto:denny.roberts@promedica.org> <http://www.paramounthealthcare.com/>

2 1

Outlook 98 compatibility
by Montjaux, Jocelyn April 30, 2003

April 30, 2003

Well first kudos to all of you guys. I am using installer 002 for Outlook XP and it works great. I would like to install SpamBayes Outlook add-in on Outlook 98 on NT4 SP6 but I get: spambayes_addin.dll Unable to register the DLL/OCX: DllRegisterServer failed; code 0x00000000 Looks like that "good" ol' Outlook 98 does not support plugins in this way? Is there a workaround? Regards, Jocelyn

1 0

[ spambayes-Bugs-730151 ] Outlook fails to classify
by SourceForge.net April 30, 2003

April 30, 2003

Bugs item #730151, was opened at 2003-04-30 13:55 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=730151&group_i… Category: Outlook Group: None Status: Open Resolution: None Priority: 5 Submitted By: Fredrik Rodland (fmmr) Assigned to: Mark Hammond (mhammond) Summary: Outlook fails to classify Initial Comment: After updating to the latest CVS version today, I get the following tracebacks whenever a mails arrives: pythoncom error: Python error invoking COM method. Traceback (most recent call last): File "C:\PROGRA~1\_DEV\Python22\lib\site- packages\win32com\server\policy.py", line 275, in _Invoke_ return self._invoke_(dispid, lcid, wFlags, args) File "C:\PROGRA~1\_DEV\Python22\lib\site- packages\win32com\server\policy.py", line 280, in _invoke_ return S_OK, -1, self._invokeex_(dispid, lcid, wFlags, args, None, None) File "C:\PROGRA~1\_DEV\Python22\lib\site- packages\win32com\server\policy.py", line 601, in _invokeex_ return DesignatedWrapPolicy._invokeex_( self, dispid, lcid, wFlags, args, kwArgs, serviceProvider) File "C:\PROGRA~1\_DEV\Python22\lib\site- packages\win32com\server\policy.py", line 541, in _invokeex_ return apply(func, args) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\ Outlook2000\addin.py", line 210, in OnItemAdd ProcessMessage(msgstore_message, self.manager) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\ Outlook2000\addin.py", line 170, in ProcessMessage disposition = filter.filter_message (msgstore_message, manager) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\ Outlook2000\filter.py", line 15, in filter_message prob = mgr.score(msg) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\ Outlook2000\manager.py", line 440, in score return self.bayes.spamprob(bayes_tokenize(email), evidence) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\s pambayes\classifier.py", line 217, in chi2_spamprob clues = self._getclues(wordstream) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\s pambayes\classifier.py", line 441, in _getclues prob = self.probability(record) File "c:\Programfiler\_UTIL\spambayes_cvs\spambayes\s pambayes\classifier.py", line 301, in probability assert hamcount <= nham exceptions.AssertionError: ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=730151&group_i…

1 0