Mailman 3 September 2003 - SpamBayes

RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express (bug?)
by Meyer, Tony Sept. 29, 2003

Sept. 29, 2003

> When "return True" is added as I wrote in the last email, it > seems to be working all right. Fantastic. Ignore the question at the end of the previous email, then. > Thanks. :) No, thank *you*, for tracking those bugs down. Much appreciated. =Tony Meyer

1 0

RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express (bug?)
by Meyer, Tony Sept. 29, 2003

Sept. 29, 2003

> That means, when I find some email classified wrong and want > to correct it then I have to train it first? Then what's the > meaning of using smtp proxy with spambayes_spam/ham@localhost? No, you don't have to train it first. smtpproxy can train messages that are in any of the three caches. If the message is in the unknown cache, it means that it hasn't yet been trained, and so it is. If it's in the ham cache, then it has already been trained as ham (so either no training is done, or it is untrained as ham and trained as spam). Similarly for the spam cache (but in reverse). If the only training you do is via smtpproxy (and you only train a message once) then it will find all messages in the unknown cache, and move them into the appropriate new locations. > >So, to confirm, you're sending an email to spambayes_ham@localhost > >which has the id of a message in one of the three caches and you get > >the "maybe already deleted" error? Note that if you're copying & > >pasting the id in, you need to include the "X-Spambayes-ID: " bit as > >well as the id itself. > Yes. I think I found another bug. > > train_message_in_pop3proxy_cache and > train_message_on_imap_server should > return True at the end as they succeeded in retraining. Indeed they should. I've fixed this, too, thanks. (smtpproxy underwent a reasonably big refit not that long ago and obviously hasn't quite recovered, yet. I'm writing up a test suite for it at the moment, but haven't had a chance to get much of it done yet). If you fix this, does that fix the problem? I can see how this would mean that even after successfully training from the pop3proxy cache you'd get the "could not find message" error. =Tony Meyer

1 0

RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express (bug?)
by Austine Jane Sept. 29, 2003

Sept. 29, 2003

When "return True" is added as I wrote in the last email, it seems to be working all right. Thanks. :) >From: "Meyer, Tony" <T.A.Meyer(a)massey.ac.nz> >To: "Austine Jane" <janeaustine50(a)hotmail.com>, <spambayes(a)python.org> >Subject: RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express >(bug?) >Date: Mon, 29 Sep 2003 16:50:39 +1200 > > > I think there is some kind of problem with spambayes caching and > > classification. When I compose email which includes spam > > words to my account and load them into the local pop3 proxy, spambayes > > classifies it as spam and attaches appropriate > > X-Spambayes-Classification header. However, as I examine the > > cache folders, the email is put in the unknown cache folder not > > in the spam cache folder. > >This is the correct behaviour. The message has been *classified* as >spam, but not *trained* as spam. If you trained the message (via the >web interface, for example), it should move from the unknown cache to >the spam one. The unknown cache holds all the messages that haven't >been trained yet. > > > Hence, the error messgae "Could not > > extract id" as I forward the email to spambayes_ham@localhost. > >This is not the correct behaviour, however. The smtp proxy is meant to >search through all three caches when attempting to find the message >(this means, for example, that it can correct messages that have been >incorrectly *trained*, not just incorrectly *classified*). > >So, to confirm, you're sending an email to spambayes_ham@localhost which >has the id of a message in one of the three caches and you get the >"maybe already deleted" error? Note that if you're copying & pasting >the id in, you need to include the "X-Spambayes-ID: " bit as well as the >id itself. > >=Tony Meyer _________________________________________________________________ Add photos to your e-mail with MSN 8. Get 2 months FREE*. http://join.msn.com/?page=features/featuredemail

1 0

RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express (bug?)
by Austine Jane Sept. 29, 2003

Sept. 29, 2003

>From: "Meyer, Tony" <T.A.Meyer(a)massey.ac.nz> >To: "Austine Jane" <janeaustine50(a)hotmail.com>, <spambayes(a)python.org> >Subject: RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express >(bug?) >Date: Mon, 29 Sep 2003 16:50:39 +1200 > > > I think there is some kind of problem with spambayes caching and > > classification. When I compose email which includes spam > > words to my account and load them into the local pop3 proxy, spambayes > > classifies it as spam and attaches appropriate > > X-Spambayes-Classification header. However, as I examine the > > cache folders, the email is put in the unknown cache folder not > > in the spam cache folder. > >This is the correct behaviour. The message has been *classified* as >spam, but not *trained* as spam. If you trained the message (via the >web interface, for example), it should move from the unknown cache to >the spam one. The unknown cache holds all the messages that haven't >been trained yet. That means, when I find some email classified wrong and want to correct it then I have to train it first? Then what's the meaning of using smtp proxy with spambayes_spam/ham@localhost? > > > Hence, the error messgae "Could not > > extract id" as I forward the email to spambayes_ham@localhost. > >This is not the correct behaviour, however. The smtp proxy is meant to >search through all three caches when attempting to find the message >(this means, for example, that it can correct messages that have been >incorrectly *trained*, not just incorrectly *classified*). > >So, to confirm, you're sending an email to spambayes_ham@localhost which >has the id of a message in one of the three caches and you get the >"maybe already deleted" error? Note that if you're copying & pasting >the id in, you need to include the "X-Spambayes-ID: " bit as well as the >id itself. > >=Tony Meyer Yes. I think I found another bug. train_message_in_pop3proxy_cache and train_message_on_imap_server should return True at the end as they succeeded in retraining. Cheers, Jane _________________________________________________________________ MSN 8 with e-mail virus protection service: 2 months FREE* http://join.msn.com/?page=features/virus

1 0

RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express (bug?)
by Meyer, Tony Sept. 29, 2003

Sept. 29, 2003

> I think there is some kind of problem with spambayes caching and > classification. When I compose email which includes spam > words to my account and load them into the local pop3 proxy, spambayes > classifies it as spam and attaches appropriate > X-Spambayes-Classification header. However, as I examine the > cache folders, the email is put in the unknown cache folder not > in the spam cache folder. This is the correct behaviour. The message has been *classified* as spam, but not *trained* as spam. If you trained the message (via the web interface, for example), it should move from the unknown cache to the spam one. The unknown cache holds all the messages that haven't been trained yet. > Hence, the error messgae "Could not > extract id" as I forward the email to spambayes_ham@localhost. This is not the correct behaviour, however. The smtp proxy is meant to search through all three caches when attempting to find the message (this means, for example, that it can correct messages that have been incorrectly *trained*, not just incorrectly *classified*). So, to confirm, you're sending an email to spambayes_ham@localhost which has the id of a message in one of the three caches and you get the "maybe already deleted" error? Note that if you're copying & pasting the id in, you need to include the "X-Spambayes-ID: " bit as well as the id itself. =Tony Meyer

1 0

RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express (bug?)
by Austine Jane Sept. 29, 2003

Sept. 29, 2003

>From: "Meyer, Tony" <T.A.Meyer(a)massey.ac.nz> >To: "Austine Jane" <janeaustine50(a)hotmail.com>, <spambayes(a)python.org> >Subject: RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express >(bug?) >Date: Mon, 29 Sep 2003 12:01:56 +1200 > > > I have looked into sb_smtpproxy.py source code, and found > > that the proxy examines the body part of email as well to > > find cached mail id. So I copied the original spambayes > > headers into the body and forwarded to the smtp > > proxy. It seemed to be working. > >Yes, that would also work. When I said that it wouldn't work with OE, I >meant without going through this sort of thing (finding the id then >pasting it into a message seems more hassle than just using the web >interface). > > > "Could not extract id" message is not shown > > anymore. In the train_cached_message method, however, the > > if-statement prints "Could not find message...perhaps it was >deleted..." > >Hopefully, exactly what it says :) If you look in the three cache >folders, is there a file with the same name as the id? If not, then it >has expired (the default is to last 7 days), and so can't be used for >training. > First of all, thank you for your reply. I think there is some kind of problem with spambayes caching and classification. When I compose email which includes spam words to my account and load them into the local pop3 proxy, spambayes classifies it as spam and attaches appropriate X-Spambayes-Classification header. However, as I examine the cache folders, the email is put in the unknown cache folder not in the spam cache folder. Hence, the error messgae "Could not extract id" as I forward the email to spambayes_ham@localhost. Shouldn't it be corrected? > > (actually, I had to modify that line so that the strings are > > concatenated first due to the TypeError: not all arguments converted > > during string formatting -- a bug.) > >Thanks, fixed that, too. > >=Tony Meyer Cheers, Jane _________________________________________________________________ Help STOP SPAM with the new MSN 8 and get 2 months FREE* http://join.msn.com/?page=features/junkmail

1 0

OE tags s/b at the end not the start of the subject line.
by John A. Peters Sept. 29, 2003

Sept. 29, 2003

When running SpamBayes with Outlook Express it is better if the tag is appended to the end of the subject line instead of at the beginning. Other spam filters offer this as an option, but I think it is simpler to just put it at the end. The OE filter will work just as well with it there and it does not get in the way as much when you are scanning a bunch of spam to be sure all is well and that there are no false positives. I have never found one so that is a complement to your guys programming. John Peters

2 1

RE: [Spambayes] pop3/smtp proxy with Outlook/Outlook Express (bug?)
by Meyer, Tony Sept. 29, 2003

Sept. 29, 2003

> I have looked into sb_smtpproxy.py source code, and found > that the proxy examines the body part of email as well to > find cached mail id. So I copied the original spambayes > headers into the body and forwarded to the smtp > proxy. It seemed to be working. Yes, that would also work. When I said that it wouldn't work with OE, I meant without going through this sort of thing (finding the id then pasting it into a message seems more hassle than just using the web interface). > "Could not extract id" message is not shown > anymore. In the train_cached_message method, however, the > if-statement prints "Could not find message...perhaps it was deleted..." Hopefully, exactly what it says :) If you look in the three cache folders, is there a file with the same name as the id? If not, then it has expired (the default is to last 7 days), and so can't be used for training. > (actually, I had to modify that line so that the strings are > concatenated first due to the TypeError: not all arguments converted > during string formatting -- a bug.) Thanks, fixed that, too. =Tony Meyer

1 0

RE: [Spambayes] Bugreport / Problems with initial setup
by Meyer, Tony Sept. 28, 2003

Sept. 28, 2003

> I get this on the "Select Filter Folders" page: [...] > File > "/usr/lib/python2.2/site-packages/spambayes/ImapUI.py", line > 195, in _login_to_imap > imap = IMAPSession(server, port) > > NameError: global name 'IMAPSession' is not defined Thanks. I've fixed this in cvs, so it'll be fixed for the next release. [...] > email.Errors.BoundaryError: multipart message with no defined boundary > > If I run it with -v, I can see at what point it died, and I > found the message it died on. It's spam (of course). I > think it's dying on this > header: > > Content-Type: multipart/mixed; This is bug #498103: <https://sourceforge.net/tracker/?func=detail&atid=498103&aid=737967&gro up_id=61702>. I'll try and get around to fixing this up soon. > One additional thing is that after it died, I had two copies > of all my messages. One with a header "X-Spambayes-MailID" > header, and one without, which was marked deleted. I guess > this is how SpamBayes checks if it's trained on that message > already? Why not use the Message-ID header if it exists? Because it might not exist, and it might not be unique (it should be, but then spam often doesn't follow the rules). I know that recreating the messages is ugly, but IMAP's an ugly protocol - if you could simply alter a message (you can't even *move* a message between folders!), or if servers were required to store user-defined flags, then there wouldn't be a problem. =Tony Meyer

1 0

RE: [Spambayes] Can't Save Configuration
by Meyer, Tony Sept. 28, 2003

Sept. 28, 2003

> I see. That makes sense. I was able to access localhost:8880 > both before and after, so it was running. (That is, pop3proxy > was running; what's sb_server/pop3proxy?) The script that handles the POP3 proxies, the SMTP proxies, and the web interface was called pop3proxy.py up until release 1.0a5. It has since been renamed sb_server.py, which is more accurate. pop3proxy_tray.py and pop3proxy_service.py haven't been renamed, as of yet. I wasn't sure which version you were using, so wasn't sure if you would have pop3proxy.py or sb_server.py (it's a confusing time!). > pop3proxy_service.py did not get installed anywhere. This is fixed in cvs, so will be fixed for the next release. > I had expanded the zip file to two locations, and found it under > the windows subdirectory in both places. I went ahead and ran > it from one of those locations. It said it started > successfully, but when I tried to save the configuration from > the Web interface, I got the following: > > 500 Server error > Traceback (most recent call last): [...] > File "F:\PROGRA~1\Python23\lib\bsddb\__init__.py", line > 192, in hashopen > d.open(file, db.DB_HASH, flags, mode) > > DBNoSuchFileError: (2, 'No such file or directory') This is odd. It's complaining that it can't open the database, but in that case it should just create a new one. You should have a bayescustomize.ini file - if you haven't created it yourself, then it should be in the directory "c:\documents and settings\application data\spambayes\proxy\" (if WinNT/2K/XP, if Win9x/Me, then "C:\windows\application data\spambayes\proxy", I think). Could you find that file and let us know what's in it? (There should be a line that starts: "persistent_storage_file:", which is the most relevant one). > > You could also try just > > using sb_server/pop3proxy (is this 1.0a6 or 1.0a5?) for the moment. > > How do I do that? Either run the pop3proxy_tray.py application (also in the windows directory, also mistakenly not installed with 1.0a6) after removing the service (run "pop3proxy_service remove"), or run "sb_server.py" - it will have been installed into the Python scripts directory. If you run it with pythonw (or change the extension to pyw) you won't get the console window displayed. =Tony Meyer

1 0