Mailman 3 April 2003 - SpamBayes

Re: [Spambayes] spamprob combining
by jm＠jmason.org April 27, 2003

April 27, 2003

Tim Peters said: > [Tim] > >> What is this? A SpamAssassin corpus? Nobody has mentioned that here > >> before. > [Justin Mason] > > Um, pretty sure I did ;) > > http://SpamAssassin.org/publiccorpus/ > > Yes, you did. As I said later, this was a very old message. I was sorry it > escaped, precisely because it failed to anticipate things that happened > after it was written, causing you needless aggravation <wink>. Yeah, sorry for the noise -- the old "should have read the rest of the thread before replying" conundrum ;) Damn time-travelling mail, --j.

1 0

RE: [Spambayes] Classifier Assertion error
by Meyer, Tony April 27, 2003

April 27, 2003

> This is happening with a new DB (and new > spambayes.messageinfo.db) trained with imapfilter: > > Loading database hammie.db... Loading state from hammie.db > database hammie.db is an existing database, with 96 spam and > 63 ham Done. Classifying Traceback (most recent call last): [...] > File "C:\Development\SpamBayes\spambayes\spambayes\classifier.py", > line 301, in probability > assert hamcount <= nham > AssertionError This is the same as SF #706520 ("assert fails in classifier"). If I understand things correctly, this probably means that the ham and spam counts in your database has become corrupted. This bug is one that we know really needs to get fixed, and people are thinking about at least, but hasn't yet been solved. I gather than what you can do is: (a) Retrain, if you have the data available (b) Use dbimpexp.py to convert your database to a text file. Change the ham and spam counts at the top to something like the numbers they should be (at the very least, they need to be greater or equal to the highest number in their column). Use dbimpexp.py to convert the text file back into a database. =Tony Meyer

2 1

gratuitous changes? + bugs
by Sjoerd Mullender April 27, 2003

April 27, 2003

I did a cvs update today, and I clearly shouldn't have. My programs based on spambayes ceased working for a variety of reasons. 1. OptionClass.mergefiles was renamed to OptionClass.merge_files. Gratuitous change? Or is there some deeper reason behind this. The change was not mentioned in the cvs log, by the way. 2. Boolean values in my .ini file (or at least the verbose flag) can't be parsed anymore. The reason is, the check is_boolen is incorrect for Python 2.3. It checks that the allowed_values is a bool, but in actual fact it's a tuple of bools. See the diff. 3. My setting of basic_header_skip and safe_headers didn't work anymore. The header names now have to be separated with a single space. Why? I propose the fix included in the diff. -- Sjoerd Mullender <sjoerd(a)acm.org> Index: Options.py =================================================================== RCS file: /cvsroot/spambayes/spambayes/spambayes/Options.py,v retrieving revision 1.43 diff -u -r1.43 Options.py --- Options.py 27 Apr 2003 05:11:40 -0000 1.43 +++ Options.py 27 Apr 2003 09:46:22 -0000 @@ -1183,7 +1183,8 @@ # considered valid input (and 0 and 1 don't look as nice) # So, just for the 2.2 people, we have this helper function try: - if type(self.allowed_values) == types.BooleanType: + if type(self.allowed_values) == types.TupleType and \ + type(self.allowed_values[0]) == types.BooleanType: return True return False except AttributeError: @@ -1354,7 +1355,7 @@ (opt, sect, filename) else: if self.multiple_values_allowed(sect, opt): - value = tuple(value.split(' ')) + value = tuple(value.split()) self.set(sect, opt, self.convert(sect, opt, value)) # not strictly necessary, but convenient shortcuts to self._options

1 0

Re: [Spambayes] spamprob combining
by jm＠jmason.org April 26, 2003

April 26, 2003

Tim Peters said: > > I ran the the SA Corpus > > What is this? A SpamAssassin corpus? Nobody has mentioned that here > before. Um, pretty sure I did ;) http://SpamAssassin.org/publiccorpus/ --j.

2 1

Advantages of S?
by Gary Robinson April 26, 2003

April 26, 2003

At present, it appears that S may perform better than relatively untweaked graham (as I guess bogofilter is using), but about the same as tweaked graham as spambayes is using, but has the advantage of showing a spread of results. As I see it there are two possible advantages to the spread: 1) emails in the middle could be classified as "you should manually check these", or 2) the user could adjust for the level of sensitivity he wants (similar to what happens now in Entourage which is otherwise brain-dead as a spam filter). (1) is a attractive but one thing worries me: it may give people a false sense of security -- they may think they only have to look at the middle ones, but occasionally even extreme cases of seeming to be spam might be legit. On the other hand, on those rare occasions, the sender can always try again if he doesn't get a response! ;) Just a couple of thoughts. --Gary -- Gary Robinson CEO Transpose, LLC grobinson(a)transpose.com 207-942-3463 http://www.emergentmusic.com http://radio.weblogs.com/0101454

8 19

[ spambayes-Bugs-725449 ] Addin won't initialize
by SourceForge.net April 26, 2003

April 26, 2003

Bugs item #725449, was opened at 2003-04-22 04:41 Message generated for change (Comment added) made by usertgo You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=725449&group_i… Category: Outlook Group: None Status: Open Resolution: None Priority: 5 Submitted By: dan maer (dmara) Assigned to: Mark Hammond (mhammond) Summary: Addin won't initialize Initial Comment: Running pure Windows (98SE) and Outlook 2000. No Python installed. I can't get the plugin to initialize. I go to Tools/options/other/advanced options/Com Addins and check the SpamBayes plug-in box, but it won't stayed checked, and I've uninstalled/reinstalled Outlook and the plugin but no go. I've got this working great, really great, on Winnt 4.0 and Xp. Logfile being attached for upload... Dan ---------------------------------------------------------------------- Comment By: J (usertgo) Date: 2003-04-26 05:03 Message: Logged In: YES user_id=763953 ok, since i liked it so much on win2000 i did the python install & manual install of the spambayes outlook addin & its working good now, so i guess it was the installer. thanks ---------------------------------------------------------------------- Comment By: J (usertgo) Date: 2003-04-24 05:10 Message: Logged In: YES user_id=763953 I also get the same errors as in the logfile on a Win98SE installation w/Outlook 2000 SP1, but it works on Win2000 w/same Outlook. If you have any workarounds (w/regedit?) please let us know... ---------------------------------------------------------------------- Comment By: dan maer (dmara) Date: 2003-04-23 03:06 Message: Logged In: YES user_id=759684 Ok Mark... Anyway to bypass the installer issue and get it working by manual means? Dan ---------------------------------------------------------------------- Comment By: Mark Hammond (mhammond) Date: 2003-04-22 23:19 Message: Logged In: YES user_id=14198 This is an issue with the "Installer" tool I use. I will try and sus it out before the next binary release. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=725449&group_i…

1 0

RE: [Spambayes] Re: imapfilter progress
by Meyer, Tony April 25, 2003

April 25, 2003

> > could you run imapfilter with the option "-i4"? [...] > ...so I set up some test "inbox, spam, unsure" folders and > tried to run: > > python imapfilter.py -v -i 5 -t -c -D ~/bayes.db > > Just so we'd have some data to look at. I got a traceback > while training on ham; the tail of the session is visible here: > http://users.rcn.com/abrahams/imap/bugout.txt This is odd. The message that it crashes on doesn't have any crlf's (even just a cr or lf) separating the headers. The ones above it do, though. Does your mailer show this message correctly? If the mailer has an option to show the message (or even the headers) in it's original form, does it show it correctly? I'd understand it more if it was imaplib or our imapfilter that was stripping the cr/lf chars, but from the trace, it looks like the raw text from the server doesn't have them - and the length of the message (with no cr/lf) matches the literal length (4278). I'm baffled. It would be easy to catch this error, but I don't know what to do then - if the headers can't be parsed, then when we try and rewrite the message into the correct folder all the headers will be lost (again :( ). I could add in a test so that training continues and messages like these are just ignored, but I can't think of anything else to try (well, except for writing a script to try and insert line endings where there should be line endings). Anyone else got any ideas? =Tony Meyer

2 1

Re: [Spambayes] spambayes-1.0a2 crashe
by Tim Stone - Four Stones Expressions April 25, 2003

April 25, 2003

4/25/2003 10:44:24 AM, woody burns <woody23107(a)yahoo.com wrote: Your message does not crash my post-alpha2 code, so I believe that whatever problem it caused has been corrected. Keep an eye out for the next release (either alpha3 or beta1). In the meantime, spammers have more to fear than you :) c'est moi - TimS http://www.fourstonesExpressions.com http://wecanstopspam.org There are 10 kinds of people in the world: those who understand binary, and those who don't.

1 0

spambayes-1.0a2 crashes
by woody burns April 25, 2003

April 25, 2003

I installed spambayes -1.0a2 6 weeks ago on a linux machine. It installed good and was easily trained. It has been working great until yesterday. I received the attached email message, and it causes the filter to crash, giving the traceback of last several steps it performed. The same message also crashes the trainer. Did someone find a way to discourge spambayes? I hope not it is a great time saver. Thanks, woody23107(a)yahoo.com __________________________________________________ Do you Yahoo!? The New Yahoo! Search - Faster. Easier. Bingo http://search.yahoo.com Received: from cvncvlcom.com ([211.104.129.150]) by xxxxxxxx ; Thu, 24 Apr 2003 14:02:13 -0500 Received: from xmxpita.mx.aol.com ([223.38.72.195]) by broome1.hotmail.com with Microsoft SMTPSVC id 235C4F74; Wed, 23 Apr 2003 18:57:30 -0000 Received: from esmtp.mail.lycos.com ([40.160.190.204]) by singularity.google.com with SMTP id 28EEF4CF; Wed, 23 Apr 2003 18:57:20 -0000 Received: from abyss.excite.com ([16.209.175.205]) by maelstrom.linksynergy.com with ESMTP id 1ADAF584; Wed, 23 Apr 2003 18:57:10 -0000 Date: Thu, 24 Apr 2003 03:57:10 +0900 From: ŸÈÀü!!<xviixviivxii(a)hotmail.com> To: hotmail.com Subject: =?ks_c_5601-1988?B?KLG ksO0pIDG?==?EUC-KR?B?5fzg9b7IwPwg4+a788ewIL7Is7sgvLG5sLW1?= OK ^^ MIME-Version: 1.0 Content-Type: text/html; charset="iso-8859-1" Message-ID: <105121093401@xxxxxxxxx> Return-Path: <xviixviivxii(a)hotmail.com> X-Rcpt-To: <vvvvvv@xxxxxxxxxxxxx> X-DPOP: Version number supressed X-UIDL: 1051210959.230669 Status: U <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> <HTML><HEAD> <META http-equiv=Content-Type content="text/html; charset=ks_c_5601-1987"> <META content="MSHTML 6.00.2600.0" name=GENERATOR> <STYLE></STYLE> </HEAD> <BODY bgColor=#ffffff> <TABLE borderColor=fuchsia borderColorDark=fuchsia width=606 borderColorLight=fuchsia border=3> <TBODY> <TR> <TD width=596 height=267><A href="http://myhome.hanafos.com/~signup3/m.htm" target=_blank><IMG height=164 alt=q.gif src="http://myhome.hanafos.com/~signup3/q.gif" width=703 border=0></A> <P></P> <P><A href="http://myhome.hanafos.com/~signup3/m.htm" target=_blank><IMG height=613 alt=s.gif src="http://myhome.hanafos.com/~signup3/s.gif" width=700 border=0></A></P> <P><A href="http://myhome.hanafos.com/~signup3/n.htm" target=_blank><IMG alt=d.gif src="http://myhome.hanafos.com/~signup3/d.gif" border=0></A></P></TD></TR></TBODY></TABLE> <P><FONT color=white>[[</FONT></P> </BODY></HTML>

1 0

RE: [Spambayes] IMAP - it works!
by Meyer, Tony April 24, 2003

April 24, 2003

> > But there was one small error - seems to be to do with the Options > > setup - > > > > Attempted to set [imap] username with invalid value ('my-username',) > > (<type 'tuple'>) > > This is due to the regexes in Options.py. They only allow letters and > digits in usernames and passwords. My username contains > hyphens, and my > passwords usually have punctuation in them too (but not in this case. > > Changing the regexes to [\S]+ would seem reasonable. I'll fix this shortly. Thanks (again) for finding both the problem and the solution. =Tony Meyer

1 0