Mailman 3 April 2004 - spambayes-dev

RE: [spambayes-dev] Testing Tools Changes
by Tony Meyer May 26, 2004

May 26, 2004

[me] > I also changed fpfn.py to print out each message and > offer to move it to the corresponding ham/spam set (I used it > to check for misclassified messages), > but it doesn't seem like this is a good addition to the script. Browsing, I notice that this has been offered before (which would have saved me the bother): [ 618932 ] fpfn.py: add interactivity on unix <http://sourceforge.net/tracker/index.php?func=detail&aid=618932&group_id=61 702&atid=498105> I don't know if this makes it any more/less worthwhile including, though. =Tony Meyer

2 1

RE: [spambayes-dev] FW: Overnight shipping on xãnax,valíum and more
by Tony Meyer May 3, 2004

May 3, 2004

> Mark, attached is a logfile I got from Glenn that was not > CC'd to the list. Maybe this will give you some more ideas > as to what's going wrong. [...] I had something pretty similar to this myself just this morning (traceback at end of message). I believe that I caused it by force quitting Outlook when it was busy working at something. Not long afterwards I also got the "Bayes database has X, message database has Y" error message. You'll notice that Glenn also does: """ Bayes database initialized with 14808 spam and 3729 good messages *** - message database has 18536 messages - bayes has 18537 - something is screwey """ Perhaps something similar is at fault here? In any case, retraining does look like the best option, and it solved the "buttons don't do anything" problem for me, too. (I have the two old databases if anyone really cares, but it doesn't seem worth looking at). There is a lot of training there, but on the plus side retraining will mean things work faster, the imbalance can be addressed, and lots of us (IIRC) are happy with sub-1000-message databases. Plus the problem will be fixed :) (I'm just hoping this doesn't mean that I'm now channelling all the problems that arise here... <wink>) =Tony Meyer """ Traceback (most recent call last): File "C:\Python23\lib\site-packages\win32com\server\policy.py", line 275, in _Invoke_ return self._invoke_(dispid, lcid, wFlags, args) File "C:\Python23\lib\site-packages\win32com\server\policy.py", line 280, in _invoke_ return S_OK, -1, self._invokeex_(dispid, lcid, wFlags, args, None, None) File "C:\Python23\lib\site-packages\win32com\server\policy.py", line 542, in _invokeex_ return func(*args) File "D:\spambayes\Outlook2000\addin.py", line 700, in OnClick TrainAsHam(msgstore_message, self.manager, save_db = False) File "D:\spambayes\Outlook2000\addin.py", line 142, in TrainAsHam if train.train_message(msgstore_message, False, manager.classifier_data): File "D:\spambayes\Outlook2000\train.py", line 52, in train_message cdata.bayes.learn(tokenize(stream), is_spam) File "D:\spambayes\spambayes\classifier.py", line 273, in learn self._add_msg(wordstream, is_spam) File "D:\spambayes\spambayes\classifier.py", line 375, in _add_msg record = self._wordinfoget(word) File "D:\spambayes\spambayes\storage.py", line 261, in _wordinfoget r = self.db.get(word) File "C:\Python23\Lib\shelve.py", line 111, in get return self[key] File "C:\Python23\Lib\shelve.py", line 119, in __getitem__ value = Unpickler(f).load() cPickle.UnpicklingError: invalid load key, ' '. """

2 1

RE: [spambayes-dev] Release 1.0?
by Mark Hammond May 3, 2004

May 3, 2004

> Other than that, the only killer flaw I notice ten times a day (in the > Outlook addin) is that in the "Filter messages ..." dialog, "Start > Filtering" should be the DEFPUSHBUTTON instead of "Close". I've got > "Automatically move pointer to the default button in a dialog > box" enabled > on my laptop (I hate using touchpads!), and so my mouse > pointer always flies > to the wrong button when I open that dialog. Fixed! > "Start > Training" would be a > more useful default button on the Training tab too. That one is harder, as the existing default button (Close) is not on the property-page, but the parent. Setting "Start" to DEFPUSHBUTTON gets it drawn like it is the default, but "Close" still does too and seems to win :) > Fantastic work, everyone! Absolutely! Not one of us here could have done anything with the others. Congratulations, and thank you! Mark.

4 3

RE: [spambayes-dev] Microsoft Exchange Server integration / WebInterface Integration
by Ryan Malayter April 30, 2004

April 30, 2004

[Kevin Bruckert] > On an Microsoft Exchange 2003 server, we receive > plenty of spam. I've tried various solutions, but they > all fall short in the UI arena. What I want to do is > the following: Each user has a seperate database, > although an initial global database never hurt anyone. > >From there, users can either install a client module > into their Outlook, giving them an easy-to-use > feedback mechanism. Or, for many of the users, > integration into the Exchange Server web interface. > The integration into the web interface should be > smooth and easy-to-use as well, instead of having to > run between multiple places to report spam. > > By running the filters on the server, mail is filtered > on entry to the system, and allows quick access to > import email while on-the-go. > > I'm willing to put in as much effort as I can to do > such work, but might want a little help at various > stages to understand the existing architecture and > prevent re-working areas which are already written. The best server-side Exchange Server filter we evaluated in terms of UI was Sunbelt Software's iHateSpam Server Edition. We ended up buying it because it was the simplest to use and deploy, and works reasonably well, even though it's not a Bayesian filter. The only UI is a set of folders created in each users inbox that contain filtered spam as well as a whitelist and blacklist. I suggest you check it out, they have a free demo. We get capture rates of 88% with the current version and our threshold set to 170. None of the other commercial or open-source Bayesian filters - which filter more accurately - came close to iHateSpam SE in terms of deployment ease and ease of use. Those two factors overrode all of our other criteria. That said, if you want to use Spambayes in a sever-side scenario, you'll have to customize the code a lot to make it work. You might be better off trying to use something like DSPAM on a linux box as a gateway in front of your Exchange server. It has per-user filtering. Another option that worked well for us for a while was ASSP, avalable at http://assp.sourceforge.net. However, it does not do per-user filtering. It has one DB for all users on a server. We ended up abandoning it because we couldn't get our test group to train it well, despite lots of instruction. The performance was very good when it was only the IT department using it, though ;-). Regards, Ryan

1 0

Microsoft Exchange Server integration / Web Interface Integration
by Kevin Bruckert April 30, 2004

April 30, 2004

I've searched back a few months, found someone (Sean) discussing this back in June of 2003, but no follow-up since, nor found any useful links (in my opinion). So let me explain my interests, and also offer my assistance (I'm a seasoned programmer, although new to Python... But I learn fast). On an Microsoft Exchange 2003 server, we receive plenty of spam. I've tried various solutions, but they all fall short in the UI arena. What I want to do is the following: Each user has a seperate database, although an initial global database never hurt anyone. >From there, users can either install a client module into their Outlook, giving them an easy-to-use feedback mechanism. Or, for many of the users, integration into the Exchange Server web interface. The integration into the web interface should be smooth and easy-to-use as well, instead of having to run between multiple places to report spam. By running the filters on the server, mail is filtered on entry to the system, and allows quick access to import email while on-the-go. I'm willing to put in as much effort as I can to do such work, but might want a little help at various stages to understand the existing architecture and prevent re-working areas which are already written. Thanks, Kevin Bruckert __________________________________ Do you Yahoo!? Win a $20,000 Career Makeover at Yahoo! HotJobs http://hotjobs.sweepstakes.yahoo.com/careermakeover

1 0

Access rights for spambayes outlook plugin
by Hartmann, Gunther April 30, 2004

April 30, 2004

Dear All, I have scanned all the FAQ for my problem but couldn't find any hint, so I try this way. I would like to have my Inbox scanned by a collegue's spambayes while I am out of office. We are running Outlook 2000 against an exchange server and my collegue openes my inbox during startup of his outlook. However he can't select my inbox in the spambayes managers folder selection box. It is displayed and one can select the checkbox but the message at the bottom doesn't reflect this additional selection and stays with '1 folder selected'. Clicking on OK doesn't select this additional inbox either. If I configure the spambayes .ini-File by adding a second inbox-identifier it refuses to start spambayes and the log file reads 'access refused'. So my question is: what access rights do I need pass to my collegue on what? I tried the highest possible one (which is 8) on both my mailbox AND the inbox folder - but it didn't work. Any hints? Mit freundlichen Grüßen / Best Regards / Saludos Gunther Hartmann Dr. Gunther Hartmann Director R&D KAMAX Tel: +49 6633 79 162 Fax +49 6633 79 6162 mailto:g.hartmann@kamax.de http://www.kamax.com

1 0

RE: [Python-Dev] SSH problems getting into SourceForge's CVS?
by Tim Peters April 29, 2004

April 29, 2004

If you're getting messages like this today when trying to cvs up: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @ WARNING: POSSIBLE DNS SPOOFING DETECTED! @ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ The RSA1 host key for cvs.spambayes.sourceforge.net has changed, and the key for the according IP address 66.35.250.209 is unknown. This could either mean that DNS SPOOFING is happening or the IP address for the host and its host key have changed at the same time. @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY! [yadda yadda yadda] it's apparently because SourceForge changed the way they like their CVS servers to get addressed. Here's a link to a python-dev article with a Python script to crawl over your checkout tree and change the hidden CVS cruft so that SF stops whining at you: http://mail.python.org/pipermail/python-dev/2004-April/044593.html For example, in the root of my spambayes checkout, I ran cvs_chroot.py :ext:tim_one@cvs.sourceforge.net:/cvsroot/spambayes and then SF stopped complaining. The hostname part of my URLs used to be "cvs.spambayes.sourceforge.net", and SF doesn't want the "spambayes." part there anymore. Since this string gets buried in CVS admin files in each of your subtrees too, you really don't want to hunt them down and fiddle them all by hand.

1 0

Spam Bayes falls over regularly
by Clare Wagemans April 29, 2004

April 29, 2004

Dear Sir Every now and then, not only after updating, I get the message that Spam Bayes is not working. The box "Definite Spam" just disappears and I have to create a new one, enable Spam Bayes and then retrain. I think I would have had it happen about 5 times in 6 months. regards Clare Wagemans

1 0

Re: no messages to review
by paul sorenson April 28, 2004

April 28, 2004

Today the proxy decided there were messages to review. I have buttons "previous day" "refresh" "next day" and ended up with 4 screenfuls of messages for training. If spambayes reports no messages to train but I have been receiving messages, is there a simple way to check what criterion it is using? > ------------------------------ > > Message: 3 > Date: Wed, 28 Apr 2004 09:27:39 +1000 > From: paul sorenson <sourceforge(a)metrak.com> > Subject: [spambayes-dev] no messages to review > To: spambayes-dev(a)python.org > Message-ID: <408EEC6B.20007(a)metrak.com> > Content-Type: text/plain; charset=us-ascii; format=flowed > > I am running spampayes proxy with mozilla thunderbird on Win XP. I just > installed 1.0b1 in the last couple of days. > > When I attempt to review messages I see the message: "There are no > untrained messages to display". This is despite receiving dozens of > email each day. > > This has been happening for some time (before this install). Then every > now and then it seems to recognize a whole lot of messages. Clicking > "previous day" followed by "next day" doesn't seem to get me back to > where I started.

1 0

RE: [spambayes-dev] Possible new header parsing option...
by Ryan Malayter April 28, 2004

April 28, 2004

[combover] >My one concern with the specification itself, though, is: >what's to stop spammers from forging these headers >themselves? Nothing, as you've guessed correctly. >Is there a mechanism in the existing MTA plugins to discard >any SPF headers already in place in a received mail? I know >this is probably not the best place for those concerns, so >maybe i'll subscribe to their dev list... That would be the correct approach. If a recieveing MTA checks for SPF compliance, should throw out all other SPF-related headers before adding its own. Assuming the MTAs do this correctly, and SPF use becomes widespread (my domain is one of only 7500 or so registered), these headers will be very useful clues to spambayes. However, with Microsoft supporting Caller-ID for Email, and Yahoo! supporting Domain Keys, SPF may not be the ultimate winner as a sending-host verification standard. I'm placing my bets on a unified standard ermerging sometime in the next few years. Spam costs Yahoo! And MS so much money they cannot afford to bicker about this issue too long.

1 0