Mailman 3 June 2003 - spambayes-dev

[ spambayes-Bugs-761359 ] Folder view results in ImportError
by SourceForge.net June 26, 2003

June 26, 2003

Bugs item #761359, was opened at 2003-06-26 13:43 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=761359&group_i… Category: Outlook Group: None Status: Open Resolution: None Priority: 5 Submitted By: Mark Welsh (markw_x) Assigned to: Mark Hammond (mhammond) Summary: Folder view results in ImportError Initial Comment: When I open the anti-spam manager and navigate to any window with a folder tree view, I end up with an ImportError in my log (attached). I haven't noticed any immediate side-effects, but the add-in does crash Outlook periodically, so I thought this might be at least partially to blame. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=761359&group_i…

1 0

[ spambayes-Bugs-761318 ] Moved mail is unfiltered
by SourceForge.net June 26, 2003

June 26, 2003

Bugs item #761318, was opened at 2003-06-26 12:22 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=761318&group_i… Category: Outlook Group: None Status: Open Resolution: None Priority: 5 Submitted By: Mark Welsh (markw_x) Assigned to: Mark Hammond (mhammond) Summary: Moved mail is unfiltered Initial Comment: When I use Outlook's rules wizard to move my emails to a different folder, they aren't filtered by the add-in. Both the inbox, where the message arrives for a second before the rule is used, and the destination folder, where the message is moved by the rule, are listed as folders that should be filtered by the add-in. The spam that arrives is given a spam score but not filtered accordingly. This is an excerpt from the log for a piece of spam that was given a rating of 100%: Message 'Get Your NEW Car ASAP' had a Spam classification of 'Yes' Training on message 'Get Your NEW Car ASAP' - trained as good Training on message 'Get Your NEW Car ASAP' - trained as spam It was trained as spam because I clicked the "Delete as Spam" button, not because of the filtering. I have Outlook 2002 SP-2. I'm using the latest binary of the add-in (SpamBayes-Outlook-Setup-002.exe). The spam filtering works fine for all other mail that's left in the inbox and not moved by a rule. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=761318&group_i…

1 0

[ spambayes-Bugs-761316 ] failed binary install
by SourceForge.net June 26, 2003

June 26, 2003

Bugs item #761316, was opened at 2003-06-26 13:19 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=761316&group_i… Category: Outlook Group: None Status: Open Resolution: None Priority: 5 Submitted By: Andrew Shepard (sheparda) Assigned to: Mark Hammond (mhammond) Summary: failed binary install Initial Comment: running win98 and Outlook 2000 spambayes1.log file attached-- starts with 2 lines: "SpamAddin - Connecting to Outlook pythoncom error: Failed to call the universal dispatcher" followed by series of "tracebacks" to E: drive ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=761316&group_i…

1 0

[ spambayes-Bugs-761250 ] .dll doesn't stay checked in COM Add-Ins window
by SourceForge.net June 26, 2003

June 26, 2003

Bugs item #761250, was opened at 2003-06-26 15:40 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=761250&group_i… Category: Outlook Group: None Status: Open Resolution: None Priority: 5 Submitted By: James Noser (byjiminy) Assigned to: Mark Hammond (mhammond) Summary: .dll doesn't stay checked in COM Add-Ins window Initial Comment: I downloaded some Windows security patches yesterday and SpamBayes no longer appeared in the toolbar. I uninstalled and reinstalled both SpamBayes and Outlook. I tried to instal Spambayes using the binary and the addin.py source. The COM add-in appeared in the Outlook menu, I checked it, and chose OK. Then when I opened the COM add-in window again, the Spam Bayes add-in wasn't checked. The attached log file documents three tries. I removed the .dll from the COM add-in window, and then added it in again. Sometimes this caused Outlook to Crash. Strangely enough, the log file shows the application trying to access files on the E: drive. Both Outlook and Spambayes are installed on my C: drive. As a note, I've passed this program to several associates who love the software. They worry though, that my problems may come their way. Let me know if I can offer any other information. Thanks PS - Windows 2000 Professional, Office 2000 Proffessional ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=498103&aid=761250&group_i…

1 0

Interesting unsure
by Skip Montanaro June 26, 2003

June 26, 2003

I got an interesting spam just now. Besides the very short message which was little more than an <a> tag wrapping an <img> tag: doorknob WI-6-5RJ0 molder y-nbs<br> <a href="http://jjoelle@www.beachballboy.com/fun/"><img src="http://njackson73@www.superfuntimes.net/jkbie/lobw.gif"></a><br> e--HRdW detect 0O-Q-Xmn marijuana (interesting nonsense words - doorknob? molder?) the subject had umlauts over many of the vowels: ousp Wänt to makë löve likë a teën? so of course, I got several tokens which the classifier ignored. The debug and classification headers were X-Spambayes-Debug: '*H*': 0.21; '*S*': 0.66; 'doorknob': 0.09; 'subject:?': 0.23; 'detect': 0.26; 'header:Message-ID:1': 0.37; 'header:Reply-To:1': 0.61; 'url:com': 0.61; 'url:www': 0.67; 'header:Received:2': 0.76; 'subject:\xf6': 0.84; 'content-type:text/html': 0.87; 'url:gif': 0.93 X-Spambayes-Classification: unsure; 0.73 It's not clear much can be done, though it might be interesting to try an option to map Latin-1 accented characters to their unadorned ASCII counterparts, at least in subjects (strip_subject_accents?). For instance, "subject:teen" and "subject:love" are both pretty spammy in my database but "subject:teën" and "subject:löve" don't occur at all. Even "subject:make" is more spammy than hammy. The problem with trying such an experiment isn't that it might not be worthwhile, but that if it's a new spammer technique, there won't be many messages in our existing spam/ham databases which would exercise the technique. Skip

4 6

RE: [spambayes-dev] Re: Pickle vs DB inconsistencies
by Meyer, Tony June 26, 2003

June 26, 2003

> You're saying that if d is an open Shelf object, then after > > d[string] = whatever > > the value of the access expression > > d[string] > > is unreliable unless a > > d.sync() > > call intervenes? That's scary, if so -- or a bug. I believe so. It's reliable as long as 'string' was already a token, but not otherwise. It doesn't give a random value, at least, it just fails to update it. (So d[string] would return whatever value it had before the d[string] = whatever line). > I haven't used this part of the code in real life. You and your pickles ;) > Other questions that pop up: > > + Why does _wordinfoset() start with > > if record and ... > > ? For example, how could record==None possibly arise? I wondered this too. I think it was Mark coding for all possible situations. > + If a word is deleted, what's stopping _wordinfoget() from sucking it > out of the database anyway? That is, I believe the except clause in > _wordinfoget() should start with: > > if self.changed_words.get(word) is WORD_DELETED: > return None I didn't notice this, but your logic makes sense to me. =Tony Meyer

2 1

RE: [spambayes-dev] Re: Pickle vs DB inconsistencies
by Meyer, Tony June 26, 2003

June 26, 2003

> Arggh, bloody Maildir. Almost but not *quite* the perfect > mail folder format. Well, you seem to have figured it out anyways. Well, definitely figured out the bit of the code that the error is in (because I can output a list of tokens that will be the ones that are different), and *probably* figured out the problem, but not a solution. I'm hoping Mark will get to these soon (when he has a chance), since he wrote that bit of the code and probably can see a solution. It is a fairly significant problem, although I'm not sure how many Spambayes apps it will effect (because I think most actually do store() after changing). (As an aside, his (skippinet) address seems to be broken today, or at least my mail to him is bouncing...he may have more urgent things to fix!) =Tony Meyer

1 0

Weird cvs commit traceback
by Meyer, Tony June 26, 2003

June 26, 2003

I just committed an update to the website faq and got a strange traceback in my cvs window: Traceback (innermost last): File "/cvsroot/spambayes/CVSROOT/syncmail", line 336, in ? main() File "/cvsroot/spambayes/CVSROOT/syncmail", line 329, in main blast_mail(subject, people, specs[1:], contextlines, fromhost) File "/cvsroot/spambayes/CVSROOT/syncmail", line 253, in blast_mail resp = conn.sendmail(address, people, s.getvalue()) File "/usr/lib/python1.5/smtplib.py", line 452, in sendmail if not (200 <= self.ehlo()[0] <= 299): File "/usr/lib/python1.5/smtplib.py", line 305, in ehlo (code,msg)=self.getreply() File "/usr/lib/python1.5/smtplib.py", line 257, in getreply raise SMTPServerDisconnected("Connection unexpectedly closed") smtplib.SMTPServerDisconnected: Connection unexpectedly closed Traceback (innermost last): File "/cvsroot/spambayes/CVSROOT/syncmail", line 336, in ? main() File "/cvsroot/spambayes/CVSROOT/syncmail", line 329, in main blast_mail(subject, people, specs[1:], contextlines, fromhost) File "/cvsroot/spambayes/CVSROOT/syncmail", line 253, in blast_mail resp = conn.sendmail(address, people, s.getvalue()) File "/usr/lib/python1.5/smtplib.py", line 452, in sendmail if not (200 <= self.ehlo()[0] <= 299): File "/usr/lib/python1.5/smtplib.py", line 305, in ehlo (code,msg)=self.getreply() File "/usr/lib/python1.5/smtplib.py", line 257, in getreply raise SMTPServerDisconnected("Connection unexpectedly closed") smtplib.SMTPServerDisconnected: Connection unexpectedly closed Any idea what this means? (If it's relevant, I'm using TortoiseCVS on WinXP). =Tony Meyer

2 1

RE: [spambayes-dev] proposed question for Spambayes FAQ
by Meyer, Tony June 26, 2003

June 26, 2003

> If other people run into this problem, then maybe it's a good > candidate for the FAQ: > > I have the Outlook plugin of Spambayes and every time I exit > from Outlook, it forgets all the training. Whether I reboot > the computer or simply close Outlook and reopen it, either > way it doesn't retain any training information. This probably is a good FAQ candidate, so I've added it. We can probably remove it once the next release (which fixes this) has been out for a while. It's online now, but here's the answer I wrote: """This is a known problem with the 002 release of the plug-in (or earlier). What is probably happening is that Outlook is not shutting down properly or completely, or is being forced to shut down too quickly. This version of the plug-in only saves training/configuration data on shut-down, so this can result in training/configuration being lost. To get around this problem, exit Outlook (not by restarting/shutting down the machine), and make sure that it is completely shut down (use the Task Manager to check). This should save your training and configuration. The 003 release (and later) saves as required, so avoids this issue.""" =Tony Meyer

1 0

RE: [spambayes-dev] Re: Pickle vs DB inconsistencies
by Meyer, Tony June 26, 2003

June 26, 2003

>From my testing: * Unless dbexpimp.py is broken, the 10.pkl and 10.db you supplied were not identical. There are two tokens that have different counts: 'header:MIME-Version:1' and header:Mime-Version:1 (2,5 vs 4,3 and 4,3 vs 2,3 respectively). I'm not sure what this means! * I couldn't use the same test messages as you because the filenames weren't valid for a win32 system and I couldn't unpack them. I grabbed a random message of my own to use as a test and changed the simplescore script, adding a initial learn (since I can't unlearn one that's not in the db). * Is the message that you give to simplescore one of the ones that was trained? It should be, because you can't untrain a message that hasn't been trained (you might get negative counts). However, even given all of this, I also get the db count 1 higher for each token. This problem goes away if after every learn/unlearn call there is a save call [1]. This would be why the problem doesn't occur running hammie multiple times. I'll keep looking... =Tony Meyer [1] Although this gave me the db error that was recently submitted as a bug, which is also where Greg ran into it, I presume. I think 'word' should be 'key' - it makes sense and seems to work. I think (sorry Mark!) that it's in here that there is a problem.

2 1