Mailman 3 November 2006 - SpamBayes

Unwanted stock solicitations
by Vibe Grevsen Nov. 3, 2006

Nov. 3, 2006

Hi Luigi, >> > > os.popen3() does not seem to support the read()-method? ... >> >>> os.popen3( ocr_cmd ).read() >> __main__:1: RuntimeWarning: tp_compare didn't return -1 or -2 for exception >> Traceback (most recent call last): >> File "<stdin>", line 1, in <module> >> AttributeError: 'tuple' object has no attribute 'read' > ok. this is the problem. popen returns 3 files descriptor > you have to use something like: > fin, fout, ferr = os.popen3(cmd) > fout.read() Oh, this is an array :) I missed that: >>> # os.popen3() returns [stdin, stdout, stderr] >>> os.popen3( ocr_cmd )[1].read() '- Unlo_k Arhus -\n\n' Yes, you're right, that's working and probably under win9x aswell. I'll test and let you know later. Happy coding :) Vibe

1 0

image analyze
by Vibe Grevsen Nov. 3, 2006

Nov. 3, 2006

Hello, ... > A part from this the algorithm could be better. From my test > using stddev and sum2 yield better result. Maybe mean filtering the parts before processing could also be a good idea? Should dim moving artefacts. -- Happy coding :) Vibe

1 0

Unwanted stock solicitations
by Vibe Grevsen Nov. 3, 2006

Nov. 3, 2006

Hi Luigi, > > os.popen3() does not seem to support the read()-method? > Are you sure? ------------ Yep, seems so at least in Python 2.5: Python 2.5 (r25:51908, Sep 19 2006, 09:52:17) [MSC v.1310 32 bit (Intel)] on win32 Type "help", "copyright", "credits" or "license" for more information. >>> import os >>> ocr_cmd = ur'ocrad -s %s -c %s "%s"' % ("2", "ascii", "c:\logo.pgm") >>> os.popen3( ocr_cmd ).read() __main__:1: RuntimeWarning: tp_compare didn't return -1 or -2 for exception Traceback (most recent call last): File "<stdin>", line 1, in <module> AttributeError: 'tuple' object has no attribute 'read' >>> os.popen( ocr_cmd ).read() '- Unlo_k Arhus -\n\n' >>> > commented calling ocrad using popen3 and it works (at least on of a few > computers I tested it) Hmm, strange. For the record, which OS are you using it on? > > > On windows you have to put quote around pnmfile to protect against space > > > in path (also un linux you should have them but it's unlikely you get a > > > path with a space). > > > Oh, YES, you're absolutely right. > > Thank you for this suggestion. > > > > > On windows there is also an other caveat. > > > you should put quote also around ocrad path but if you do that you have > > > to quote everything. > > > to explain the command should be: > > > > ocr_cmd = r'""ocrad_path" -s %s -c %s "%s""'%(scale, charset, pnmfile) > > > fin, fout, ferrr = os.popen3(ocr_cmd) > > > I tested your suggestion, but it seemed to resolve wrong in the interpreter. > > Also popen3() could not be read() so I changed it a bit > Strange. It's work for me The tripple-quoting resolved wrong I think. I don't understand it completely. Maybe because it's already a raw string? > > # u: unicode support, r: raw string > > ocr_cmd = ur'ocrad -s %s -c %s "%s"' % (scale, charset, pnmfile) > > ocr = os.popen( ocr_cmd ) > > > > I also tested this > > > > # u: unicode support, r: raw string > > ocr_cmd = ( ur'ocrad -s %s -c %s < "%s" 2>' + os.path.devnull ) % (scale, charset, pnmfile) > > ocr = os.popen( ocr_cmd ) > > > > Both working in windows so Skip can pick whichever he likes best ;) > Does 2> really work? I think it kind of works because it's ignored by > cmd.exe but it's a unix sh construct (I'm not really sure if it even > works using csh derived shells) Yes, it works in NT, XP and 2k: http://shorterlink.com/?P3W1A9 (You may even learn some tricks from that article) > > > using -s (and other flags as well) disable -x. > > > > Hmm, bug, no, better undocumented feature? :) > oh yes, you have to look inside the source code to find it Okay ... > > > orf file is never used. probably is there from the start before skip > > > introduce the scale parameter > > > > Actually he tries to count the number of lines in orf I think > no, he looks for line starting with line that probably it's related to > the number of line in the output. Not sure - I'd never even opened a .py file ten days ago :) - but this ctokens.add("image-text-lines:%d" % int(log2(nlines))) makes me suspicious... Skip? Happy coding :) Vibe

2 1

prevailing
by Sibyl Morales Nov. 3, 2006

Nov. 3, 2006

1 0

UnicodeDecodeError: ordinal not in range(128)
by Peter Barker Nov. 2, 2006

Nov. 2, 2006

I am using sb_bnfilter.py version 1.1a3 on linux (actually CVS version from Aug 21), and am getting an increasing number of spam messages with 8-bit characters in messages labelled as 7-bit. These cause sb_bnfilter.py to give an error such as: UnicodeDecodeError: 'ascii' codec can't decode byte 0xb0 in position 1: ordinal not in range(128) and the message is not classified. I set the option replace_nonascii_chars: True in .spambayesrc, and some characters no longer caused problems (as they were replaced with ?). However any 8-bit character in the Subject: header still caused problems, also the character 0xb0 somewhere in messages. I used hexdump on the message to look for the reported 8-bit character. I could find the reported character in the message (or headers), except in the case of 0xb0, which did not appear to be anywhere in the message when dumped with hexdump. I have attached a message which reports the 0xb0 problem.

1 0

(no subject)
by cristin＠guinnsmith.com Nov. 2, 2006

Nov. 2, 2006

I am using spam bays 1.1 on windows microsoft xp version 2002 and my spam bayes icon buttons are no longer working, delete as spam is no where to be seen and when I click on the spam or spambayes icons nothing happens. My hourglass pops up for a few seconds like it's trying to work but nothing changes. Sincerely, Cristin Wilson Receptionist Guinn, Smith, & Co. Phone 972-255-7120

1 0

Simple Question...
by Jeremy Wallis Nov. 2, 2006

Nov. 2, 2006

Hi, Do I turn off Outlook's built in junk filter or leave it running? I'm inclined to turn it off unless there's a good reason not to. Thanks.

2 1

Re: [Spambayes] ?????
by Jan Tuerlinckx Nov. 2, 2006

Nov. 2, 2006

POP3 proxy running on 110, proxying to Pop.skynet.be:110. Active POP3 conversations: 0. POP3 conversations this session: 12. Emails classified this session: 1 spam, 22 ham, 1 unsure. Total emails trained: Spam: 121 Ham: 258 More statistics... Till now no one SPAM OR unsure are derivated to the folders JUNK MAIL or POSSIBLE JUNK

1 0

Junk mail marked as read - letter icon still shows in system tray
by MENHINICK Design Ltd Nov. 1, 2006

Nov. 1, 2006

Hi, I seem to have a small glitch? in my Spambayes installtion? The filter seems to be working extremely well but I have ticked options for all 'Spam' and 'Junk Suspects' to be marked as read. The junk mail is 'un-bolded' which appears to be marked as read but the letter icon still appears in the system tray; is this the intended action?? I was hoping that marking spam as read would not still bring 'spam' to my attention. WinXP Pro SP2 Outlook 2000 SP3 Regards Mike ******************** Mike Menhinick MENHINICK Design Ltd PO Box 32164 93 Victoria Rd Devonport Auckland PH/FX +64(9)4450034 menhinick(a)xtra.co.nz ********************

1 0

BadIMAPResponseError: "Cannot find saved message"
by Matt Stegman Nov. 1, 2006

Nov. 1, 2006

Hello, I've just started using Spambayes 1.1a2, and I'm quite happy with it (I had been using the Outlook plugin until now). However, I'm seeing an intermittent problem with sb_imapfilter.py. It will routinely crash while talking to the IMAP server, and always with the same error message: Traceback (most recent call last): File "/usr/bin/sb_imapfilter.py", line 1284, in ? run() File "/usr/bin/sb_imapfilter.py", line 1266, in run imap_filter.Filter() File "/usr/bin/sb_imapfilter.py", line 1067, in Filter self.unsure_folder, self.ham_folder) File "/usr/bin/sb_imapfilter.py", line 970, in Filter msg.Save() File "/usr/bin/sb_imapfilter.py", line 723, in Save raise BadIMAPResponseError("recent", "Cannot find saved message") __main__.BadIMAPResponseError: The command 'recent' failed to give an OK response. Cannot find saved message Usually it'll run OK for a day or two, but sometimes for just a few hours before crashing. If I don't notice for a while and messages pile up in the inbox without being classified, Spambayes will sometimes crash before classifying a dozen or less messages, when I start it again. I've tried training several times, and have never seen this error; it's only appeared when classifying. Also, the server runs Courier IMAP, but I don't know the version. I'm using IMAP over SSL, on port 993. I found that I'm not the first person to see this error message: http://mail.python.org/pipermail/spambayes-dev/2004-November/003232.html I ran imapfilter with -i4 as suggested there, and saw the following just before the crash. The pattern repeats what looks like 100 times - I see a loop in the code at line 717, I guess this loop fails against my IMAP server sometimes. 06:50.02 untagged responses dump: MYRIGHTS: ""acdilrsw"" EXISTS: "31" "33" "34" "35" PERMANENTFLAGS: "(\* \Draft \Answered \Flagged \Deleted \Seen)" READ-WRITE: "" FLAGS: "(\Draft \Answered \Flagged \Deleted \Seen \Recent)" APPENDUID: "1063604858 55181" "1063604858 55182" "1063604858 55183" "1063604858 55184" "1077921887 9359" UIDVALIDITY: "1063604858" 06:50.02 > GFNI156 NOOP 06:50.03 < GFNI156 OK NOOP completed Now, this run was after a few messages had piled up since the last time Spambayes had crashed. Here's what looks like happened: messages 1-19 in the INBOX were previously classified. New messages were 20-31. Spambayes classified messages 20-24, the first four were ham and the last was spam. The messages were written out OK; 32-35 are copies of the ham with added headers, and the spam ended up in the spam folder. So if I'm reading the output right, Spambayes was looking for messages 31, 33, 34, and 35. That looks odd - if 32-35 were just written out, why is Spambayes querying message 31 and not 32? The full output is attached; hopefully it can help. -- Thanks for any help, Matt Stegman

2 2