Mailman-coders September 2004

mailman-coders@python.org

2 participants
67 discussions

[ mailman-Patches-1032434 ] make KNOWN_SPAMMERS work for headers appearing mult. times

by SourceForge.net

Patches item #1032434, was opened at 2004-09-22 10:39 Message generated for change (Comment added) made by bergolth You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=300103&aid=1032434&group_… Category: mail delivery Group: Mailman 2.1 Status: Open Resolution: None Priority: 5 Submitted By: Alexander Bergolth (bergolth) Assigned to: Tokio Kikuchi (tkikuchi) Summary: make KNOWN_SPAMMERS work for headers appearing mult. times Initial Comment: Hi! Currently the header check against the KNOWN_SPAMMERS config option in SpamDetect.py uses msg[header], i.e. __getitem__. This method only checks against the first matching header: Note that if the header appeared multiple times, exactly which occurrance gets returned is undefined. Use getall() to get all the values matching a header field name. I've changed the code to use msg.get_all() instead. --leo ---------------------------------------------------------------------- >Comment By: Alexander Bergolth (bergolth) Date: 2004-09-24 10:11 Message: Logged In: YES user_id=24695 I'm using spamassassin and amavisd to tag spam and viruses. The header lines added by the virus-check look like the following: ---------- snipp! ---------- X-Amavis-Alert: INFECTED, message contains virus: Worm.SomeFool.Gen-1 X-Amavis-Alert: BANNED FILENAME, message contains part named: .exe ---------- snipp! ---------- I.e. there are multiple "X-Amavis-Alert" headers to be considered. --leo ---------------------------------------------------------------------- Comment By: Tokio Kikuchi (tkikuchi) Date: 2004-09-24 04:20 Message: Logged In: YES user_id=67709 Looks like resonable to me. So, testing in my site. Do you have example to catch spam with this patch enabled. (received: ??) ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=300103&aid=1032434&group_…

17 years, 1 month

[ mailman-Patches-1032434 ] make KNOWN_SPAMMERS work for headers appearing mult. times

by SourceForge.net

Patches item #1032434, was opened at 2004-09-22 08:39 Message generated for change (Comment added) made by tkikuchi You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=300103&aid=1032434&group_… Category: mail delivery Group: Mailman 2.1 Status: Open Resolution: None Priority: 5 Submitted By: Alexander Bergolth (bergolth) >Assigned to: Tokio Kikuchi (tkikuchi) Summary: make KNOWN_SPAMMERS work for headers appearing mult. times Initial Comment: Hi! Currently the header check against the KNOWN_SPAMMERS config option in SpamDetect.py uses msg[header], i.e. __getitem__. This method only checks against the first matching header: Note that if the header appeared multiple times, exactly which occurrance gets returned is undefined. Use getall() to get all the values matching a header field name. I've changed the code to use msg.get_all() instead. --leo ---------------------------------------------------------------------- >Comment By: Tokio Kikuchi (tkikuchi) Date: 2004-09-24 02:20 Message: Logged In: YES user_id=67709 Looks like resonable to me. So, testing in my site. Do you have example to catch spam with this patch enabled. (received: ??) ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=300103&aid=1032434&group_…

17 years, 1 month

[ mailman-Bugs-1033469 ] attachment appears in archive with extension changed to .exe

by SourceForge.net

Bugs item #1033469, was opened at 2004-09-23 17:45 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=1033469&group_… Category: Pipermail Group: None Status: Open Resolution: None Priority: 5 Submitted By: Alexis Dimitriadis (alexis3) Assigned to: Nobody/Anonymous (nobody) Summary: attachment appears in archive with extension changed to .exe Initial Comment: I posted a message with an attached pdf document, which arrived intact to listmembers. But the link in the archived version appears with a somewhat mangled name and the extension .exe (which confuses browsers). The link points to the intact pdf file. >From the way the name was mangled, I suspect that the problem is caused by a space in the filename of the attachment. The bottom of the archived message looks like this:

17 years, 1 month

[ mailman-Patches-873035 ] subject handling in -request mail

by SourceForge.net

Patches item #873035, was opened at 2004-01-08 12:32 Message generated for change (Comment added) made by tkikuchi You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=300103&aid=873035&group_i… Category: mail delivery Group: Mailman 2.1 >Status: Closed Resolution: None Priority: 7 Submitted By: Tokio Kikuchi (tkikuchi) Assigned to: Nobody/Anonymous (nobody) Summary: subject handling in -request mail Initial Comment: Since spammers get one of our '-request' mail command address as target, we frequently get following error log and many such messages shunted. Jan 08 10:17:02 2004 (11705) Uncaught runner exception: ASCII decoding error: ordinal not in range(128) Jan 08 10:17:02 2004 (11705) Traceback (most recent call last): File "/usr/local/mailman/Mailman/Queue/Runner.py", line 110, in _oneloop self._onefile(msg, msgdata) File "/usr/local/mailman/Mailman/Queue/Runner.py", line 160, in _onefile keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/local/mailman/Mailman/Queue/CommandRunner.py", line 223, in _dispose res = Results(mlist, msg, msgdata) File "/usr/local/mailman/Mailman/Queue/CommandRunner.py", line 77, in __init__ subj = make_header(decode_header(subj)).__unicode__() File "/usr/local/mailman/pythonlib/email/Header.py", line 144, in make_header h.append(s, charset) File "/usr/local/mailman/pythonlib/email/Header.py", line 272, in append ustr = unicode(s, incodec, errors) UnicodeError: ASCII decoding error: ordinal not in range(128) Jan 08 10:17:02 2004 (11705) SHUNTING: 1073506489.162806+2102abfa360c02ffb7bebbce12c1b9f09d8139f9 Apparently, following patch to Queue/CommandRunner.py may solve this problem. ---------------------------------------------------------------------- >Comment By: Tokio Kikuchi (tkikuchi) Date: 2004-09-23 00:44 Message: Logged In: YES user_id=67709 Fixed in CVS revision: 2.26.2.5 ---------------------------------------------------------------------- Comment By: Tokio Kikuchi (tkikuchi) Date: 2004-03-04 02:32 Message: Logged In: YES user_id=67709 Ok, I double-posted this item. So, raise the priority. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=300103&aid=873035&group_i…

17 years, 1 month

[ mailman-Bugs-1014750 ] need to sort by domain before submitting to MTA

by SourceForge.net

Bugs item #1014750, was opened at 2004-08-23 17:39 Message generated for change (Comment added) made by jaredmauch You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=1014750&group_… Category: mail delivery Group: 2.1 (stable) Status: Open Resolution: None Priority: 5 Submitted By: jared mauch (jaredmauch) Assigned to: Nobody/Anonymous (nobody) Summary: need to sort by domain before submitting to MTA Initial Comment: I have a number of (large) lists that have a number of users at the same domain, but are submitted to the MTA in chunks of 10 to insure the list performs reasonably. The users at the same domain end up in different queue files of my MTA, and spark a large number of SMTP connections to their SMTP servers that could be minimized if the <user>@<domain> that is passed to the MTA is sorted by domain. Then I could have one SMTP transaction with them that delivers 10 messages. I'm no python expert, but figure sorting of this type should be fairly simple, and will reduce the amount my SMTP server abuses these other SMTP servers, which will be a good thing(tm), as well as save bandwidth.. ---------------------------------------------------------------------- >Comment By: jared mauch (jaredmauch) Date: 2004-09-22 10:59 Message: Logged In: YES user_id=131445 that should be recips not r.sort fyi ---------------------------------------------------------------------- Comment By: jared mauch (jaredmauch) Date: 2004-09-22 10:44 Message: Logged In: YES user_id=131445 SMTPDirect.py def domsort(uida, uidb): ## sort by domain ## usage foo.sort(domsort) i = uida.rfind('@') if i >= 0: doma = uida[i+1:] i = uidb.rfind('@') if i >= 0: domb = uidb[i+1:] return cmp(doma, domb) } # Need to sort by domain name. if we split to chunks it is possible # some well-known domains will be interspersed as we sort by # userid by default instead of by domain. (jared mauch) r.sort(domsort) ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=1014750&group_…

17 years, 1 month

[ mailman-Bugs-953320 ] bad handling From header in archiver

by SourceForge.net

Bugs item #953320, was opened at 2004-05-13 07:32 Message generated for change (Comment added) made by msapiro You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=953320&group_i… Category: Pipermail Group: 2.1 (stable) Status: Open Resolution: None Priority: 8 Submitted By: Tibor Pittich (phuture) Assigned to: Nobody/Anonymous (nobody) Summary: bad handling From header in archiver Initial Comment: 2.1.4 mailman version - there is problem with archiver. when body of message contains blank line and continued with text 'From ' at beggining of line, then archiver thing that this is a new message and split it. i see, there is a cleanarch script, which can escape non-header From line but why i must change original post adding "escape character"? is there possibility to check only header of message instead of whole message including body? ---------------------------------------------------------------------- Comment By: Mark Sapiro (msapiro) Date: 2004-09-22 07:52 Message: Logged In: YES user_id=1123998 I had this problem on 2.1.4 after importing a large archive from another service. I then fixed the "^From .*$" lines that were in the bodies of a few messages and ran "bin/arch --wipe" to rebuild the archive and that absolutely DID fix the problem. ---------------------------------------------------------------------- Comment By: David A. Desrosiers (desrod) Date: 2004-09-22 07:04 Message: Logged In: YES user_id=3078 I can confirm that this affects the public/stable release version of 2.1.5. Running bin/cleanarch on the suspect mbox DOES NOT fix the problem. I have a list with messages back in 2002, which have "parts" showing up at the end of my September 2004 archives. The messages contain "parts" of the body, and are missing most of the headers. Every time arch runs, it reduplicates the trashed/truncated messages from 2002 onto the end of the September 2004 archive. This is a MAJOR MAJOR MAJOR MAJOR blocker, and cleanarch is not a proper solution. There are reasons why valid messages can start with the word "From" at the beginning of a line, and not be part of the "From:" header. Here are two examples: http://lists.pilot-link.org/pipermail/pilot-link-general/2002-September/016… http://lists.pilot-link.org/pipermail/pilot-link-general/2002-June/016144.h… I haven't yet found a fix for this, and adding the > in front of the "From" words at the beginning of the lines, DOES NOT fix the problem. In fact, deleting those messages (remember, they're from TWO YEARS AGO) from the .mbox, rm'ing the .html files, and re-running arch on the list, DOES NOT fix the problem. ---------------------------------------------------------------------- Comment By: David A. Desrosiers (desrod) Date: 2004-05-13 10:04 Message: Logged In: YES user_id=3078 I can confirm this bug in 2.1.4, and that it is also in 2.1.5c2.. MAJOR BLOCKER! Please assign to someone and fix! ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=953320&group_i…

17 years, 1 month

[ mailman-Bugs-1014750 ] need to sort by domain before submitting to MTA

by SourceForge.net

Bugs item #1014750, was opened at 2004-08-23 17:39 Message generated for change (Comment added) made by jaredmauch You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=1014750&group_… Category: mail delivery Group: 2.1 (stable) Status: Open Resolution: None Priority: 5 Submitted By: jared mauch (jaredmauch) Assigned to: Nobody/Anonymous (nobody) Summary: need to sort by domain before submitting to MTA Initial Comment: I have a number of (large) lists that have a number of users at the same domain, but are submitted to the MTA in chunks of 10 to insure the list performs reasonably. The users at the same domain end up in different queue files of my MTA, and spark a large number of SMTP connections to their SMTP servers that could be minimized if the <user>@<domain> that is passed to the MTA is sorted by domain. Then I could have one SMTP transaction with them that delivers 10 messages. I'm no python expert, but figure sorting of this type should be fairly simple, and will reduce the amount my SMTP server abuses these other SMTP servers, which will be a good thing(tm), as well as save bandwidth.. ---------------------------------------------------------------------- >Comment By: jared mauch (jaredmauch) Date: 2004-09-22 10:44 Message: Logged In: YES user_id=131445 SMTPDirect.py def domsort(uida, uidb): ## sort by domain ## usage foo.sort(domsort) i = uida.rfind('@') if i >= 0: doma = uida[i+1:] i = uidb.rfind('@') if i >= 0: domb = uidb[i+1:] return cmp(doma, domb) } # Need to sort by domain name. if we split to chunks it is possible # some well-known domains will be interspersed as we sort by # userid by default instead of by domain. (jared mauch) r.sort(domsort) ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=1014750&group_…

17 years, 1 month

[ mailman-Bugs-953320 ] bad handling From header in archiver

by SourceForge.net

Bugs item #953320, was opened at 2004-05-13 16:32 Message generated for change (Settings changed) made by phuture You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=953320&group_i… Category: Pipermail Group: 2.1 (stable) Status: Open Resolution: None >Priority: 8 Submitted By: Tibor Pittich (phuture) Assigned to: Nobody/Anonymous (nobody) Summary: bad handling From header in archiver Initial Comment: 2.1.4 mailman version - there is problem with archiver. when body of message contains blank line and continued with text 'From ' at beggining of line, then archiver thing that this is a new message and split it. i see, there is a cleanarch script, which can escape non-header From line but why i must change original post adding "escape character"? is there possibility to check only header of message instead of whole message including body? ---------------------------------------------------------------------- Comment By: David A. Desrosiers (desrod) Date: 2004-09-22 16:04 Message: Logged In: YES user_id=3078 I can confirm that this affects the public/stable release version of 2.1.5. Running bin/cleanarch on the suspect mbox DOES NOT fix the problem. I have a list with messages back in 2002, which have "parts" showing up at the end of my September 2004 archives. The messages contain "parts" of the body, and are missing most of the headers. Every time arch runs, it reduplicates the trashed/truncated messages from 2002 onto the end of the September 2004 archive. This is a MAJOR MAJOR MAJOR MAJOR blocker, and cleanarch is not a proper solution. There are reasons why valid messages can start with the word "From" at the beginning of a line, and not be part of the "From:" header. Here are two examples: http://lists.pilot-link.org/pipermail/pilot-link-general/2002-September/016… http://lists.pilot-link.org/pipermail/pilot-link-general/2002-June/016144.h… I haven't yet found a fix for this, and adding the > in front of the "From" words at the beginning of the lines, DOES NOT fix the problem. In fact, deleting those messages (remember, they're from TWO YEARS AGO) from the .mbox, rm'ing the .html files, and re-running arch on the list, DOES NOT fix the problem. ---------------------------------------------------------------------- Comment By: David A. Desrosiers (desrod) Date: 2004-05-13 19:04 Message: Logged In: YES user_id=3078 I can confirm this bug in 2.1.4, and that it is also in 2.1.5c2.. MAJOR BLOCKER! Please assign to someone and fix! ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=953320&group_i…

17 years, 1 month

[ mailman-Bugs-953320 ] bad handling From header in archiver

by SourceForge.net

Bugs item #953320, was opened at 2004-05-13 14:32 Message generated for change (Comment added) made by desrod You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=953320&group_i… Category: Pipermail Group: 2.1 (stable) Status: Open Resolution: None Priority: 5 Submitted By: Tibor Pittich (phuture) Assigned to: Nobody/Anonymous (nobody) Summary: bad handling From header in archiver Initial Comment: 2.1.4 mailman version - there is problem with archiver. when body of message contains blank line and continued with text 'From ' at beggining of line, then archiver thing that this is a new message and split it. i see, there is a cleanarch script, which can escape non-header From line but why i must change original post adding "escape character"? is there possibility to check only header of message instead of whole message including body? ---------------------------------------------------------------------- Comment By: David A. Desrosiers (desrod) Date: 2004-09-22 14:04 Message: Logged In: YES user_id=3078 I can confirm that this affects the public/stable release version of 2.1.5. Running bin/cleanarch on the suspect mbox DOES NOT fix the problem. I have a list with messages back in 2002, which have "parts" showing up at the end of my September 2004 archives. The messages contain "parts" of the body, and are missing most of the headers. Every time arch runs, it reduplicates the trashed/truncated messages from 2002 onto the end of the September 2004 archive. This is a MAJOR MAJOR MAJOR MAJOR blocker, and cleanarch is not a proper solution. There are reasons why valid messages can start with the word "From" at the beginning of a line, and not be part of the "From:" header. Here are two examples: http://lists.pilot-link.org/pipermail/pilot-link-general/2002-September/016… http://lists.pilot-link.org/pipermail/pilot-link-general/2002-June/016144.h… I haven't yet found a fix for this, and adding the > in front of the "From" words at the beginning of the lines, DOES NOT fix the problem. In fact, deleting those messages (remember, they're from TWO YEARS AGO) from the .mbox, rm'ing the .html files, and re-running arch on the list, DOES NOT fix the problem. ---------------------------------------------------------------------- Comment By: David A. Desrosiers (desrod) Date: 2004-05-13 17:04 Message: Logged In: YES user_id=3078 I can confirm this bug in 2.1.4, and that it is also in 2.1.5c2.. MAJOR BLOCKER! Please assign to someone and fix! ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=100103&aid=953320&group_i…

17 years, 1 month

[ mailman-Patches-1032434 ] make KNOWN_SPAMMERS work for headers appearing mult. times

by SourceForge.net

Patches item #1032434, was opened at 2004-09-22 10:39 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=300103&aid=1032434&group_… Category: mail delivery Group: Mailman 2.1 Status: Open Resolution: None Priority: 5 Submitted By: Alexander Bergolth (bergolth) Assigned to: Nobody/Anonymous (nobody) Summary: make KNOWN_SPAMMERS work for headers appearing mult. times Initial Comment: Hi! Currently the header check against the KNOWN_SPAMMERS config option in SpamDetect.py uses msg[header], i.e. __getitem__. This method only checks against the first matching header: Note that if the header appeared multiple times, exactly which occurrance gets returned is undefined. Use getall() to get all the values matching a header field name. I've changed the code to use msg.get_all() instead. --leo ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=300103&aid=1032434&group_…

17 years, 1 month

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

Mailman-coders September 2004