Mailman 3 December 2001 - Mailman-Developers

Mailman VS. Base64 encoding
by hinet 25 Dec '01

25 Dec '01

Dear all, It seems Mailman 2.0.6 can't process the base64 encoded e-mail, so the Footer can't be appended to the e-mail correctly, and the archives are also base64 encoded, does anyone have any suggesttion? regards Caleb

3 2

"continuation" bug in 2.1a3 (or in "email" package)
by Fil 24 Dec '01

24 Dec '01

My error log fills up with this message, one each time a message is snt to a list, apparently. What ca I do? Downgrade the email package? # python Python 2.1 (#1, Jun 1 2001, 23:51:21) [GCC 2.95.3 20010125 (prerelease)] on linux2 Type "copyright", "credits" or "license" for more information. >>> import email >>> email.__version__ '0.96' logs/error: Dec 24 13:41:11 2001 qrunner(319): Traceback (most recent call last): Dec 24 13:41:11 2001 qrunner(319): File "/home/mailman/bin/qrunner", line 265, in ? Dec 24 13:41:11 2001 qrunner(319): main() Dec 24 13:41:11 2001 qrunner(319): File "/home/mailman/bin/qrunner", line 225, in main Dec 24 13:41:11 2001 qrunner(319): qrunner.run() Dec 24 13:41:11 2001 qrunner(319): File "/home/mailman/Mailman/Queue/Runner.py", line 58, in run Dec 24 13:41:11 2001 qrunner(319): filecnt = self.__oneloop() Dec 24 13:41:11 2001 qrunner(319): File "/home/mailman/Mailman/Queue/Runner.py", line 87, in __oneloop Dec 24 13:41:11 2001 qrunner(319): msg, msgdata = self._switchboard.dequeue(filebase) Dec 24 13:41:11 2001 qrunner(319): File "/home/mailman/Mailman/Queue/Switchboard.py", line 156, in dequeue Dec 24 13:41:11 2001 qrunner(319): msg = email.message_from_file(msgfp, Message.Message) Dec 24 13:41:11 2001 qrunner(319): File "/usr/local/lib/python2.1/site-packages/email/__init__.py", line 35, in message_from_file Dec 24 13:41:11 2001 qrunner(319): return _Parser(_class).parse(fp) Dec 24 13:41:11 2001 qrunner(319): File "/usr/local/lib/python2.1/site-packages/email/Parser.py", line 40, in parse Dec 24 13:41:11 2001 qrunner(319): self._parsebody(root, fp) Dec 24 13:41:11 2001 qrunner(319): File "/usr/local/lib/python2.1/site-packages/email/Parser.py", line 133, in _parsebody Dec 24 13:41:11 2001 qrunner(319): msgobj = self.parsestr(part) Dec 24 13:41:11 2001 qrunner(319): File "/usr/local/lib/python2.1/site-packages/email/Parser.py", line 44, in parsestr Dec 24 13:41:11 2001 qrunner(319): return self.parse(StringIO(text)) Dec 24 13:41:11 2001 qrunner(319): File "/usr/local/lib/python2.1/site-packages/email/Parser.py", line 40, in parse Dec 24 13:41:11 2001 qrunner(319): self._parsebody(root, fp) Dec 24 13:41:11 2001 qrunner(319): File "/usr/local/lib/python2.1/site-packages/email/Parser.py", line 144, in _parsebody Dec 24 13:41:11 2001 qrunner(319): self._parseheaders(blockmsg, fp) Dec 24 13:41:11 2001 qrunner(319): File "/usr/local/lib/python2.1/site-packages/email/Parser.py", line 80, in _parseheaders Dec 24 13:41:11 2001 qrunner(319): raise Errors.HeaderParseError( Dec 24 13:41:11 2001 qrunner(319): email.Errors . HeaderParseError : Not a header, not a continuation -- Fil

2 1

~mailman/bin/mailmanctl -s start
by Fil 24 Dec '01

24 Dec '01

(using Mailman 2.1a3) What happens when the computer crashes then starts again? If the pidfile stays there, mailctl start will fail. If we use mailmanctl -s start, it will fail if the pidfile is not there... What we need is a start command that does not fail, even if a pid file is already here. Or am I missing something? Furthermore, it seems buggy on my installation: # ~mailman/bin/mailmanctl -s start Starting Mailman's master qrunner. Traceback (most recent call last): File "/home/mailman/bin/mailmanctl", line 492, in ? main() File "/home/mailman/bin/mailmanctl", line 364, in main lock._transfer_to(pid) File "/home/mailman/Mailman/LockFile.py", line 357, in _transfer_to os.link(self.__lockfile, self.__tmpfname) OSError: [Errno 2] No such file or directory -- Fil

1 0

MAILMAN_SITE_LIST
by Rodolfo Pilas 22 Dec '01

22 Dec '01

Hello developers: Ok, I understand that this list is for development purposes, but I posted this question at mailman-users and did not receive any reply, perhaps because I use the latest development version of MM. -----Mensaje reenviado----- From: Rodolfo Pilas <rodolfo(a)linux.org.uy> To: mailman-users(a)python.org Subject: [Mailman-Users] MAILMAN_SITE_LIST Date: 14 Dec 2001 10:39:56 -0300 I use MM 2.1a3 with Python 2.0 I have MAILMAN_SITE_LIST='mailman' in my $prefix/Mailman/Default.py in accordance to the item 4 of the INSTALL document: Create a "site-wide" mailing list. This is the one that password reminders will appear to come from. Usually this should be the "mailman" mailing list, but if you need to change this, be sure to change the MAILMAN_SITE_LIST variable in mm_cfg.py (see below). I also have DEFAULT_HOST_NAME='mysite.net' in my $prefix/Mailman/mm_cfg.py But the list is showed as mailman(a)www.mysite.net (whit "www") additionally, when I create a new list the host_name by default is showed as www.mysite.net (of course, I chage it to mysite.net). I see this problem since I upgraded from 2.1a2 to 2.1a3. Can you tell me how to have mailman(a)mysite.net (without "www") and a default host_name "mysite.net" again? Thank you. -- Rodolfo Pilas Quien los puso a estos tipos donde estan, rodolfo(a)linux.org.uy Quien los deja seguir en su lugar, http://rodolfo.pilas.net Quien los baja ahora de su altar, ICQ #17461636 Quien les paga para que hagan lo que haran http://xtralinux.org -=# Apocalipsis Now % Cuarteto de Nos #=- Public GnuPG key: http://www.keyserver.net 1024D/57153363 2001-06-02 key fingerprint = DAAE 3246 3F7D A420 B7A0 48A5 D120 C773 5715 3363 ------------------------------------------------------ Mailman-Users maillist - Mailman-Users(a)python.org http://mail.python.org/mailman/listinfo/mailman-users

3 4

bug in pipermail ?
by Fil 22 Dec '01

22 Dec '01

Her's the traceback: # bin/arch listes ... figuring article archives 2001-July Traceback (most recent call last): File "bin/arch", line 129, in ? main() File "bin/arch", line 118, in main archiver.processUnixMailbox(fp, Article) File "/home/mailman/Mailman/Archiver/pipermail.py", line 525, in processUnixMailbox m = mbox.next() File "/home/mailman/Mailman/pythonlib/mailbox.py", line 38, in next return self.factory(_Subfile(self.fp, start, stop)) File "/home/mailman/Mailman/Mailbox.py", line 77, in scrubber return mailbox.scrub(msg) File "/home/mailman/Mailman/Mailbox.py", line 97, in scrub return self._scrubber(self._mlist, msg) File "/home/mailman/Mailman/Handlers/Scrubber.py", line 154, in process url = save_attachment(mlist, part) File "/home/mailman/Mailman/Handlers/Scrubber.py", line 301, in save_attachment fp.write(decodedpayload) TypeError: argument must be string or read-only character buffer, not instance (I'm using latest cvs) -- Fil

1 0

bsddb python module
by Rodolfo Pilas 19 Dec '01

19 Dec '01

Another question for developers... (please, accept my apologies to post this question here, but I need a tip about this problem) -----Mensaje reenviado----- From: Rodolfo Pilas <rodolfo(a)linux.org.uy> To: mailman-users(a)python.org Subject: [Mailman-Users] bsddb python module Date: 18 Dec 2001 18:57:09 -0300 I have a MM 2.1a3 with Pyton 2.0 + Postfix working very well. By the other way I try to install MM 2.1a3 with Pyton 2.1.1 but I can not create lists because I do not have the module bsddb (required by dbhash). Traceback (most recent call last): File "/usr/lib/mailman/scripts/driver", line 96, in run_main main() File "/usr/lib/mailman/Mailman/Cgi/create.py", line 55, in main process_request(doc, cgidata) File "/usr/lib/mailman/Mailman/Cgi/create.py", line 199, in process_request __import__(modname) File "/usr/lib/mailman/Mailman/MTA/Postfix.py", line 25, in ? import dbhash File "/var/tmp/python-root//usr/lib/python2.1/dbhash.py", line 5, in ? import bsddb ImportError: No module named bsddb In the first system I can not locate the bsddb* module file, but an import bsddb works. I downloaded bsddb3-3.3.0 and try to install (python setup.py install) but I can not compile it. Can anybody help me to have bsddb installed? (My sistem is a SuSE 7.3 Professional and I do not understand Python language) -- Rodolfo Pilas Quien los puso a estos tipos donde estan, rodolfo(a)linux.org.uy Quien los deja seguir en su lugar, http://rodolfo.pilas.net Quien los baja ahora de su altar, ICQ #17461636 Quien les paga para que hagan lo que haran http://xtralinux.org -=# Apocalipsis Now % Cuarteto de Nos #=- Public GnuPG key: http://www.keyserver.net 1024D/57153363 2001-06-02 key fingerprint = DAAE 3246 3F7D A420 B7A0 48A5 D120 C773 5715 3363 ------------------------------------------------------ Mailman-Users maillist - Mailman-Users(a)python.org http://mail.python.org/mailman/listinfo/mailman-users

1 0

ScriptURL with aolserver
by Ellen Spertus 16 Dec '01

16 Dec '01

I think I've figured out what's behind the problems with links from administration pages that some users have reported [http://sourceforge.net/tracker/?group_id=103&atid=100103&func=detail&aid=21… and http://sourceforge.net/tracker/?group_id=103&atid=100103&func=detail&aid=45…]. For an example of the problem, see http://javamlm.mills.edu/mailman/admin/test/ and try following any link. I am using aolserver 3.2, which seems to set nonstandard values for the environment variables SCRIPT_NAME and PATH_INFO. When I do a GET on "http://javamlm.mills.edu/mailman/admin/test", the values are: SCRIPT_NAME: /mailman/admin/test PATH_INFO: /test When Utils.ScriptURL concatenates these, the result is the bogus fullpath "/mailman/admin/test/test", which leads to the bogus relative path "../../../admin". Workarounds: - Use a behaving web server - Use absolute URLs [which would probably break something else], e.g., - change MailList.GetScriptURL - change Utils.ScriptURL - Have a special case for noncompliant web servers - require a flag for aolserver users - infer that something's wrong if SCRIPT_NAME and PATH_INFO end in the same string I'd be happy to code a patch but could use advice on the best way to proceed without breaking something else (or perhaps people don't care about supporting aolserver). I've also sent a query to the aolserver discussion list asking whether the behavior is a bug or a feature. Ellen

2 1

[Patch] SMTPDirect.py wrongly closing the connection
by Marc MERLIN 15 Dec '01

15 Dec '01

So, I have my mailman alpha 3 cvs with python 2.1 seemingly working, and when I move a list with more than one subscriber to it, I started getting: Dec 12 22:11:33 2001 (18247) delivery to aregnier(a)yahoo.com failed with code 501 : <powerteam-bounces(a)lists.merlins.org> size=3426: malformed address: size=3426 may not follow <powerteam-bounces(a)lists.merlins.org> Apparently smtplib.py makes a delivery attempt without doing EHLO or HELO first, and then users the size extention, which is illegal before EHLO has been used. I have the following defaults: SMTP_MAX_RCPTS = 500 MAX_DELIVERY_THREADS = 0 SMTPHOST = 'localhost' SMTPPORT = 0 My exim debug logs show: This one is good: SMTP>> 220 mail2.merlins.org ESMTP Exim 3.31-VA-mm2 #1 Wed, 12 Dec 2001 22:28:08 SMTP<< ehlo moremagic.merlins.org SMTP>> 250-mail2.merlins.org Hello mailman at localhost [127.0.0.1] 250-SIZE 52428800 250-EXPN 250-PIPELINING 250-STARTTLS 250 HELP SMTP<< mail FROM:<powerteam-bounces(a)lists.merlins.org> size=3426 SMTP>> 250 <powerteam-bounces(a)lists.merlins.org> is syntactically correct SMTP<< rcpt TO:<tinic(a)tinic.net> SMTP>> 250 <tinic(a)tinic.net> is syntactically correct SMTP<< rcpt TO:<marc(a)merlins.org> SMTP>> 250 <marc(a)merlins.org> is syntactically correct SMTP<< data SMTP>> 354 Enter message, ending with "." on a line by itself (message follows) SMTP>> 250 OK id=16EPLk-0000fZ-00 SMTP<< quit SMTP>> 221 mail2.merlins.org closing connection But here's what happens afterwards. LOG: 4 MAIN SMTP connection from localhost [127.0.0.1] SMTP>> 220 mail2.merlins.org ESMTP Exim 3.31-VA-mm2 #1 Wed, 12 Dec 2001 22:28:08 -0800 - mm1 SMTP<< mail FROM:<powerteam-bounces(a)lists.merlins.org> size=3426 LOG: 4 MAIN SMTP syntax error in "mail FROM:<powerteam-bounces(a)lists.merlins.org> size=342 6" H=localhost [127.0.0.1] U=mailman: malformed address: size=3426 may not follo w <powerteam-bounces(a)lists.merlins.org> SMTP>> 501 <powerteam-bounces(a)lists.merlins.org> size=3426: malformed address: s ize=3426 may not follow <powerteam-bounces(a)lists.merlins.org> SMTP<< rset SMTP>> 250 Reset OK SMTP<< quit So here, mailman becomes rude, and doesn't say EHLO, and yet tries to use SIZE... (one hoyr later) Aaaah, I think I get it. moremagic:/var/local/mailman/logs# diff -u /var/local/src/mailman/Mailman/Handlers/SMTPDirect.py ../Mailman/Handlers/SMTPDirect.py --- /var/local/src/mailman/Mailman/Handlers/SMTPDirect.py Wed Nov 21 14:57:27 2001 +++ ../Mailman/Handlers/SMTPDirect.py Wed Dec 12 23:05:02 2001 @@ -274,7 +274,8 @@ # constructor if SMTPHOST is false refused = conn.sendmail(envsender, recips, msgtext) finally: - conn.quit() + 1 + #conn.quit() except smtplib.SMTPRecipientsRefused, e: refused = e.recipients # MTA not responding, or other socket problems, or any other kind of I'm not 100% sure it was meant to work that way, it looked like the code meant to send all the deliveries in one connection, which is why it didn't say helo in the second batch. So, I've removed the part that closes the connection after the first chunk is out. Barry, was this right? (I didn't check if it breaks the threaded code path) Marc PS: Don't make fun of me for sticking a '1' in there, I don't really claim to know python, and the parser was getting upset if I commented out conn.quit, or that plus the finally: I was watching Buffy on my tivo before all this happened, and I'd like to see the end of the episode :-) (see, just Like Niguel, I have a worthy excuse :-D) -- Microsoft is to operating systems & security .... .... what McDonalds is to gourmet cooking Home page: http://marc.merlins.org/ | Finger marc_f(a)merlins.org for PGP key

3 5

Re: [Mailman-Developers] To be more precise on the Web errors...
by Dan Mick 15 Dec '01

15 Dec '01

I still seem OK without that latest MailList.py patch. > Hi, > > it seems that accessing via Web the main /mailman/listinfo page I get the error > below, but if I access directly one (and only this, it seems) list > via /mailman/listinfo/listname all works fine :-) I can perform all the > administrative operations! :-) I don't know why only for this list, > anyway... > > Here is the Traceback for the lists that don't work: > > Traceback (most recent call last): > File "/home/mailman/scripts/driver", line 96, in run_main > main() > File "/home/mailman/Mailman/Cgi/admin.py", line 62, in main > mlist = MailList.MailList(listname, lock=0) > File "/home/mailman/Mailman/MailList.py", line 98, in __init__ > self.Load() > File "/home/mailman/Mailman/MailList.py", line 531, in Load > self.CheckVersion(dict) > File "/home/mailman/Mailman/MailList.py", line 548, in CheckVersion > self.Lock() > File "/home/mailman/Mailman/MailList.py", line 151, in Lock > self.Load() > File "/home/mailman/Mailman/MailList.py", line 531, in Load > self.CheckVersion(dict) > File "/home/mailman/Mailman/MailList.py", line 548, in CheckVersion > self.Lock() > File "/home/mailman/Mailman/MailList.py", line 147, in Lock > self.__lock.lock(timeout) > File "/home/mailman/Mailman/LockFile.py", line 268, in lock > raise AlreadyLockedError > AlreadyLockedError: > > --luca > > > _______________________________________________ > Mailman-Developers mailing list > Mailman-Developers(a)python.org > http://mail.python.org/mailman/listinfo/mailman-developers

9 22

marshal.load() and error handling
by Cillian Sharkey 15 Dec '01

15 Dec '01

I'd been getting EOF errors for some time now, both in log/error and from cron/checkdbs, e.g: Traceback (most recent call last): File "/local/mailman/cron/checkdbs", line 92, in ? main() File "/local/mailman/cron/checkdbs", line 43, in main count = mlist.NumRequestsPending() File "/local/mailman/Mailman/ListAdmin.py", line 96, in NumRequestsPending self.__opendb() File "/local/mailman/Mailman/ListAdmin.py", line 69, in __opendb self.__db = marshal.load(fp) EOFError: EOF read where object expected So I decided to track it down: the problem was lists with corrupt request.dbs. I think the solution would be to handle the EOFError exception in ListAdmin.py in __opendb. I don't know Python, but perhaps something along the lines of: def __opendb(self): if self.__db is None: assert self.Locked() and self.__filename try: fp = open(self.__filename) self.__db = marshal.load(fp) fp.close() except IOError, e: if e.errno <> errno.ENOENT: raise self.__db = {} + except EOFError, e: + self.__db = {} In addition to this, it may be worthwhile handling other errors (ValueError, TypeError etc.) which indicate corrupt databases. Some of the other mailman code which uses marshal.load does this. Perhaps all uses of marshal.load should be checked for extra error handling? There was no easy way to find out which request database was corrupt (there doesn't appear to be any script similar to check_db to do the same for the request.db file) so I just wrote a script based on check_db to help find corrupt request.dbs. I think something like this (cleaned up of course) should be added to the distribution.. bin/check_request_db ------------8<------------ #! /usr/bin/env python """Check the raw request.db for a mailing list. Usage: %(program)s listname """ import sys import os import string import marshal import paths from Mailman import mm_cfg program = sys.argv[0] def testfile(filename): try: fp = open(filename) except IOError, (code, msg): print filename, 'cannot be opened:\n\t', msg return 1 else: try: d = marshal.load(fp) except (EOFError, ValueError, TypeError), msg: print filename, 'is corrupted:\n\t', msg return 1 else: print filename, 'is fine' return 0 def main(): if len(sys.argv) == 2: listname = string.lower(sys.argv[1]) else: print __doc__ % globals() sys.exit(1) listpath = os.path.join(mm_cfg.LIST_DATA_DIR, listname) configdb = os.path.join(listpath, 'request.db') testfile(configdb) if __name__ == '__main__': main() ------------>8------------ Regards, -- Cillian [PS: please CC me on any replies]

1 0