Mailman 3 September 1999 - Mailman-Developers

Reminder: Python Conference papers due soon!
by Guido van Rossum 17 Sep '99

17 Sep '99

The deadline for paper submissions for the next Python conference is nearing! Make sure that if you are considering submitting a paper, the program chair sees your paper by SEPTEMBER 30. Papers can be on any Python, JPython or Zope related subject. Papers will be reviewed and the best papers will be selected for presentation. You will hear about selection by October 22. For more information, see the official call for papers: http://www.python.org/workshops/2000-01/cfp.html ** We are planning a significant Zope presence at this conference! ** The conference will be held from January 24-27 in Alexandria, VA (just across the Potomac from DC). Make Python the first conference in the new millennium you visit! For more info, see the conference home page: http://www.python.org/workshops/2000-01/ Send all email questions about papers to: ipc8papers(a)cs.uchicago.edu --Guido van Rossum (home page: http://www.python.org/~guido/) (And sorry for the broad spamming.)

1 0

Re: [Mailman-Developers] [PATCH] MTA patch for sendmail/qmail
by Nigel Metheringham 15 Sep '99

15 Sep '99

julian7(a)kva.hu said: > This patch's goal is to use the sendmail-interface rather than use the > SMTP port managing to send letters. This method is much more > effective when the SMTP server itself is in the local machine. (due of > the latency of establishing a socket) I find this *very* strange - I would expect the process startup hit to be a real performance limiter in this situation. However some of the differences in the way that qmail runs as opposed to a sendmail or similar MTA daemon may well mean that this method works for qmail. Certainly the latency to connect to a loopback network socket should be minimal (as long as no one starts trying to do strange things like remote DNS reverse lookups of 127.0.0.1). Other downsides are the inability to deal with errors relating to a single recipient other than by a bounce message (ie no per recipient turnround message). Actually maybe thats the latency you are referring to - in an SMTP transaction you *should* wait after each RCPT TO for a return code, so each recipient would have a turnround time and a couple of process context switches. If the MTA supports streaming (ESMTP required) then you could blat the recipients across without waiting for turnround - you can't just fire them in a pile because its possible you could get a double blocking leading to deadly embrace - and then check the return codes separately. [I haven't checked through the python code to see exactly whats happening here] Nigel. -- [ Nigel Metheringham Nigel.Metheringham(a)VData.co.uk ] [ Phone: +44 1423 850000 Fax +44 1423 858866 ]

2 1

lock timeout ?
by Gergely Madarasz 15 Sep '99

15 Sep '99

Hello, This is running on a stock 2.2.12 kernel... what could be the problem ? -- Madarasz Gergely gorgo(a)caesar.elte.hu gorgo(a)linux.rulez.org It's practically impossible to look at a penguin and feel angry. Egy pingvinre gyakorlatilag lehetetlen haragosan nezni. HuLUG: http://mlf.linux.rulez.org/ ---------- Forwarded message ---------- Date: Wed, 15 Sep 1999 14:55:23 +0200 From: aikido-request(a)chardonnay.math.bme.hu To: root(a)chardonnay.math.bme.hu Subject: Mailman results for Aikido Resent-Date: Wed, 15 Sep 1999 14:53:51 +0200 Resent-From: korn(a)chardonnay.math.bme.hu Resent-To: gorgo(a)caesar.elte.hu This is an automated response. There were problems with the email commands you sent to Mailman via the administrative address <aikido-request(a)chardonnay.math.bme.hu>. To obtain instructions on valid Mailman email commands, send email to <aikido-request(a)chardonnay.math.bme.hu> with the word "help" in the subject line or in the body of the message. If you want to reach the human being that manages this mailing list, please send your message to <aikido-admin(a)chardonnay.math.bme.hu>. The following is a detailed description of the problems. ***** subscribe >>>>> An unexpected Mailman error has occurred. >>>>> >>>>> Please forward your request to the human list administrator in charge >>>>> of this list at <aikido-admin(a)chardonnay.math.bme.hu>. The traceback >>>>> is attached below and will be forwarded to the list administrator >>>>> automatically. Traceback (innermost last): File "/usr/lib/mailman/Mailman/MailCommandHandler.py", line 204, in ParseMailCommands self.__dispatch[cmd](args, line, msg) File "/usr/lib/mailman/Mailman/MailCommandHandler.py", line 542, in ProcessSubscribeCmd self.AddMember(subscribe_address, password, digest, remote) File "/usr/lib/mailman/Mailman/MailList.py", line 885, in AddMember cookie = Pending().new(name, password, digest) File "/usr/lib/mailman/Mailman/Pending.py", line 67, in new db = self.__load() File "/usr/lib/mailman/Mailman/Pending.py", line 94, in __load self.__assert_lock(self.db_lock_timeout) File "/usr/lib/mailman/Mailman/Pending.py", line 120, in __assert_lock self.__lock.lock(timeout) File "/usr/lib/mailman/Mailman/flock.py", line 127, in lock raise TimeOutError TimeOutError

1 0

[PATCH] MTA patch for sendmail/qmail
by Balazs Nagy 15 Sep '99

15 Sep '99

Hiyas, I tested and debugged throughoutly my ol' patch and I found it useable. This patch's goal is to use the sendmail-interface rather than use the SMTP port managing to send letters. This method is much more effective when the SMTP server itself is in the local machine. (due of the latency of establishing a socket) In the attachment there's the latest patch. "Save it, patch it, try it, apply it" ("Hold Me, Thrill Me, Kiss Me, Kill Me"). -- Regards: Kevin (Balazs)

1 0

New Apps site: AppWatch.com!
by AppWatch Staff 13 Sep '99

13 Sep '99

Hi Mailman! We at AppWatch.com are excited about our new site, and looking for Apps lovers all around to enjoy our hard work. We only announce Open Source Software, and do our best to make the updates as quickly as possible. You can even set up your own account to personalize how AppWatch.com looks, and soon you'll be able to filter announcements too. So drop by http://www.appwatch.com an check out the latest, coolest Apps for Linux and other Unixes. Sincerely, The AppWatch Staff <staff(a)appwatch.com> ----- This email was sent to you based on your interest in Open Source applications. The AppWatch.com site services are absolutely free and we just hope you enjoy them. This is not a mailing list and you will not receive any more email on this matter. -----

2 1

Patch to rotate log files and mail to owner
by Sean Reifschneider 12 Sep '99

12 Sep '99

Here's a patch that adds the file cron/maillogs, which defaults to running at 5am every morning. This checks the 'error' and 'smtp-failures' files and if they contain any information they are rotated and a summary is sent to the MAILMAN_OWNER address. Also added is a COMPRESS_LOGFILES_WITH option which can be set to compress the log files (and specify what command to use for doing so). Sean Index: Mailman/Defaults.py.in =================================================================== RCS file: /projects/cvsroot/mailman/Mailman/Defaults.py.in,v retrieving revision 1.83 diff -c -r1.83 Mailman/Defaults.py.in *** Mailman/Defaults.py.in 1999/09/07 18:32:44 1.83 --- Mailman/Defaults.py.in 1999/09/12 09:12:09 *************** *** 83,88 **** --- 83,93 ---- # night to generate the txt.gz file. See cron/nightly_gzip for details. GZIP_ARCHIVE_TXT_FILES = 0 + # Set this to the name of an compression command to run (with "%s" being + # substituted for the file name to compress) to compress the logfiles. + # If this value is not set, logfiles will not be compressed. + #COMPRESS_LOGFILES_WITH = 'gzip "%s"' + HOME_PAGE = 'index.html' MAILMAN_OWNER = 'mailman-owner@%s' % DEFAULT_HOST_NAME Index: Mailman/mm_cfg.py.dist.in =================================================================== RCS file: /projects/cvsroot/mailman/Mailman/mm_cfg.py.dist.in,v retrieving revision 1.21 diff -c -r1.21 Mailman/mm_cfg.py.dist.in *** Mailman/mm_cfg.py.dist.in 1998/06/19 20:11:32 1.21 --- Mailman/mm_cfg.py.dist.in 1999/09/12 09:12:09 *************** *** 55,59 **** --- 55,61 ---- PUBLIC_ARCHIVE_URL = '/pipermail' PRIVATE_ARCHIVE_URL = '/mailman/private' + #COMPRESS_LOGFILES_WITH = 'gzip "%s"' + # Note - if you're looking for something that is imported from mm_cfg, but you # didn't find it above, it's probably in Defaults.py. Index: cron/crontab.in.in =================================================================== RCS file: /projects/cvsroot/mailman/cron/crontab.in.in,v retrieving revision 1.12 diff -c -r1.12 cron/crontab.in.in *** cron/crontab.in.in 1999/09/04 03:25:36 1.12 --- cron/crontab.in.in 1999/09/12 09:12:09 *************** *** 1,6 **** --- 1,9 ---- # At 5PM every day, mail reminders to admins as to pending requests 0 17 * * * @PYTHON@ @prefix@/cron/checkdbs # + # At 5AM every day, mail error logs to admin user + 0 5 * * * @PYTHON@ @prefix@/cron/maillogs + # # Noon, mail digests for lists that do periodic as well as threshhold delivery. 0 12 * * * @PYTHON@ @prefix@/cron/senddigests # =================================================================== *** cron/maillogs.orig Sun Sep 12 03:08:42 1999 --- cron/maillogs Sun Sep 12 03:01:52 1999 *************** *** 0 **** --- 1,83 ---- + #! /usr/bin/env python + # + # Copyright (C) 1998 by the Free Software Foundation, Inc. + # + # This program is free software; you can redistribute it and/or + # modify it under the terms of the GNU General Public License + # as published by the Free Software Foundation; either version 2 + # of the License, or (at your option) any later version. + # + # This program is distributed in the hope that it will be useful, + # but WITHOUT ANY WARRANTY; without even the implied warranty of + # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the + # GNU General Public License for more details. + # + # You should have received a copy of the GNU General Public License + # along with this program; if not, write to the Free Software + # Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA. + + """Check the error logs and send any which have information in them. + + If any log entries exist, a message is sent to the mailman owner address + and the logs are rotated. + """ + + import sys, os, string, time, errno + import paths + from Mailman import mm_cfg, Utils + import fileinput, socket, time, stat + + # Work around known problems with some RedHat cron daemons + import signal + signal.signal(signal.SIGCHLD, signal.SIG_DFL) + + + newLogfiles = [] + text = [] + text.append('MailMan Log Report') + text.append('Generated: %s' % time.ctime(time.time())) + text.append('Host: %s' % socket.gethostname()) + text.append('') + + logDate = time.strftime('%Y%m%d-%H%M%S', time.localtime(time.time())) + textSend = 0 + for log in ( 'error', 'smtp-failures' ): + fileName = os.path.join(mm_cfg.LOG_DIR, log) + + # rotate file if it contains any data + stats = os.stat(fileName) + if stats[stat.ST_SIZE] < 1: continue + fileNameNew = '%s.%s' % ( fileName, logDate ) + newLogfiles.append(fileNameNew) + os.rename(fileName, fileNameNew) + open(fileName, 'w') + os.chmod(fileName, stat.S_IMODE(stats[stat.ST_MODE])) + os.chown(fileName, stats[stat.ST_UID], stats[stat.ST_GID]) + + textSend = 1 + tmp = '# FILE: %s #' % fileNameNew + text.append('#' * len(tmp)) + text.append(tmp) + text.append('#' * len(tmp)) + text.append('') + + linesLeft = 30 # e-mail first linesLeft of log files + for line in fileinput.input(fileNameNew): + if linesLeft == 0: + text.append('[... truncated ...]') + break + linesLeft = linesLeft - 1 + line = string.rstrip(line) + text.append(line) + text.append('') + + # send message if we've actually found anything + if textSend: + text = string.join(text, '\n') + '\n' + Utils.SendTextToUser('MailMan Log Report -- %s' % time.ctime(time.time()), + text, mm_cfg.MAILMAN_OWNER, mm_cfg.MAILMAN_OWNER) + + # compress any log-files we made + if hasattr(mm_cfg, 'COMPRESS_LOGFILES_WITH') and mm_cfg.COMPRESS_LOGFILES_WITH: + for file in newLogfiles: + os.system(mm_cfg.COMPRESS_LOGFILES_WITH % file) -- Linux: When you need to run like a greased weasel. -- Sean Reifschneider, 1998 Sean Reifschneider, Inimitably Superfluous <jafo(a)tummy.com> URL: <http://www.tummy.com/xvscan> HP-UX/Linux/FreeBSD/BSDOS scanning software.

1 0

Another typo
by Sean Reifschneider 12 Sep '99

12 Sep '99

Index: paths.py.in =================================================================== RCS file: /projects/cvsroot/mailman/misc/paths.py.in,v retrieving revision 1.4 diff -c -r1.4 paths.py.in *** paths.py.in 1998/06/22 21:58:04 1.4 --- paths.py.in 1999/09/12 07:38:02 *************** *** 16,22 **** # along with this program; if not, write to the Free Software # Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA. ! # This file becomes paths.py which is installed in may directories. By # importing this module, sys.path gets `hacked' so that the $prefix/Mailman # directory is inserted at the start of that list. That directory really # contains the Mailman modules in package form. This file exports two --- 16,22 ---- # along with this program; if not, write to the Free Software # Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA. ! # This file becomes paths.py which is installed in many directories. By # importing this module, sys.path gets `hacked' so that the $prefix/Mailman # directory is inserted at the start of that list. That directory really # contains the Mailman modules in package form. This file exports two -- "I want to see more of you around the lab." "Fine. I'll gain weight." -- Chris Knight, _Real_Genius_ Sean Reifschneider, Inimitably Superfluous <jafo(a)tummy.com> URL: <http://www.tummy.com/xvscan> HP-UX/Linux/FreeBSD/BSDOS scanning software.

1 0

Sub-address patch
by Sean Reifschneider 12 Sep '99

12 Sep '99

I haven't done any testing of this code yet (I'm not comfortable enough with things to shove this into production, and don't have a test mailman setup I can run this on). The goal of this patch is to add sub-address matching to the SMART_ADDRESS_MATCH code. I've added a new option "SMART_ADDRESS_MATCH_SUBADDR" to make it easy to disable (perhaps it should even be allowed on a per-list basis?). It's goal is to match "user-mailman-devel(a)example.com" with "user(a)example.com". I frequently subscribe to a list as "jafo-listname@", but submit from "jafo@" and sometimes get tripped up in the closed-list restrictions. It handles both qmail-style sub-addresses (as above) and sendmail-style ("jafo+mailman+devel"). I believe this was one of the things that I asked to be added to the TODO list, but I don't see it on there (nor did I see any discussion of it). Sean =============== Index: Defaults.py.in =================================================================== RCS file: /projects/cvsroot/mailman/Mailman/Defaults.py.in,v retrieving revision 1.83 diff -c -r1.83 Defaults.py.in *** Defaults.py.in 1999/09/07 18:32:44 1.83 --- Defaults.py.in 1999/09/12 07:13:49 *************** *** 120,131 **** # spoofed messages may get through. USE_ENVELOPE_SENDER = 0 ! # When true, mailman will consider user(a)host.domain to be the same address ! # as user@domain. If set to 0, mailman will consider user(a)host.domain to ! # be the same address as user(a)Host.DoMain, but different than user@domain. ! # Usernames will be case preserved, and host parts of addresses will all be ! # lowercased. SMART_ADDRESS_MATCH = 1 # When set, the listinfo web page overview of lists on the machine will be # confined to only those lists whose web_page_url configuration option host # is included within the URL by which the page is visited - only those "on --- 120,139 ---- # spoofed messages may get through. USE_ENVELOPE_SENDER = 0 ! # When SMART_ADDRESS_MATCH is true, mailman will consider user(a)host.domain ! # to be the same address as user@domain. If set to 0, mailman will ! # consider user(a)host.domain to be the same address as user(a)Host.DoMain, ! # but different than user@domain. Usernames will be case preserved, ! # and host parts of addresses will all be lowercased. SMART_ADDRESS_MATCH = 1 + # When SMART_ADDRESS_MATCH_SUBADDR is true (as well as SMART_ADDRESS_MATCH), + # user names with '+' or '-' in them are tried with this part stripped. + # For example, "user-mailman-devel(a)example.com" will match + # (in addition to the full address) "user-mailman(a)example.com" and + # "user(a)example.com". Similarly with the '+' symbol (- is qmail, + is + # sendmail). + SMART_ADDRESS_MATCH_SUBADDR = 1 + # When set, the listinfo web page overview of lists on the machine will be # confined to only those lists whose web_page_url configuration option host # is included within the URL by which the page is visited - only those "on Index: Utils.py =================================================================== RCS file: /projects/cvsroot/mailman/Mailman/Utils.py,v retrieving revision 1.77 diff -c -r1.77 Utils.py *** Utils.py 1999/09/03 05:55:51 1.77 --- Utils.py 1999/09/12 07:13:51 *************** *** 455,471 **** """returns a sorted list of addresses that could possibly match a given name. ! For Example, given scott(a)pobox.com, return ['scott(a)pobox.com'], ! given scott(a)blackbox.pobox.com return ['scott(a)blackbox.pobox.com', 'scott(a)pobox.com']""" name = string.lower(name) user, domain = ParseEmail(name) res = [name] if domain: domain = domain[1:] while len(domain) >= 2: ! res.append("%s@%s" % (user, string.join(domain, "."))) domain = domain[1:] return res --- 455,486 ---- """returns a sorted list of addresses that could possibly match a given name. ! For Example, given scott(a)pobox.com, return ['scott-mailman(a)pobox.com'], ! given scott(a)blackbox.pobox.com return ['scott-mailman(a)blackbox.pobox.com', ! 'scott(a)blackbox.pobox.com', ! 'scott-mailman(a)pobox.com', 'scott(a)pobox.com']""" name = string.lower(name) user, domain = ParseEmail(name) res = [name] + + # Try stripping off sub-addresses + userList = [user] + if mm_cfg.SMART_ADDRESS_MATCH_SUBADDR: + userTmp = userList[0] + for split in ( '-', '+' ): + while 1: + pos = string.rfind(userTmp, split) + if pos <= 0: break # <= to not create empty user-names + userTmp = userTmp[:pos] + if pos: userList.append(userTmp) + if domain: domain = domain[1:] while len(domain) >= 2: ! for user in userList: ! res.append("%s@%s" % (user, string.join(domain, "."))) domain = domain[1:] return res -- Linux: When you need to run like a greased weasel. -- Sean Reifschneider, 1998 Sean Reifschneider, Inimitably Superfluous <jafo(a)tummy.com> URL: <http://www.tummy.com/xvscan> HP-UX/Linux/FreeBSD/BSDOS scanning software.

1 0

MailMan typo and suggestion
by Sean Reifschneider 12 Sep '99

12 Sep '99

In reviewing the code I ran into a typo (first part of patch below). I also ran into "return not not foo & bar" which caused me to scratch my head a moment. The second part of the patch is to change this to "return (foo & bar) == bar", however the alternative may be "return not not (foo & bar) # coerce return to 1/0" Sean ======== Index: MailList.py =================================================================== RCS file: /projects/cvsroot/mailman/Mailman/MailList.py,v retrieving revision 1.135 diff -c -r1.135 MailList.py *** MailList.py 1999/09/02 15:04:14 1.135 --- MailList.py 1999/09/12 07:13:51 *************** *** 101,107 **** def __AddMember(self, addr, digest): """adds the appropriate data to the internal members dict. ! If the username has upercase letters in it, then the value in the members dict is the case preserved address, otherwise, the value is 0. """ --- 101,107 ---- def __AddMember(self, addr, digest): """adds the appropriate data to the internal members dict. ! If the username has uppercase letters in it, then the value in the members dict is the case preserved address, otherwise, the value is 0. """ *************** *** 201,207 **** return self.digest_members.has_key(user) if not self.user_options.has_key(user): return 0 ! return not not self.user_options[user] & option def SetUserOption(self, user, option, value, save_list=1): user = self.GetUserCanonicalAddress(user) --- 201,207 ---- return self.digest_members.has_key(user) if not self.user_options.has_key(user): return 0 ! return (self.user_options[user] & option) == option def SetUserOption(self, user, option, value, save_list=1): user = self.GetUserCanonicalAddress(user) -- Linux: Bring back that "greased weasel" feeling. -- Sean Reifschneider, 1998 Sean Reifschneider, Inimitably Superfluous <jafo(a)tummy.com> URL: <http://www.tummy.com/xvscan> HP-UX/Linux/FreeBSD/BSDOS scanning software.

1 0

Re: Cron <list@chiark> [ -x /usr/bin/python -a -f /usr/lib/mailman/cron/run_queue ] && /usr/bin/python /usr/lib/mailman/cron/run_queue
by Gergely Madarasz 10 Sep '99

10 Sep '99

On Fri, 10 Sep 1999, Ian Jackson wrote: > Cron Daemon writes ("Cron <list@chiark> [ -x /usr/bin/python -a -f /usr/lib/mailman/cron/run_queue ] && /usr/bin/python /usr/lib/mailman/cron/run_queue"): > > Traceback (innermost last): > > File "/usr/lib/mailman/cron/run_queue", line 46, in ? > > main() > > File "/usr/lib/mailman/cron/run_queue", line 39, in main > > lockfile.lock() > > File "/usr/lib/mailman/Mailman/flock.py", line 114, in lock > > if self.locked(): > > File "/usr/lib/mailman/Mailman/flock.py", line 193, in locked > > pid, winner = self.__read() > > File "/usr/lib/mailman/Mailman/flock.py", line 96, in __read > > pid, winner = string.split(string.strip(fp.read())) > > ValueError: unpack list of wrong size > > Exception exceptions.ValueError: 'unpack list of wrong size' in <method FileLock.__del__ of FileLock instance at 80a1f38> ignored > > I just got this mail. You'll remember that I mailed you a little > while ago when my system ran out of disk space and I got a `no space > left on device' error (which was obviously expected) and something > that looked like the stuff above (which you told me I could ignre). > > But, as you can see, it's happened again, and there is plenty of disk > space and I can't see anything wrong. Hmmm... I don't know what this should mean... Greg

1 0