Mailman 3 November 2001 - Mailman-Developers

Administrate mailman from shell
by Jonas Meurer 30 Nov '01

30 Nov '01

Hello, Is there a way to configure mailman completely from the shell? It don't has to be compfortable, it only is for scripts etc... I've heard somewhere that it's possible. The cgi-bin-scripts also only can execute probrams, he? Is there a howto for administrate and configure mailman from the shell? If not, can anyone list me all commandlines? As compensation then I will write a howto. Thanks Jonas -- Definition of Atheism: a non-prophet organization.

2 1

Re: [Mailman-Developers] Administrate mailman from shell
by J C Lawrence 30 Nov '01

30 Nov '01

On Fri, 30 Nov 2001 08:49:31 +0100 Jonas Meurer <jmeurer(a)gmx.de> wrote: > Is there a way to configure mailman completely from the > shell? Yes. ~/bin/with_list. Knowledge of Python and Mailman internals is required. See the list archives for examples. Please drop your findings in the FAQ: http://www.python.org/cgi-bin/faqw-mm.py?req=home -- J C Lawrence ---------(*) Satan, oscillate my metallic sonatas. claw(a)kanga.nu He lived as a devil, eh? http://www.kanga.nu/~claw/ Evil is a name of a foeman, as I live.

1 0

MailGraph for Postfix
by J C Lawrence 30 Nov '01

30 Nov '01

http://people.ee.ethz.ch/~dws/software/mailgraph/ --<cut>-- Mailgraph is a very simple mail statistics RRDtool frontend for Postfix that produces daily, weekly, monthly and yearly graphs of received/sent and bounced/rejected mail. --<cut>-- It doesn't do the level of abstraction I'd really like (graphing per Sender: header), but its fairly easy to extend to do that if I ever get around to it. ITMT its a rather useful general MTA performance and monitoring tool. Certainly it revealed me a few things about my mail systems I hadn't fully grokked before. Demo site: http://people.ee.ethz.ch/~dws/mailgraph/mailgraph.cgi Note: If you use syslog-ng there's a very simple patch you'll need to make to the Parse:Syslog package to get it to properly read syslog-ng log entries. -- J C Lawrence ---------(*) Satan, oscillate my metallic sonatas. claw(a)kanga.nu He lived as a devil, eh? http://www.kanga.nu/~claw/ Evil is a name of a foeman, as I live.

1 0

Re: [Mailman-Users] Backing up Mailman list installations
by J C Lawrence 29 Nov '01

29 Nov '01

On Thu, 29 Nov 2001 02:09:17 -0500 Jon Carnes <jonc(a)haht.com> wrote: > Cool scripts. Hacks really. > I used to do something similar, and then I moved over to using > "ncftp" to drop the tarball off on my backup-server. A matter of > preference, but I like that better than mailing myself the > tarball. Originally I kept the tarballs as versioned files in a ZOO archive. I didn't like this as ZOO suffers as a tool and there was no distribution. Then I used to SSH/scp the tarballs to myself on another system. I didn't like this as it required that the tool that did the file copy must be able to authenticate itself on the other system (ie SSH public key authentication). I didn't like that as compromise of the local system thereby implied compromise of the the other system as well (or at least questions of untrusted shell access). Not good. No I mail them. No trust models required other than the fact that I'm implicitly exposing the tarballs en-route to interception, and thus the password/membership base as well. Well, that would be a problem except that the root account on that box delivers to a local mbox which I collect over an IMAP-SSL connection (the wonders of fetchmail). So, I get a decent trust model *and* distribution. -- J C Lawrence ---------(*) Satan, oscillate my metallic sonatas. claw(a)kanga.nu He lived as a devil, eh? http://www.kanga.nu/~claw/ Evil is a name of a foeman, as I live.

2 2

Backing up Mailman list installations
by J C Lawrence 29 Nov '01

29 Nov '01

<<Reply-To: set>> A moderately frequent request on these lists has been, "How can I back up my Mailman lists/membership/etc?" I happened to be in the area today touching up the scripts I use. Please feel free to adapt freely. Note: You'll need to have a reasonably recent version of nmh installed as the scripts rely on the MH tools to build a MIME message: http://www.mhost.com/nmh/ The scripts: ~/bin/mimemail: --<cut>-- #!/bin/bash #set -x subject=$1 file=$2 addr=$3 echo "To: ${addr} From: nobody Subject: ${subject} #application/octet-stream [${subject}] ${file} " | /usr/bin/mh/mhbuild - > /tmp/mimemail.tmp.${$} /usr/lib/mh/post -verbose -watch /tmp/mimemail.tmp.${$} rm /tmp/mimemail.tmp.${$} --<cut>-- ~/bin/mailman.backup --<cut>-- #!/bin/bash #set -x datestr=`date +%Y%m%d` host=`hostname -f` file=mailman.lists.${datestr}.tar.gz filepath=~/backups/${file} sendto="root" cd /var/lib/mailman tar zcf ${filepath} lists cd ~/backups mimemail ${file} ${filepath} ${sendto} #rm ${file} --<cut>- Yeah, there are some hard coded paths in there. Sue me. I never said they were pretty, merely that they worked. Brief explanation: mimemail takes three arguments: the Subject: of the message its going to send, the file it is going to send, and the address it is going to send it to. mimemail depends on the nmh tools to build the MIME message. mailman.backup takes no arguments. It creates a compressed tarball of ~mailman/lists in the file ~/backups/mailman.lists.YYMMDD.tar.gz eg: mailman.lists.20011128.tar.gz And then uses mimemail to send that file to root@localhost (edit/change if you want) before deleting it. To use drop them in a cronjob something like: 0 6 * * 0 /home/archiver/bin/mailman.backup A sample execution should look something like: $ ./mailman.backup -- Posting for All Recipients -- -- Local Recipients -- root: address ok -- Recipient Copies Posted -- Message Processed The result will be that every time the cronjob runs it will send you (in this case root(a)host.dom) a message looking something like: Subject: mailman.lists.20011128.tar.gz From: nobody(a)kanga.nu Date: Wed, 28 Nov 2001 21:12:55 -0800 To: root(a)kanga.nu <MIME attachment application/octet-stream> Where the MIME attachment is the tarball constructed by ~/bin/mailman.backup. Edit the value of sendto in mailman.backup if you want them going somewhere else. I've added this to FAQ at: http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq04.006.htp -- J C Lawrence ---------(*) Satan, oscillate my metallic sonatas. claw(a)kanga.nu He lived as a devil, eh? http://www.kanga.nu/~claw/ Evil is a name of a foeman, as I live.

2 1

A few things...
by Chuq Von Rospach 29 Nov '01

29 Nov '01

First, Barry -- there's a message in the admin posting queue you need to take a look at. It's an unsub request I can't find, but it's probably not our problem, since we're also being hit really hard right now by both the latest virus and by people who seem to have been spammed onto some list(s) that seem tob e run on a mailman server somewhere, and the links to mailman are probably the only ones that work (again). Sigh -- those links in the default distribution are a mixed blessing... And, you know, I was thinking today that the message sent out that says: homebuoy1(a)hotmail.com has been removed from south-bay-birds. Would be a lot more useful if it told me how/why (has he been removed? Or unsubscribed?). One other thing -- this is another possible DoS issue, but I don't really have any good idea of what (if anything) you can do about it. I was working on some stuff the other day, and realized that my ~mailman/data directory had a huge number of files in it. It was stuffed with a bunch of heldmsg* files. At one point, a subscriber's mailer misbehaved and the daemon stuffed 400+ corrupted messages down our throats. We finally had to just blow away the requests.db file, but I didn't realize until later it left the requests in ~data (somehow, that needs to be cleaned up, but I don't know how to easily do that, but there seems a need for some kind of garbage collection here). But it also made me realize this opens the server to a denial attack. Someone who's pissed at you can simply start sending messages to be held into the admin queue, infinitely, until you run out of disk space or inodes. And with the current admin interface, you can effectively shut down the admin queeue by building a pending queue so large you can't process it. But I'm more worried about that disk-based DoS here; at the same time, I don't know how you could practically implement some kind of quota or protection, unless you wanted to check disk space, and if it falls below some lowwater mark, start TEMPFAILing messages back into the queue for later processing. That, though, simply moves the dos attack into the mail queues, although most mailers also do disk-space checks, and stop accepting mail if the disk gets too full,. Not a good situation, but at least it'd keep the system from shutting down because of a full disk.... Anyway, some stuff to give you headaches over....

1 0

FoRK-as-RSS (fwd)
by Mark Tearle 29 Nov '01

29 Nov '01

[Forwarded with permission] A cool hack, although Justin thinks it would be cooler if implemented inside Mailman/pipermail itself.... Yours Mark -- Mark Tearle - mark(a)tearle.com Roy Knable: Boy, this is strange! [As cartoon mice.] Helen Knable: Strange? I'm a cartoon mouse with high-heel sneakers. The word "strange" is somewhat lacking. ---------- Forwarded message ---------- Date: Wed, 28 Nov 2001 14:42:47 +1100 From: Justin Mason <jm(a)jmason.org> To: fork(a)xent.com Subject: FoRK-as-RSS For some reason, I've hacked up a script which scrapes MailMan list archives to generate RSS. Not sure why, seeing as I really should be doing more "proper" work, but there you go ;) The results: http://taint.org/mmrss/ http://taint.org/mmrss/FoRK.html http://taint.org/mmrss/FoRK.rss cheers! --j. http://xent.com/mailman/listinfo/fork

1 0

AttributeError: 'generator' object has no attribute 'pop' (was: Re: [Mailman-Developers] Uncaught runner exception: 'generator' object has no attribute 'insert')
by Markus Jansen 28 Nov '01

28 Nov '01

Hi Pavel, I have seen the same problem in Tagger.py (see context diff below) with incoming mails. Similar to you, I have some 2 days of Python experience, but it seems to work now. Best regards, Markus > diff -c Tagger.py.orig Tagger.py *** Tagger.py.orig Wed Nov 28 17:50:36 2001 --- Tagger.py Wed Nov 28 17:55:09 2001 *************** *** 81,87 **** # the first numlines of body text. lines = [] lineno = 0 ! reader = email.Iterators.body_line_iterator(msg) while numlines is None or lineno < numlines: try: line = reader.pop(0) --- 81,87 ---- # the first numlines of body text. lines = [] lineno = 0 ! reader = list(email.Iterators.body_line_iterator(msg)) while numlines is None or lineno < numlines: try: line = reader.pop(0) > > X-Authentication-Warning: asp.ogi.edu: nobody set sender to paja(a)asp.ogi.edu using -f > From: Pavel Chytil <paja(a)asp.ogi.edu> > To: "Barry A. Warsaw" <barry(a)zope.com> > Cc: mailman-developers(a)python.org > Subject: Re: [Mailman-Developers] Uncaught runner exception: 'generator' object has no attribute 'insert' > MIME-Version: 1.0 > Content-Transfer-Encoding: 8bit > User-Agent: Internet Messaging Program (IMP) 4.0-cvs > X-BeenThere: mailman-developers(a)python.org > X-Mailman-Version: 2.0.7 (101270) > List-Help: <mailto:mailman-developers-request@python.org?subject=help> > List-Post: <mailto:mailman-developers@python.org> > List-Subscribe: <http://mail.python.org/mailman/listinfo/mailman-developers>, <mailto:mailman-developers-request@python.org?subject=subscribe> > List-Id: Mailman mailing list developers <mailman-developers.python.org> > List-Unsubscribe: <http://mail.python.org/mailman/listinfo/mailman-developers>, <mailto:mailman-developers-request@python.org?subject=unsubscribe> > List-Archive: <http://mail.python.org/pipermail/mailman-developers/> > Date: Tue, 27 Nov 2001 14:03:42 -0800 > > Patch: > > --- NewsRunner.py Tue Nov 27 13:22:45 2001 > +++ NewsRunner.py Thu Oct 11 22:16:18 2001 > @@ -123,7 +123,7 @@ > # Lines: is useful > if msg['Lines'] is None: > # BAW: is there a better way? > - count = len(list(email.Iterators.body_line_iterator(msg))) > + count = len(email.Iterators.body_line_iterator(msg)) > msg['Lines'] = str(count) > # Massage the message headers by remove some and rewriting others. This > # woon't completely sanitize the message, but it will eliminate the bulk > > Pavel > > Cituji z emailu od Pavel Chytil <pchytil(a)asp.ogi.edu>: > > > This goes away if I change > > > > count = len(email.Iterators.body_line_iterator(msg)) > > > > to > > > > count = len(list(email.Iterators.body_line_iterator(msg))) > > > > in ./mailman/Mailman/Queue/NewsRunner.py line 126 > > > > I do not know if this is clean or not, but I never done anything with > > python. > > > > This introduce new problem which is nntp error: > > > > Nov 27 13:48:10 2001 (26172) (NNTPDirect) NNTP error for list "test": 441 437 > > No > > colon-space in "From pchytil(a)asp.ogi.edu Tue Nov 27 13:48:09 2001" header > > > > So my hacking is still in progress. I should probably read more about format > > of > > NNTP headers in documentation of mailman. > > > > Any ideas? > > > > Thanks, > > Pavel > > > > Cituji z emailu od Pavel Chytil <pchytil(a)ece.ogi.edu>: > > > > > I have the same problem like before. I am trying to gate my list with > > news. > > > Posting to news does not work and gives following error: > > > > > > Nov 27 11:12:30 2001 (18296) Uncaught runner exception: len() of unsized > > > object > > > Nov 27 11:12:30 2001 (18296) Traceback (most recent call last): > > > File "/work/mailman/Mailman/Queue/Runner.py", line 104, in __oneloop > > > self.__onefile(msg, msgdata) > > > File "/work/mailman/Mailman/Queue/Runner.py", line 152, in __onefile > > > keepqueued = self._dispose(mlist, msg, msgdata) > > > File "/work/mailman/Mailman/Queue/NewsRunner.py", line 56, in _dispose > > > prepare_message(mlist, msg, msgdata) > > > File "/work/mailman/Mailman/Queue/NewsRunner.py", line 126, in > > > prepare_message > > > count = len(email.Iterators.body_line_iterator(msg)) > > > TypeError: len() of unsized object > > > > > > gating from news to list works fine, though. I am suspecting very similar > > > problem as before. > > > > > > Thanks, > > > Pavel > > > > > > _______________________________________________ > > > Mailman-Developers mailing list > > > Mailman-Developers(a)python.org > > > http://mail.python.org/mailman/listinfo/mailman-developers > > > > > > > > > > > _______________________________________________ > > Mailman-Developers mailing list > > Mailman-Developers(a)python.org > > http://mail.python.org/mailman/listinfo/mailman-developers > > > > > > _______________________________________________ > Mailman-Developers mailing list > Mailman-Developers(a)python.org > http://mail.python.org/mailman/listinfo/mailman-developers -- Markus Jansen Markus.Jansen(a)ericsson.com Senior Designer, Technical Coordinator Ericsson Process & Application Consulting TTM Solutions / CM Tools VH/PAC/L/TD Phone +46 8 568 61560 Västberga Allé 36A Mobile +46 70 526 2548 12582 Stockholm, Sweden Fax +46 8 568 61888

1 0

I need Jpython 1.0.3
by Salil_Sanghvi＠i2.com 28 Nov '01

28 Nov '01

Hi, Can anybody give me Jpython 1.0.3, I havent found this anywhere. Salil

1 0

I need Jpython 1.0.3
by Salil_Sanghvi＠i2.com 28 Nov '01

28 Nov '01

Hi, Can anybody give me Jpython 1.0.3, I havent found this anywhere. Salil

1 0