Mailman 3 June 2002 - Mailman-Users

MimeFilter integration with Mailman
by J C Lawrence June 2, 2002

June 2, 2002

<<Reply-To set to mailman-users(a)python.org>> A while back I noticed that while we'd been happily recommending MimeFilter for stripping unwanted MIME parts from messages before they got to mailman, nobody had bothered to say how to run it beyond "chuck it in the alias file". Problem: those instructions (generally) won't work. Reason: Mimefilter tries to create files and a temp directory in its CWD, and at least under postfix that means /var/spool/postfix which here is root.root/0755 (and I'm not about to change that). So I spent some time this morning and threw something together a little slicker. Its essentially a wrapper around Mailman's wrapper. What I got seems to work. I don't and won't claim beauty. --<cut>-- #!/bin/bash # Syntax: # # mimestrip <action> <target> # # Both arguments will be passed to /var/lib/mailman/mail/wrapper # in the same order, without change. # # All other arguments will be gleefully discarded. # # Author: J C Lawrence <claw(a)kanga.nu> # ACTION=$1 TARGET=$2 export PATH=/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/sbin:/usr/sbin # -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= # Config (Edit this bit to suit your setup!) # -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= # Safe working directory for mimefilter. We need to do this as # postfix by default will execute this script in /var/spool/postfix and # mimefilter will try and create temp directories and files under there. # Note: Make sure that the value of tmpdir is writeable by the UID or GID # that this script will execute under. tmpdir="/tmp/mimestrip.${$}" # Do you want to save an mbox of the messages before filtering # in $savefile_pre? (0/1) save_pre=1 # Do you want to save an mbox of the messages after filtering # in $savefile_post? (0/1) save_post=1 # File to save pre-filtered messages in savefile_pre="/tmp/mimestrip.prefilter" # File to same post filtered messages in savefile_post="/tmp/mimestrip.postfilter" # Send a copy of every processed message to the list maintainer? (Y/N) copy_maintainer="y" # -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= # MimeFilter setup (Don't edit from here down) # -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= # The name of the mailing list this message is intended for. Used # as the return address of the warning issued to the orginal author # if the message is not already clean. export list=${USER} # The address of the mailing list this message is intended for. # Used in the X-Loop field of the warning issued to the original # author if the message is not already clean. export listaddr=${USER}@${DOMAIN} # The administrative (owner) address of the mailing list this # message is inteded for. Used in the return address of the warning # issued to the original author if the message is not already clean. export listreq=${USER}-admin@${DOMAIN} # The email address of the maintainer of the mailing list this # message is inteded for. If it is defined, it is used to send the # maintainer original carbon copies of messages that have been # modified by this filter -- if filter_mime_cc_maintainer is # affermative, of course. export maintainer=${USER}-owner@${DOMAIN} # A boolean flag: if affermative (i.e., if it matches the /y/i Perl # regular expression), the mimefilter script will send carbon copies # of every cleaned (modified) message to the maintainer of the # mailing list the message is intended for. export filter_mime_cc_maintainer=${copy_maintainer} # -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= # Start working # -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= # Build a safe working directory for mimefilter. We need to do this as # postfix by default will execute this script in /var/spool/postfix and # mimefilter will try and create temp directories and files under there, # which will fail on permissions. # Note: Make sure that the value of tmpdir is writeable by the UID or GID # that this script will execute under. rm -rf ${tmpdir} 2> /dev/null mkdir ${tmpdir} cd ${tmpdir} # Working files (over-engineered and IO heavy, but useful during debugging # and tuning of the filter setup) tmpfile="mimestrip.$$" holdfile="mimehold.$$" # DEBUG #pwd > /tmp/mimestrip.pwd #set > /tmp/mimestrip.env # Get the inbound message from stdin and run it thru mimefilter with # copies saved for before and after. The mimestrip.err file should # always be empty. I found it useful for debugging. Nuke freely. # Note: If there's an "X-MimeStrip: No" header (actually anywhere in the # message), then don't run this message thru mimefilter but pass it # straight on to the mailman wrapper. cat > ${holdfile} grep -i "^X-MimeStrip:[ \t]*No" ${holdfile} if [ $? ] then cat ${holdfile} | /usr/bin/mimefilter > ${tmpfile} 2> /tmp/mimestrip.err # If there's nothing left of the message (less than 5 lines), don't # bother sending it forward to Mailman. count=`cat ${tmpfile} | wc -l` if [ $count -gt 5 ] then cat ${tmpfile} | /var/lib/mailman/mail/wrapper ${ACTION} ${TARGET} fi else # We found a header so send it thru unfiltered. cat ${tmpfile} | /var/lib/mailman/mail/wrapper ${ACTION} ${TARGET} fi # Save copies of the before and after messages off to a temp file for # analysis/debugging if [ $save_pre -eq 1 ] then cat ${holdfile} >> /tmp/mimestrip.prefilter echo >>/tmp/mimestrip.prefilter fi if [ $save_post -eq 1 ] then cat ${tmpfile} >> /tmp/mimestrip.postfilter echo >> /tmp/mimestrip.postfilter fi # Clean up rm -rf ${tmpdir} exit 0 --<cut>-- Notes: Use in your Mailman alias file as so (for a list called "test"): test: "|/some/path/here/mimestrip post test" More simply just replace the normal /var/lib/mailman/mail/wrapper" with the call to mimestrip. The script is Postfix specific in that it expects the $USER and $DOMAIN in its environment to be respectively set to the LHS and RHS of the address the message was sent to. Hack freely for your MTA of choice if it does something different. Why not use demime which does all sorts of cool things like Yahoo signature removal and getting rid of unnecessary quoted-printable? demime strips all MIME parts, which is fine if that's what you want. However there are certain MIME parts that I specifically want to let thru to my lists (eg message/rfc822), and I rather like some of mimefilter's other features thta demime doesn't share like emailing the original poster with a warning that parts were removed from their message. Yeah, those extra messages are annoying to the posters. They're intended to be and I like that. I don't want posters sending unwanted MIME parts to my lists. Note: You can turn off that feature in Mimefilter's config. I also wanted a way to send MIME messages thru to my lists without doing any MIME stripping. A bypass if you would. Typically I'd use this for valid/valuable list messages which contain useful MIME parts (eg an attached image such as a graph diagramming the message content) that would otherwise be stripped my the mimefilter. In the end I did this via a custom X-header: X-MimeStrip: No. Strong suggestion: Configure your lists to hold messages with that header for moderator approval. This will allow you to catch abuse by too-clever posters. Mailman v2.1 largely removes need for this mimestrip filter. If all you want is mimestripping then Mailman 2.1 should be more than enough. However I want more than that. I want mimefilter's annoying messages to posters of unwanted MIME, I want the bypass, I want the ability to save the before and after filtering messages etc, and I really want the ability to ad-hoc extend the filter with other little toys and trinkets as I go along (eg a quoted-printable flattener will likely be next for me here). Adding in something like SpamAssassin into the mail processing pipe with a custom handling rule (eg silently discard messages with high enough scores before passing them thru mimefilter) would be trivially easy and is left as an exercise for the reader. This is barely if at all tested. Caveat Emptor and all that rot. Yeah, I should put this in the FAQ and I hopefully will after I've run it thru a few more exercises here. Enjoy. -- J C Lawrence ---------(*) Satan, oscillate my metallic sonatas. claw(a)kanga.nu He lived as a devil, eh? http://www.kanga.nu/~claw/ Evil is a name of a foeman, as I live.

1 0

Mailman in french
by Laurent Rathle June 2, 2002

June 2, 2002

Hello, Is it possible to put french messages and templates in mailman 2.0.8 and if yes, how do I set it ? Thank you, -- lrathle(a)teaser.fr

2 1

restricting privileges
by john d June 2, 2002

June 2, 2002

Hi, Can anyone suggest a way of restricting privileges in the Mailman web admin pages? In particular I'd like to stop users with list-admin privileges from being able to change the max_message_size setting but still allow site-admins to have full access. Thanks John

3 2

Is mailman the thing to use with a big newsletter?
by Support June 2, 2002

June 2, 2002

Hello, i'm searching a software that gives me the ability to send my newsletter to nearly 240'000 recipents. My webserver is running Debian potato. I don't now weather mailman is the right software. I'd be very happy if you could tell me about your experiences. Thanks, Florian Kubis

3 2

Greetings from Northeastern Argentina's
by Eduardo Sosa June 2, 2002

June 2, 2002

Hi! After years having used Sendmail+Majordomo+Linux, I´ve migrated to Exim+Mailman+linux http://listas.unam.edu.ar/mailman/listinfo . I do know that you receive questions like this one every day, but I would like to know from where could I download a spanish translation for the Mailman 2.0.11 With regards -- ///////////////////////////////////////////// Eduardo Omar Sosa eososa(a)unam.edu.ar Universidad Nacional de Misiones Ruta 12 Km 7,5 - 3304 M. Lanús Tel-Fax: (++54 3752) 480529 A R G E N T I N A /////////////////////////////////////////////

2 1

html messages in archives?
by Steven June 2, 2002

June 2, 2002

hiya, is it possible for messages which were sent in html and/or mime to be displayed in the archives as they were displayed to recipients? default settings seem to display the code as PRE test rather than HTML or MIME. any docs to point me to that I'm missing which touch on this subject? any hacks available if no settings to do it with? thanks, ~Steven

2 1

Accumulated Admin Request Reset
by Ahamed Kaize June 2, 2002

June 2, 2002

We are using MailMan version 2.0.10 For some reason, I have a list of more than 3,000 list admin requests (approving posts, etc.) that Mailman has accumulated over the downtime period, and it's all but impossible to clear that using the Mailman script (I got a 500 error the one time I tried it). Since then, I'm unable to log back into Mailman too. How can I over come this trouble? Is there a way to reset these requested from the server? Thank you,

1 0

The disappearing messages ??
by Stefaans Mostert June 2, 2002

June 2, 2002

Heya all I posted previousely about my message problem. In short I post to a moderated list it notifies me that there is a request and when I click on the link there is nothing. What puzzles me is that the next day I got the message @ the bottom here If I log in I cannot see my messages and I cannot approve them Please help!!!! I am @ the end of my wits here. If you look @ the times they were sent you can imagine what huors I have been putting into this ;-) I use mailman-2.0.11 witch I recently upgraded from mailman-2.0.10 and python2-2.2.1-1.i386.rpm(from python site) evereything else looks fine 6 Test911 admin request(s) waiting Date: Sun, 02 Jun 2002 17:00:01 +0200The Test911@<domain>.net mailing list has 6 request(s) waiting for your consideration at: http://<domain>.net/mailman/admindb/test911 Please attend to this at your earliest convenience. This notice of pending requests, if any, will be sent out daily. Pending posts: From: groottoets@<domain>.net on Sun Jun 2 23:14:01 2002 Cause: Post to moderated list From: groottoets@<domain>.net on Sun Jun 2 23:25:01 2002 Cause: Post to moderated list From: stefaans@<domain>.co.za on Sun Jun 2 23:32:01 2002 Cause: Post to moderated list From: groottoets@<domain>.net on Sun Jun 2 23:37:01 2002 Cause: Post to moderated list From: stefaans@<domain>.co.za on Sun Jun 2 00:12:02 2002 Cause: Post to moderated list From: richard@<domain>.net on Sun Jun 2 00:18:01 2002 Cause: Post to moderated list -- No Microsoft products were used or employees harmed In creating this e-mail.

1 0

Accumulated Admin Request Reset
by Ahamed Kaize June 2, 2002

June 2, 2002

Using version 2.0.10 For some reason, I have a list of more than 3,000 list admin requests (approving posts, etc.) that Mailman has accumulated over the downtime period, and it's all but impossible to clear that using the Mailman script (I got a 500 error the one time I tried it). Is there a way to reset these requested from the server

1 0

Re: [Mailman-Users] how to generate list of administrators
by Cassandra Fleetwood June 2, 2002

June 2, 2002

I found the following script at http://msgs.securepoint.com/cgi-bin/get/mailman-users-0101/294.html #!/bin/sh # output 'listname : owner' for all lists for i in ../lists/*; do this=`basename $i` printf "$this : " config_list -o - $this | egrep '^owner =' | cut -f2 -d"'" done -Cassandra ----- Original Message ----- From: "Sarah K. Miller" <techgrrl(a)beeze.com> To: "Cassandra Fleetwood" <csf(a)incose.propagation.net> Sent: Sunday, June 02, 2002 11:21 AM Subject: Re: [Mailman-Users] how to generate list of administrators > Version 2.1b* does this for you, using the bin/list_admins command. > > ----- Original Message ----- > From: "Cassandra Fleetwood" <csf(a)incose.propagation.net> > To: <mailman-users(a)python.org> > Sent: Sunday, June 02, 2002 10:03 AM > Subject: [Mailman-Users] how to generate list of administrators > > > I want to create a mailing list of the list administrators. How do I generate this. I'd rather not access each list for this info. > -Cassandra >

1 0