Mailman 3 May 2007 - Mailman-Users

Using Mailman with Apache Tomcat
by Meenal Pant May 4, 2007

May 4, 2007

I have a server running Liferay using apache tomcat. I access the portal as: https://abc.xyz.org/web/guest/home Can I still install mailman and use it with apache as described in the Mailman Documentation.(http://www.gnu.org/software/mailman/mailman-install/front.ht… ? Basically I want to access mailman webserver as : https://abc.xyz.org/mailman/listinfo Will this work or do I have to integrate mailman with Tomcat ? If yes, then how to do so? Thanks Meenal

4 3

Re: [Mailman-Users] Duplicate Emails - but only if first email has HTMLor stationary
by Mark Sapiro May 4, 2007

May 4, 2007

Lisa Phillips wrote: > >Thank you for responding. I can provide the messages sent to the list, but >not the one as sent to the list. I am also going to see if the first one >caused some bounces from some of the members (they usually always do), and >I'll send that in a separate email. Please let me know if you have any >suggestions. I see from the messages, that this is a cPanel Mailman (2.1.9-cp1). I don't think this duplication is a cPanel issue per se (see below). Also … [View More]see <http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq06.011.htp>. There was a somewhat different cPanel issue I worked on a while back that caused duplication of images within an email as opposed to duplicate messages, and that cPanel bug was triggered by the addition of msg_footer to the message. See <http://forums.cpanel.net/showthread.php?t=61603> (requires registration) for my (unanswered) report of this, but I don't think that that is this issue. Thank you for including the two messages. That is very helpful. The MIME structure of the first message is multipart/mixed multipart/alternative text/plain text/html image/gif image/jpeg text/plain This structure is not really correct, but it may have been munged by Mailman's content filtering in some way. Given what this actually is with the gif and jpeg images referenced by the html via Content-ID:, I think the actual message structure should be multipart/mixed multipart/alternative text/plain multipart/related text/html image/gif image/jpeg text/plain I don't think this is related to the duplication however. The second message appears to be a newly created message based on the first message. While many of the headers of the first message are copied verbatim in the second message, and the content of most of the elemental parts is the same, several things stand out. The Message-ID: is different. The From: header has had the real name removed from the email address as you noted originally. The MIME boundary is different. Parts are added. The MIME structure is different. It is multipart/mixed text/plain text/html image/gif image/jpeg application/octet-stream text/plain text/plain The application/octet-stream part appears to be the msg_footer from the first message, then there is an added text/plain part with filename="GWAVADAT.TXT" and contents AdmID:71370CBC7758B07A9A4CF8C0F77AE198 followed by the new msg_footer. The message contains an X-Mailer: GWAVA Archive Mailer header. The Received: headers indicate it came back to the list via Received: from [199.227.27.194] (port=47532 helo=FSBMAIL.FIRSTSOUTHERNBANK.COM) by enzo.elinuxservers.com with esmtp (Exim 4.63) (envelope-from <KSmith-Bonilla(a)hialeahfl.gov>) id 1Hiwns-0008Aw-Ij for fisaalerts(a)fisanet.com; Tue, 01 May 2007 11:10:21 -0700 Received: from D9YTRC51 ([10.85.56.72]) by FSBMAIL.FIRSTSOUTHERNBANK.COM with ESMTP; Tue, 01 May 2007 14:09:57 -0400 GWAVA is GroupWise anti-virus, anti-spam, archiving, etc. Thus, I think what's happening is that one of the list members addresses goes to GroupWise at FIRSTSOUTHERNBANK.COM and this GroupWise is munging the message a bit and resending it back to the list where it is resent to the members. Why this only seems to happen with some list mail, I don't know. >It seems like there should be some setting that would prevent users from >receiving html formatted emails, which I think is what happening for the >first email. Let me know what you think, and thanks a million for your >help. There is no list member setting to prevent receiving HTML email. The list has content filtering options that can be used to remove HTML and images from all posts so no one receives any HTML. For example, if you set filter_content On and put multipart message/rfc822 text/plain in pass_mime_types, only text/plain parts will be passed through to the list. >Oh, one more question.. should I just reply to you on this, or the >entire list? Replying to the list or copying the list in a reply-all is normally the way to reply. The exceptions to this (this might have been one of them) are when the reply contains emails or whatever with personal or domain information that you don't want in a public archive and when the detailed information in the reply (such as copies of emails) is very large. In this case, your copy to the list was held I think because it exceeded the maximum post size. It may yet be approved unless you delete it first (instructions were in the 'held' notice you should have received). -- Mark Sapiro <msapiro(a)value.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan [View Less]

1 0

Re: [Mailman-Users] Counting messages that went to postfix queue
by D G Teed May 4, 2007

May 4, 2007

Hi, Thanks for the great replies and help. I found a perl script "findsender.pl" with google and it seems to be useful. I seem to have missing mail list members from my maillog, and one python error from mailman. Here is what I did to verify non-mailing... list_members maillist > /tmp/listnames for person in `cat /tmp/listnames`; do ./findsender.pl $person maillog | grep 'Found 0'; done {returns 28 email addresses} I didn't trust that findsender.pl actually parses postfix logs 100% so … [View More]I verified with plain grep for any mention of the user addresses in /var/log/maillog or /var/log/mailman/* I found one reference of the 28 which findsender.plmissed. This list has 1890 members, and 27 are not showing up at all in postfix logs. Unless postfix has a bug where some emails are not being logged, there seems to be a problem with mailman. I'm not looking for delivery - just any reference to the expected attempts to deliver. I do however see an error in /var/log/mailman which matches the time of this mass mailing: Apr 30 15:43:40 2007 (1877) Uncaught runner exception: No terminating boundary and no trailing empty line Apr 30 15:43:40 2007 (1877) Traceback (most recent call last): File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 99, in _oneloop msg, msgdata = self._switchboard.dequeue(filebase) File "/usr/lib/mailman/Mailman/Queue/Switchboard.py", line 151, in dequeue msg = email.message_from_string(msg, Message.Message) File "/usr/lib/mailman/pythonlib/email/__init__.py", line 52, in message_from_string return Parser(_class, strict=strict).parsestr(s) File "/usr/lib/mailman/pythonlib/email/Parser.py", line 75, in parsestr return self.parse(StringIO(text), headersonly=headersonly) File "/usr/lib/mailman/pythonlib/email/Parser.py", line 64, in parse self._parsebody(root, fp, firstbodyline) File "/usr/lib/mailman/pythonlib/email/Parser.py", line 240, in _parsebody msgobj = self.parsestr(part) File "/usr/lib/mailman/pythonlib/email/Parser.py", line 75, in parsestr return self.parse(StringIO(text), headersonly=headersonly) File "/usr/lib/mailman/pythonlib/email/Parser.py", line 64, in parse self._parsebody(root, fp, firstbodyline) File "/usr/lib/mailman/pythonlib/email/Parser.py", line 265, in _parsebody msg = self.parse(fp) File "/usr/lib/mailman/pythonlib/email/Parser.py", line 64, in parse self._parsebody(root, fp, firstbodyline) File "/usr/lib/mailman/pythonlib/email/Parser.py", line 206, in _parsebody raise Errors.BoundaryError( BoundaryError: No terminating boundary and no trailing empty line Apr 30 15:43:40 2007 (1877) Ignoring unparseable message: 1177958619.246433+b72521b62f4a6aa7dc74c339613c4ef7e9c3eb a7 There are no errors like it in our previous months of using mailman on other smaller departmental mailing lists. The mailman smtp log does not show the entry for the 1800 something messages which were delivered OK. My hunch, is that there is some bad data in our mailing list subscription which wasn't caught anywhere and has created this issue. We are given data from the Alumni Affairs department to inject into the mailing list. It may contain odd things. I've seen a '#' and single quote appear in the mail subscriptions. Regards, --Donald On 5/2/07, Brad Knowles <brad(a)shub-internet.org> wrote: > > On 5/1/07, D G Teed wrote: > > > I've tried finding the message queue IDs which were used > > and grep QueueID maillog | wc but this seems difficult > > to do since some reappear again in the logs, which were initially > > bounces. > > Mailman will give you the message-id, the list name, and the number > of recipients it was sent to. However, this won't help you for > digest recipients, since Mailman will have to generate a different > and totally unique message-id for that. In addition, it will use the > same message-id on outbound as was used on inbound, so unless you > have different copies of your MTA running on different ports and > sending their logs to different locations, you're going to get a mix > of both inbound and outbound activity in your log files. This will > make it more difficult to track down what happened when. > > Now, postfix will give you a one-to-many mapping of the message-id > and the queue-ids, and then you can track the status of the > individual queue-ids. > > > I also tried pflogsumm and looked at those stats. At first I thought > > the message sizes and multiples of that message size going to > > different domains would be a key, but it seems to be inaccurate. > > Speaking as the author of the "mmdsr" script, and as someone who has > hacked around with the pflogsumm script, I can tell you that this is > a process that is harder to do than most people would give credit for. > > Beyond that, I'm not sure I can give you any specific advice. I've > been looking at installing Splunk on the python.org machines so that > we can more easily track down what happened when to which mail > messages, but right now it doesn't appear to know anything about > Mailman log format. I don't mind teaching it about that kind of > stuff, but that does mean that we're that much further away from > having any kind of short-term solution for this problem. > > > I don't have any indications that anyone in our pilot list was lost, > > but we just need a method to account for the reliability. > > Mailman doesn't currently have much for you in this area. We know > that this is an area of weakness, and are planning on fixing this in > upcoming versions. However, we do not otherwise have a whole lot of > details as to what will be going on when. > > If you have specific requirements, I would urge you to join the > discussions on this topic in the Mailman Wiki pages. > > -- > Brad Knowles <brad(a)shub-internet.org>, Consultant & Author > LinkedIn Profile: <http://tinyurl.com/y8kpxu> > Slides from Invited Talks: <http://tinyurl.com/tj6q4> > [View Less]

3 12

Restoring missing messages due to wrong permissions in mbox archive file
by Ricardo Pereira May 4, 2007

May 4, 2007

Hi all, I've moved a list from one server to another a while ago but left the list archive .mbox file with the wrong permissions. After a week I noticed several permission denied errors in Mailman logs. I have corrected the permissions but now the messages sent during that period weren't added to the list archives. How can I add the missing messages to the archive? Thanks in advance for any help. Cheers, Ricardo

2 1

Attachments - archives and encoding problems
by John Papapanos May 4, 2007

May 4, 2007

Hi list, I have 2 different problems with attachments in archives in mailman lists. 1. The first problem has to do with attachment URLs in the web archive. The URL is split into two lines where the first line ends with a '='. If you concatenate the two lines and omit the '=' the URL works fine. I know this problem has been already discussed but I haven't found a working solution yet. The mail is delivered directly from my mail client to the MTA without any intermidiate machines. Is there a … [View More]

3 5

Opinions on domainkeys
by Ivan Van Laningham May 4, 2007

May 4, 2007

Hi All-- I just ran across this proposal from Yahoo: http://antispam.yahoo.com/domainkeys I was examining headers from some yahoogroup email for reasons having to do with non-delivery when I ran across the domainkey header. Has anyone on the list given any thought to it? Is it a Good Thing(tm)? Or yet another way for Yahoo to try to dominate the planet? There's a qmail patch available, which is what I'm using, and I wonder if there would be Mailman integration issues? I assume that … [View More]

3 2

Urgent Help! Need to repair my list
by Nathaniel Rahav May 3, 2007

May 3, 2007

Greetings Mailman Users. I did something supremely dumb last night in a late night attempt to be efficient and inadvertently corrupted one of my lists. I had 150 moderator requests on a particular list (all spam) and due to some strange unicode characters in one or two of the messages, I was receiving an error when trying to "delete all moderator requests marked defer". So i went into the mailman directory on the server and did the following: cd mailman/data rm -f heldmsg-news*.pck where '… [View More]news' is the name of my list. Now when I go to the pending moderator requests page I get the following error... can somebody please help me repair my list ? thanks : Bug in Mailman version 2.1.5 We're sorry, we hit a bug! If you would like to help us identify the problem, please email a copy of this page to the webmaster for this site with a description of what happened. Thanks! Traceback: Traceback (most recent call last): File "/usr/local/mailman/scripts/driver", line 87, in run_main main() File "/usr/local/mailman/Mailman/Cgi/admindb.py", line 233, in main num += show_helds_overview(mlist, form) File "/usr/local/mailman/Mailman/Cgi/admindb.py", line 483, in show_helds_overview mlist.HandleRequest(id, mm_cfg.DISCARD) File "/usr/local/mailman/Mailman/ListAdmin.py", line 159, in HandleRequest forward, addr) File "/usr/local/mailman/Mailman/ListAdmin.py", line 345, in __handlepost syslog('vette', note) File "/usr/local/mailman/Mailman/Logging/Syslog.py", line 40, in write self.write_ex(kind, msg, args, kws) File "/usr/local/mailman/Mailman/Logging/Syslog.py", line 58, in write_ex logf.write(msg + '\n') File "/usr/local/mailman/Mailman/Logging/StampedLogger.py", line 73, in write Logger.write(self, "%s %s" % (prefix, msg)) File "/usr/local/mailman/Mailman/Logging/Logger.py", line 91, in write f.write(msg) UnicodeEncodeError: 'ascii' codec can't encode character u'\x92' in position 157: ordinal not in range(128) ------------------------------------------------------------------------ Python information: Variable Value sys.version 2.3.3 (#1, May 7 2004, 10:31:40) [GCC 3.3.3 20040412 (Red Hat Linux 3.3.3-7)] sys.executable /usr/bin/python sys.prefix /usr sys.exec_prefix /usr sys.path /usr sys.platform linux2 ------------------------------------------------------------------------ Environment variables: Variable Value HTTP_COOKIE news+admin=280200000069cf463946732800000031616333636266363339393035316438313136333962343865626231346431306339616166633331 SERVER_SOFTWARE Apache/2.0.53 (Unix) PHP/4.3.10 SCRIPT_NAME /mailman/admindb SERVER_SIGNATURE Apache/2.0.53 (Unix) PHP/4.3.10 Server at www.busquelo.org Port 80 REQUEST_METHOD GET HTTP_KEEP_ALIVE 300 SERVER_PROTOCOL HTTP/1.1 QUERY_STRING HTTP_ACCEPT_CHARSET ISO-8859-1,utf-8;q=0.7,*;q=0.7 HTTP_USER_AGENT Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11 HTTP_CONNECTION keep-alive HTTP_REFERER http://www.busquelo.org/mailman/admin/news/members/add SERVER_NAME www.busquelo.org REMOTE_ADDR 96.224.0.108 PATH_TRANSLATED /home/httpd/busquelo.org/news SERVER_PORT 80 SERVER_ADDR 209.166.211.42 DOCUMENT_ROOT /home/httpd/busquelo.org PYTHONPATH /usr/local/mailman SCRIPT_FILENAME /usr/local/mailman/cgi-bin/admindb SERVER_ADMIN s3ma4(a)yahoo.com HTTP_HOST www.busquelo.org REQUEST_URI /mailman/admindb/news HTTP_ACCEPT application/x-shockwave-flash,text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5 GATEWAY_INTERFACE CGI/1.1 REMOTE_PORT 50871 REMOTE_HOST pool-96-224-0-108.nycmny.east.verizon.net HTTP_ACCEPT_ENCODING gzip,deflate PATH_INFO /news -- Nathaniel Rahav Busquelo Productions LLC 205 W 15th St, NYC 10011 Tel: 917 299 0115 Fax: 212 645 5687 nat(a)busquelo.org www.busquelo.org www.soulnado.net www.tropicofcancer.net [View Less]

2 1

Mailman and Qmail/Vpopmail
by Simon Schuh May 3, 2007

May 3, 2007

Hello, I'm trying to install Mailman and have some problems. If I try to send an email to the list(configuration), qmail cannot deliver the mail and I get a "Sorry, no mailbox here by that name." I looked in the logs and qmail actually tries to find the local mailman-testliste(a)lists.mydomain.tld, like I configured it in the virtualdomains. I think qmail doesn't check the mailman home which is /usr/local/mailman. And I don't really know how qmail could find it. I have the line "lists.mydomain.… [View More]

4 11

Re: [Mailman-Users] Counting messages that went to postfix queue
by D G Teed May 2, 2007

May 2, 2007

On 5/2/07, Brad Knowles <brad(a)shub-internet.org> wrote: > > On 5/2/07, D G Teed wrote: > > > I didn't trust that findsender.pl actually parses postfix logs 100% so > > I verified with plain grep for any mention of the user addresses in > > /var/log/maillog or > > /var/log/mailman/* I found one reference of the 28 which > > findsender.pl missed. > > This list has 1890 members, and 27 are not showing up at all in postfix > > … [View More]logs. > > Keep in mind that some of those users may have set themselves (or > been set) to "NOMAIL" status, or they may be digest subscribers. In > either of those cases, they would not be found in the list of normal > recipients. This is a pilot server. I subscribed all users to the list myself with no welcome message - only minutes before the message was delivered. It is a one way list. You have to look to make sure you know how many "normal" subscribers you > have. > > > Unless postfix has a bug where some emails are not being logged, there > > seems to be a problem with mailman. I'm not looking for delivery - > just > > any reference to the expected attempts to deliver. > > If you found a bug, I think it's much more likely that it exists > within Mailman or the Python libraries or Python itself than postfix. > Or you could have found a bug in syslog, where postfix sent the data > to be logged, but syslog didn't actually write it to the file. It seems like mailman is the most likely point of failure. There was a python error in the error log file for mailman. Unless we are taking about versions of python. I'm running 2.3.4 for that (Redhat EL 4). > There are no errors like it in our previous months of using mailman > > on other smaller departmental mailing lists. The mailman smtp log does > > not show the entry for the 1800 something messages which were delivered > OK. > > That's weird. You should definitely see Mailman smtp log entries for > the other messages which were delivered. Unless the python bomb out happened prior to logging the smtp info. > My hunch, is that there is some bad data in our mailing list subscription > > which wasn't caught anywhere and has created this issue. We are given > > data from the Alumni Affairs department to inject into the mailing > list. > > It may contain odd things. I've seen a '#' and single quote appear in > > the mail subscriptions. > > That's possible. I think you can use dumpdb to take a look at the > list of subscribers, to see if there's anything funky there. dumpdb shows the email case with the single quote wrapped with double quotes, unlike the regular ones. I've verifyed the list prior to import to mailman, with Mail::VRFY and only found 2 bogus format email addresses. One had the quote, and the other had a bad top level domain. Not 26 problems. However, given that you've not had problems before and are now having > problems, tells me that either this is a result of a new addition to > the list, or that maybe there was a problem with the way that > particular message was formatted. > > > Remind me again -- what version of Mailman are you using? I'm on 2.1.5. I have the patch to allow subscribers in one list to be added to posting ability in another list by simply adding the @listname to the allowed set. Hopefully that still works in 2.1.9. If you're > not already on 2.1.9, you might want to consider making that upgrade, > because I know that the more recent code has gotten more robust in > the face of weirdness on input, and continuing to operate as close to > normal as possible even though there may be some messages which don't > go through. I'll take a look. --Donald [View Less]

3 3

Retrieving list membership via email
by Drew Tenenholz May 2, 2007

May 2, 2007

Folks -- I'd just like a quick confirmation of Mailman (2.1.4, yikes!) behavior: A message sent to listname-request(a)example.com with a body of "who" should return the list members. (FAQ 3.62) However, my list has 'private_roster' set to 'List Admin Only', and when (from a list owner email address) I send "who admin_password", I get: - Results: You are not allowed to retrieve the list membership. Is this expected behavior? -- Drew Tenenholz

2 3