Hi all
I've mailman 2.1.13 and postfix configured to use a reg-exp with mappings between virtual alias domain recipient addresses and local recipient addresses with the "classical": # mandatory /^(postmaster|root|abuse)@lists\.mydomain\.org$/ $1@mydomain.net # aliases /^(.+)-(subscribe|on)@(lists\.mydomain\.org)$/ $1-join@$3 /^(.+)-(unsubscribe|off)@(lists\.mydomain\.org)$/ $1-leave@$3 # commands /^(.+)-(post|admin|request|owner|join|leave|confirm|bounces)@(lists\.)?mydomain\.org$/ mailman_$2+$1 # lists (command -post) /^([-a-zA-Z0-9_]+)@lists\.mydomain\.org$/ mailman_post+$1
This server has been running since a few months. New mailing lists have been added recently and it happens that emails sent to these lists are accepted by postfix, transferred to mailman ("delivered to command: /usr/local/mailman/mail/mailman post $EXTENSION"), they are archived (they appear on the web-based mailman's archive) but then nothing happen. I don't find any errors on neither the postfix nor the mailman logs.
I did try to send an email on a older mailing list and I got the same problem: postfix accepts the message, gives it to mailman, email appears on the web-based archive, but then it's not sent to the members of the mailing lists.
I'm quite baffled by this problem and would appreciate any pointer.
Kind regards,
Gaël
Gaël Lams wrote:
This server has been running since a few months. New mailing lists have been added recently and it happens that emails sent to these lists are accepted by postfix, transferred to mailman ("delivered to command: /usr/local/mailman/mail/mailman post $EXTENSION"), they are archived (they appear on the web-based mailman's archive) but then nothing happen. I don't find any errors on neither the postfix nor the mailman logs.
I did try to send an email on a older mailing list and I got the same problem: postfix accepts the message, gives it to mailman, email appears on the web-based archive, but then it's not sent to the members of the mailing lists.
I'm quite baffled by this problem and would appreciate any pointer.
Are there entries for the messages in Mailman's 'smtp' and 'post' logs? Presumably, there are not entries in Mailman's 'smtp-failure' log since you say "I don't find any errors on neither the postfix nor the mailman logs"
There are a few possibilities. The first that comes to mind is OutgoingRunner is not running and the messages are still queued in Mailman's out/ queue (this could be /usr/local/mailman/qfiles/out/, /var/lib/mailman/qfiles/out/. /var/spool/mailman/out/ or elsewhere depending on how Mailman was installed).
The basic FAQ for troubleshooting this issue is at <http://wiki.list.org/x/A4E9>. For your specific symptoms, see item 13.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Hi Mark,
For the answer.
Are there entries for the messages in Mailman's 'smtp' and 'post' logs?
Presumably, there are not entries in Mailman's 'smtp-failure' log since you say "I don't find any errors on neither the postfix nor the mailman logs"
There are a few possibilities. The first that comes to mind is OutgoingRunner is not running and the messages are still queued in Mailman's out/ queue (this could be /usr/local/mailman/qfiles/out/, /var/lib/mailman/qfiles/out/. /var/spool/mailman/out/ or elsewhere depending on how Mailman was installed).
Actually the emails finally went out, it just takes them a few hours (probably more last week) to be processed. Regarding mailman's queue, I still have to read the documentation to understand how it works because I remember checking this queue but didn't see a lot of files. Is it that, if I send an email to a list with 11000 members, only one file is created there?
As it seems now to be a tuning problem, I started having a look at the mailman's wiki page on performance tuning. Reference is made there to QRUNNER_LOCK_LIFETIME, QRUNNER_PROCESS_LIFETIME, and QRUNNER_MAX_MESSAGES. I did a grep on my mailman's installation but did not find them (I've mailman 2.1.13). Knowing that I host +/- 50 mailing lists, most of them small (3'/40 users) but a few with between 2000 and 11700 users, I'm trying to understand what I can do to improve the tuning.
I will also have a look later at postfix's configuration (I will anyway have to do something there because both yahoo and hotmail are slowing us, temporarily refusing the connection) but the fact is that these emails I was waiting for were not in postfix's queue.
Kind regards,
Gaël
On 4/8/2010 12:15 AM, Gaël Lams wrote:
Actually the emails finally went out, it just takes them a few hours (probably more last week) to be processed. Regarding mailman's queue, I still have to read the documentation to understand how it works because I remember checking this queue but didn't see a lot of files. Is it that, if I send an email to a list with 11000 members, only one file is created there?
Yes. There is only one file per post in the out/ queue regardless of the number of recipients. You can tell when the queue is seriously backlogged from the 'smtp' log. A "normal" log looks like
Apr 08 07:47:05 2010 (20026) <msg-id> smtp to list for 209 recips, completed in 4.658 seconds Apr 08 08:00:03 2010 (20026) <msg-id> smtp to list for 1 recips, completed in 0.020 seconds Apr 08 08:00:09 2010 (20026) <msg-id> smtp to list for 1 recips, completed in 0.018 seconds Apr 08 08:30:50 2010 (20026) <msg-id> smtp to list for 206 recips, completed in 4.661 seconds Apr 08 09:45:13 2010 (20026) <msg-id> smtp to list for 206 recips, completed in 4.107 seconds Apr 08 11:06:37 2010 (20026) <msg-id> smtp to list for 209 recips, completed in 4.489 seconds Apr 08 11:09:55 2010 (20026) <msg-id> smtp to list for 209 recips, completed in 4.009 seconds
Note that we are delivering on the order of 45 to 50 recipients per second (with full Mailman VERP so a separate SMTP transaction per recipient) and the queue is not backlogged.
With a backlogged queue, each entry has a timestamp which is equal to the previous entry's timestamp plus this entry's processing time so there's no idle time between entries.
As it seems now to be a tuning problem, I started having a look at the mailman's wiki page on performance tuning. Reference is made there to QRUNNER_LOCK_LIFETIME, QRUNNER_PROCESS_LIFETIME, and QRUNNER_MAX_MESSAGES. I did a grep on my mailman's installation but did not find them (I've mailman 2.1.13).
Those were Mailman 2.0.x settings.
Knowing that I host +/- 50 mailing lists, most of them small (3'/40 users) but a few with between 2000 and 11700 users, I'm trying to understand what I can do to improve the tuning.
I will also have a look later at postfix's configuration (I will anyway have to do something there because both yahoo and hotmail are slowing us, temporarily refusing the connection) but the fact is that these emails I was waiting for were not in postfix's queue.
The Postfix tuning FAQ at <http://wiki.list.org/x/rIA9> may help.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
participants (2)
-
Gaël Lams -
Mark Sapiro