[Mailman-Developers] VERPing: ouch!

[J C Lawrence]

On Tue, 13 Jul 2004 17:33:43 +0200 
fil  <fil at rezo.net> wrote:

>> I thought v2 chunked the queue processing...  Hurm, if it doesn't it
>> should and that's an easy enough fix.

>> From what I read we're in SMTPDirect.py :

>         def process(mlist, msg, msgdata):

> this function does process all recipients (in chunks if not VERP)
> consecutively, before exiting. We spent 5 hours in its main loop for
> that one message.

The painful bit is in Runner.py which appears to linearly process each
message queue.  The next optimisation would have queue runners forking
off every N minutes, with each one opportunistically handling messages
in the queue.

-- 
J C Lawrence
---------(*)                Satan, oscillate my metallic sonatas.
claw at kanga.nu               He lived as a devil, eh?
http://www.kanga.nu/~claw/  Evil is a name of a foeman, as I live.