Re: [Mailman-Developers] qrunner -- problem with huge mail messages
On Mon, 25 Jun 2001 15:35:26 +0200 Dirko van Schalkwyk <dvschalk@ing.sun.ac.za> wrote:
I set Mailman up, created a test list and played with it for a while. Then I send it a big "whopper" 5MB e-mail. I watched the logs and saw postfix running the wrapper. The cron started qrunner and all hell broke lose (over dramatizing a bit). It started running at 100% CPU, where it stayed until I killed it. The message was queued in $prefix/qfiles, it and its little .db file. I had to remove those as well as the locks in $prefix/locks before I could successfully use the list again.
So I thought, "well maybe the pipermail thingy can't handle the huge mime thingies I'm sending it". So I send a smaller attachment <150kb. Things went fine (except for the ugly html page:) ) Send it a 1MB attachment. qrunner started spinning it's wheels again. Had to seek and destroy again.
Having run lists which had posts with attachments in the 100Meg+ range (some people use mail as a file transfer protocol), and had them work (admittedly more than a year ago) I'm fairly certain that this is not a Mailman problem. Its likely to be an MTA problem or a system problem (eg spool space).
Try sending such a post with such a large attachment to yourself through that same mail server. Now try the same thing, but with say 50 copies of the same message being sent to yourself in very rapid succession. What your system closely. What happens?
-- J C Lawrence claw@kanga.nu ---------(*) http://www.kanga.nu/~claw/ The pressure to survive and rhetoric may make strange bedfellows
J C Lawrence wrote:
again. Had to seek and destroy again.
Having run lists which had posts with attachments in the 100Meg+ range (some people use mail as a file transfer protocol), and had them work (admittedly more than a year ago) I'm fairly certain that this is not a Mailman problem. Its likely to be an MTA problem or a system problem (eg spool space).
Try sending such a post with such a large attachment to yourself through that same mail server. Now try the same thing, but with say 50 copies of the same message being sent to yourself in very rapid succession. What your system closely. What happens?
My MTA (postfix) works fine.
I humbly apologize. It seems that I was to hasty in my definition of qrunner "spinning" its wheels.
I made some time measurements :
1 236 202 bytes took 2 minutes to process 4 053 188 bytes took 19 minutes to process
I this normal? Am I missing some option that I can turn of. What is qrunner doing all this time?
Greets
Dirko
On Wed, Jun 27, 2001 at 04:42:56PM +0200, Dirko van Schalkwyk wrote:
I humbly apologize. It seems that I was to hasty in my definition of qrunner "spinning" its wheels.
I made some time measurements :
1 236 202 bytes took 2 minutes to process 4 053 188 bytes took 19 minutes to process
I this normal? Am I missing some option that I can turn of. What is qrunner doing all this time?
I might guess "swapping", if I knew how much RAM you had. :-)
Cheers, -- jra
Jay R. Ashworth jra@baylink.com Member of the Technical Staff Baylink The Suncoast Freenet The Things I Think Tampa Bay, Florida http://baylink.pitas.com +1 727 804 5015
OS X: Because making Unix user-friendly was easier than debugging Windows
"Jay R. Ashworth" wrote:
I this normal? Am I missing some option that I can turn of. What is qrunner doing all this time?
I might guess "swapping", if I knew how much RAM you had. :-)
Got plenty :*)
I would appreciate it if anyone can do similar time tests?
Greets
Dirko
cat /proc/cpuinfo
processor : 0 vendor_id : AuthenticAMD cpu family : 6 model : 3 model name : AMD Athlon(tm) Processor stepping : 0 cpu MHz : 600.046 cache size : 64 KB bogomips : 1196.03
cat /proc/meminfo
total: used: free: shared: buffers: cached:
Mem: 402161664 233144320 169017344 0 123678720 43839488 Swap: 262103040 0 262103040 MemTotal: 392736 kB MemFree: 165056 kB MemShared: 0 kB Buffers: 120780 kB Cached: 42812 kB BigTotal: 0 kB BigFree: 0 kB SwapTotal: 255960 kB SwapFree: 255960 kB
participants (3)
-
Dirko van Schalkwyk -
J C Lawrence -
Jay R. Ashworth