[Mailman-Users] Memory usage

[Grigory Batalov]

On Tue, 4 Dec 2007 13:19:16 -0600, Brad Knowles wrote:

> >   It was 25Mb maximum in my previous letter, now it is 36Mb:
> >
> >  $ top
> >    PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> >  17660 mailman   15   0  101M  36M 2668 S  0.0  1.8   0:41.33 qrunner
> >  32356 mailman   15   0  100M  35M 2668 S  0.0  1.7   0:38.30 qrunner
> >  17584 mailman   15   0  100M  35M 2668 S  0.0  1.7   0:40.04 qrunner
> >  32739 mailman   18   0 99.7M  34M 2660 S  0.0  1.7   0:33.94 qrunner
> >   3182 mailman   15   0 99.5M  34M 2668 S  0.0  1.7   0:39.10 qrunner
> >  ....
> >
> >   Some of them took up to 200Mb (!) before I had to restart them.
> >   All this looks like slow and fast memory leak.
> 
> That's not so different from what we've got on python.org (see 
> <http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.015.htp>), 
> and the RSS for our qrunners is between 11MB and 41MB, depending on 
> the specific runner.  Note that neither yours nor ours are sucking up 
> any CPU time, so they're primed for being paged or swapped out if you 
> do run into any memory pressure.  Also note that all that Linux stats 
> quoted on 
> <http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq04.056.htp> 
> are from the python.org machines.
> 
> I'm not a Linux performance tuning expert, but I'm not seeing any 
> real problems in what you've shown us so far.  If you are seeing 
> problems, then you might want to consult a Linux performance tuning 
> expert.

  The problem is that some qrunners quickly eat memory. Most of them
  use 20-37Mb after 13 hours of running. But today several qrunners
  6 times took above 200Mb! Fortunately now I have Monit that checks
  memory usage, and kills such runners.

  I wrote previous letter after server failure when 2 greedy qrunners
  took 249 and 235 Mb. In that moment even crond couldn't fork and
  mail delivery was aborted.

  After that I have increased memory limit to 2Gb and started Monit
  daemon to prevent such failure.

-- 
 Grigory Batalov,
 ALT Linux Team
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: not available
Url : http://mail.python.org/pipermail/mailman-users/attachments/20071205/cf371ad1/attachment.pgp