[Mailman-Developers] Re: Huge qrunner process

[sigma@pair.com]

Following up on my own message...

qrunner isn't the only culprit.  senddigests is worse, since it doesn't stop
itself from running indefinitely.

There is a definite memory leak or inefficiency somewhere.  Just the following
fragment of code, edited from senddigests, is enough to send the memory usage
sky-high:

def main():
    for listname in Utils.list_names():
        mlist = MailList.MailList(listname, lock=0)
        del mlist

The "del mlist" doesn't help.

I've noticed that one pathological list has a 12MB config.db file.  If
loading config.db is inefficient by a factor of eleven, then that could
explain the swelling to 135MB.  With that list removed, the memory usage
peak is just 89MB.

Is there a way to tell if Python is deleting the MailList object when mlist
gets reassigned, so I can find out if there is a leak each time a list is
loaded?  Otherwise it's just inefficient memory usage in proportion to the
size of config.db

Thanks,
Kevin

----- Forwarded message from sigma@pair.com -----

>From mailman-developers-admin@python.org Thu Dec 07 12:00:16 2000
Delivered-To: sigma@smx.pair.com
Delivered-To: sigma@pair.com
Delivered-To: mailman-developers@new.python.org
Delivered-To: mailman-developers@python.org
Message-ID: <20001207115954.1364.qmail@smx.pair.com>
From: sigma@pair.com
To: mailman-developers@python.org
X-Mailer: ELM [version 2.4ME+ PL40 (25)]
Subject: [Mailman-Developers] Huge qrunner process
Sender: mailman-developers-admin@python.org
Errors-To: mailman-developers-admin@python.org
X-BeenThere: mailman-developers@python.org
X-Mailman-Version: 2.0
Precedence: bulk
List-Help: <mailto:mailman-developers-request@python.org?subject=help>
List-Post: <mailto:mailman-developers@python.org>
List-Subscribe: <http://www.python.org/mailman/listinfo/mailman-developers>,
	<mailto:mailman-developers-request@python.org?subject=subscribe>
List-Id: Mailman mailing list developers <mailman-developers.python.org>
List-Unsubscribe: <http://www.python.org/mailman/listinfo/mailman-developers>,
	<mailto:mailman-developers-request@python.org?subject=unsubscribe>
List-Archive: <http://www.python.org/pipermail/mailman-developers/>
Date: Thu, 7 Dec 2000 06:59:54 -0500 (EST)


Can anyone enlighten me about why the qrunner process might need a
tremendous amount of memory?  Running Mailman 2.0 on a FreeBSD 4.1.1-STABLE
server with Python 2.0.  There are about 1500 lists, but the qfiles
directory only has 32 files in it.  Nonetheless, each minute when qrunner
runs, it looks like this in top:

59606 mailman   -2  20   135M 74456K getblk   0:01  8.93%  3.52% python

135 MB?  It seems excessive.  Any insight would be appreciated :)

Thanks,
Kevin


_______________________________________________
Mailman-Developers mailing list
Mailman-Developers@python.org
http://www.python.org/mailman/listinfo/mailman-developers

----- End of forwarded message from sigma@pair.com -----