[Mailman-Developers] [ mailman-Feature Requests-228127 ] Improve Pipermail's memory footprint

[noreply@sourceforge.net]

Feature Requests item #228127, was opened at 2001-01-08 22:07
You can respond by visiting: 
http://sourceforge.net/tracker/?func=detail&atid=350103&aid=228127&group_id=103

Category: Pipermail
Group: None
>Status: Closed
Resolution: Later
Priority: 3
Submitted By: Bob Tanner (tanner)
Assigned to: Nobody/Anonymous (nobody)
>Summary: Improve Pipermail's memory footprint

Initial Comment:
I run several very active mailing lists. And the mbox files are starting to approach critical size. With 2.4 coming out and reiserfs I no longer have to working about the single file size limitation.

BUT pipermail is terrible on handling mbox files that are GB in size. 

My feature request to to re-write pipermail and store the files in Maildir format.

Get pipermail so that it does not have to read the entire mbox (or Maildir) info in order to rebuild the archives.

I have a dual P3 550 zeon box with 1Gb of memory and I am constantly running out of core and VM because pipermail consumes resources like a wild thing.

I also have difficulty backing up the "archives" directory. By the time BRU, tar, amanda, etc... dump the GB mbox file to tape, I have received several more messages and the check of the file on disk against the file on tape never matches.

Maildir format would help solve this problem as well.


----------------------------------------------------------------------

>Comment By: Barry Warsaw (bwarsaw)
Date: 2002-05-03 01:48

Message:
Logged In: YES 
user_id=12800

I've changed the subject header to more accurately reflect
this RFE.

MM2.1 is a leeetle bit better here in that you can
regenerate the archive in more bite-sized chunks.  It still
sucks, but it should be good enough until someone steps up
for a complete MM rewrite.

As for the backup problem, in MM2.1 you could shut down the
archive queue runner for the duration of the backup, and
then turn it back on and have it process the queued messages
when the backup is finished.

----------------------------------------------------------------------

Comment By: Thomas Wouters (twouters)
Date: 2001-03-02 03:59

Message:
Logged In: YES 
user_id=34209

Rewriting the archiver has been a long standing feature
request, yes :) The maildir suggestion hadn't occured to me
yet, but does make sense.

In the mean time, you can use an external archiver, like (I
believe) MHonarc and others. We should probably get someone
who's done that to write up a quick HOWTO for it.


----------------------------------------------------------------------

You can respond by visiting: 
http://sourceforge.net/tracker/?func=detail&atid=350103&aid=228127&group_id=103