[Mailman-Developers] Pipermail, large archives and performance

[Marc MERLIN]

On Thu, Jan 25, 2001 at 02:20:06PM -0600, Bob Tanner wrote:
> I am wondering what that road map is for mailman.
> 
> Meaning what are the new features slated for the future. What enhancements to
> current features are planned.
> 
> I posted a feature enchancement to SF:
> 
> http://sourceforge.net/bugs/?func=detailbug&bug_id=128127&group_id=103
> 
> And pipermail  is really  causing problems. I  have an  mbox file  that is
> 1.92Gb in size and it takes almost 14 hours to process the qfiles.
> 
> I believe this is because qrunner(?)  has a difficult time processing such
> large files to generate the archives. Am I way off base here?

You are absolutely correct, I did some testing with sending 1000 messages to
a list,  and time went from  4mn until I  received the last message  to more
than one hour when I had HTML archiving enabled.

For sourceforge, I felt we couldn't  afford the slowdown and turned off HTML
archiving. I've left the text archiving enabled  as it shouldn't be the part
that's the slowest.

Ideally, it'd be nice if we could  update the HTML archive off line, once an
hour or so, but apparently that's not possible (I didn't get any answer back
to my enquiring Email)

Marc
-- 
Microsoft is to operating systems & security ....
                                      .... what McDonalds is to gourmet cooking
  
Home page: http://marc.merlins.org/   |   Finger marc_f@merlins.org for PGP key