[Mailman-Users] Pipermail --> MHonArc error

[Richard Barrett]

Karl

I just noticed the posting that you made to mailman-users.

I think that what is triggering the exception is the way you are  
running arch.

When you run arch the first time with the --wipe option, the existing  
HTML archive content is deleted and the new HTML archive content is  
generated by MHonArc from the list's .mbox content, assuming you have  
set the list to use mhonarc as it archive page generator.

When you then run arch a second time without the the --wipe option  
you are telling MHonArc to generate HTML archive content from the  
same .mbox  with the same content as on the previous run with the -- 
wipe option. But MHonArc does not find any new messages to add to the  
HTML archive as it is being handed the same messages again. Normally,  
MHonArc "optimises out" "duplicate" messages (based on Message-id: I  
believe). I think that when it finds nothing to add to the HTML  
archive it closes the pipe connection back to the Mailman process  
prematurely, leading to the exception.

I will publish a revised MHonArc/Mailman integration patch to handle  
this condition but in the meantime you should be able avoid the  
problem by not running arch with the same input .mbox as on a  
previous run. No loss, as the second run of arch serves no useful  
purpose.

Regards

Richard

On Tue May 1 21:56:17 CEST 2007 you posted the following to the  
mailman-users list:

   I am trying to convert a list from the Pipermail archiver
to MhonArc.

I can run /bin/arch --wipe listname successfully.

I get this error when generating the MhonArc archive with

/bin/arch listname

Pickling archive state into
/data/mailman/archives/private/listname/pipermail.pck
Traceback (most recent call last):
    File "./arch", line 202, in ?
      main()
    File "./arch", line 190, in main
      archiver.processUnixMailbox(fp, start, end)
    File "/data/mailman/Mailman/Archiver/pipermail.py",
line 576, in processUnixMailbox
      self.mhonarcProcessUnixMailbox(input, start, end)
    File "/data/mailman/Mailman/Archiver/pipermail.py",
line 706, in mhonarcProcessUnixMailbox
      status = mhonarch_process.close()
IOError: [Errno 32] Broken pipe


If I switch back to Pipermail it will run successfully.

It looks too that I miss  March and April 2007 archives
when trying to convert to MHonArc, but Pipermail generates
them.  Would this point to an problem in the .mbox file?

--Karl