[Mailman-Users] mailman simply *stops* sending messages

[Rob Scott]

Thanks a bunch for your help Mark, though I'm afraid I'm not actually getting any further ahead with this..  I am admittedly a mailman/python newb but I find it hilarious and somewhat pathetic that python (or is it actually mailman?) chokes and dies a horrible death on one little accented e.  I'm just not getting a clear picture of which file(s) I would need to remove the offending character(s) from, or what the correct procedure to do so would be.. can I simply grep the digest(s) / qfiles for that accented e and them strip them out with a text editor?   Any further insights would be much appreciated!

 When running unshunt I now get the following error for each file in /qfiles/shunt  (22 of them)  

May 20 14:07:31 2005 (4364) SHUNTING: 1116552066.5283909+9c37617d12e1db5cef5b1124ccb0162679814821
May 20 14:07:31 2005 (4364) Uncaught runner exception: 'ascii' codec can't decode byte 0xe9 in position 2: ordinal not in range(128)
May 20 14:07:31 2005 (4364) Traceback (most recent call last):
  File "/home/mailman/mailman/Mailman/Queue/Runner.py", line 111, in _oneloop
    self._onefile(msg, msgdata)
  File "/home/mailman/mailman/Mailman/Queue/Runner.py", line 167, in _onefile
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "/home/mailman/mailman/Mailman/Queue/IncomingRunner.py", line 130, in _dispose
    more = self._dopipeline(mlist, msg, msgdata, pipeline)
  File "/home/mailman/mailman/Mailman/Queue/IncomingRunner.py", line 153, in _dopipeline
    sys.modules[modname].process(mlist, msg, msgdata)
  File "/home/mailman/mailman/Mailman/Handlers/ToDigest.py", line 91, in process
    send_digests(mlist, mboxfp)
  File "/home/mailman/mailman/Mailman/Handlers/ToDigest.py", line 132, in send_digests
    send_i18n_digests(mlist, mboxfp)
  File "/home/mailman/mailman/Mailman/Handlers/ToDigest.py", line 306, in send_i18n_digests
    msg = scrubber(mlist, msg)
  File "/home/mailman/mailman/Mailman/Handlers/Scrubber.py", line 265, in process
    url = save_attachment(mlist, part, dir)
  File "/home/mailman/mailman/Mailman/Handlers/Scrubber.py", line 359, in save_attachment
    fnext = os.path.splitext(msg.get_filename(''))[1]
  File "/home/mailman/mailman/pythonlib/email/Message.py", line 731, in get_filename
    return unicode(newvalue[2], newvalue[0] or 'us-ascii')
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe9 in position 2: ordinal not in range(128)

May 20 14:07:31 2005 (4364) SHUNTING: 1116605053.782793+2fc4939e7a782d2a482757c725756d45401bd83f

[...]

-----
----------------------------------------------------------------------------------------------------------------
Below is the message being replied to:

>>  Mark Sapiro wrote:

>>  >Rob Scott wrote:
>>  >>
>>  >>After running 'unshunt' I was able to coax the following error from
>>  mailman.. which sheds some light on the problem at least, though I am
>>  still quite confused as to what the actual problem could be.  The lists
>>  in question are all in french if that makes any difference, and many
>>  french characters are in the messages, though that's never been a problem
>>  before. 
>>  >>
>>  >>
>>  >>Traceback (most recent call last):
>>  >>File "/home/mailman/mailman/cron/senddigests", line 94, in ?
>>  >>main()
>>  >>File "/home/mailman/mailman/cron/senddigests", line 86, in main
>>  >>mlist.send_digest_now()
>>  >>File "/home/mailman/mailman/Mailman/Digester.py", line 60, in
>>  send_digest_now
>>  >>ToDigest.send_digests(self, mboxfp)
>>  >>File "/home/mailman/mailman/Mailman/Handlers/ToDigest.py", line 132, in
>>  send_digests
>>  >>send_i18n_digests(mlist, mboxfp)
>>  >>File "/home/mailman/mailman/Mailman/Handlers/ToDigest.py", line 306, in
>>  send_i18n_digests
>>  >>msg = scrubber(mlist, msg)
>>  >>File "/home/mailman/mailman/Mailman/Handlers/Scrubber.py", line 265, in
>>  process
>>  >>url = save_attachment(mlist, part, dir)
>>  >>File "/home/mailman/mailman/Mailman/Handlers/Scrubber.py", line 359, in
>>  save_attachment
>>  >>fnext = os.path.splitext(msg.get_filename(''))[1]
>>  >>File "/home/mailman/mailman/pythonlib/email/Message.py", line 731, in
>>  get_filename
>>  >>return unicode(newvalue[2], newvalue[0] or 'us-ascii')
>>  >>UnicodeDecodeError: 'ascii' codec can't decode byte 0xe9 in position 2:
>>  ordinal not in range(128)
>>  >>
>>  >
>>  >It looks like the message has an attached file with a lowercase e-acute
>>  >in the filename. You might be able to use bin/show_qfiles to find the
>>  >offending message.

>>  Once again, the finger is faster than the eye ...

>>  Actually it's senddigests that gets the error so the offending message
>>  is probably in lists/<listname>/digest.mbox.

>>  --
>>  Mark Sapiro <msapiro at value.net>       The highway is for gamblers,
>>  San Francisco Bay Area, California    better use your sense - B. Dylan




---------------------------------------------------------------------------------------------------------------------
This electronic message transmission, including any attached files, contains information which may be confidential and/or privileged. The information is intended to be for the sole use of the individual or entity named above. If you are not the intended recipient, be aware that any review, disclosure, copying, distribution or use of the contents of this information is prohibited. This message is not to be forwarded for any reason without prior consent of the sender. If you have received this electronic transmission in error, please notify the sender immediately by telephone (250) 380-0377 or by a "reply to sender only" message and destroy all electronic and hard copies of the communication, including attachments, without reading or saving in any manner.