[Mailman-Developers] critical bug in Digest

[Heiko Rommel]

Hi,

we experienced some problems with one of our major mailing lists which had the Digest turned on.

I finally found out that one of our users had misconfigured his MUA and send messages with
Content-Type: text/plain; charset*=utf-8342200235''utf-8%E2%80%9D
where 
Content-Type: text/plain; charset=utf-8
would be correct.

This caused Mailman 2.1.14 to

a) throw an exception:

Apr 30 13:39:51 2004 (13945) Traceback (most recent call last):
  File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 110, in _oneloop
    self._onefile(msg, msgdata)
  File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 160, in _onefile
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "/usr/lib/mailman/Mailman/Queue/IncomingRunner.py", line 130, in _dispose
    more = self._dopipeline(mlist, msg, msgdata, pipeline)
  File "/usr/lib/mailman/Mailman/Queue/IncomingRunner.py", line 153, in _dopipeline
    sys.modules[modname].process(mlist, msg, msgdata)
  File "/usr/lib/mailman/Mailman/Handlers/ToDigest.py", line 91, in process
    send_digests(mlist, mboxfp)
  File "/usr/lib/mailman/Mailman/Handlers/ToDigest.py", line 132, in send_digests
    send_i18n_digests(mlist, mboxfp)
  File "/usr/lib/mailman/Mailman/Handlers/ToDigest.py", line 306, in send_i18n_digests
    msg = scrubber(mlist, msg)
  File "/usr/lib/mailman/Mailman/Handlers/Scrubber.py", line 182, in process
    charset = part.get_content_charset(lcset)
  File "/usr/lib/mailman/pythonlib/email/Message.py", line 800, in get_content_charset
    charset = unicode(charset[2], pcharset).encode('us-ascii')
LookupError: unknown encoding


b) store the message in the digest.mbox, but shunt the message (so it was not delivered).

I tried the latest patches to Scrubber but that didn't help.

To my opinion, this is a very critial error since a single user can shut down the whole mailing list effectively.
My only option as an emergency action was to switch off the Digest option and
have a look into the very large digest.mbox :(

-- 
Heiko Rommel                             rommel at suse.de
SUSE Linux AG,     Maxfeldstr. 5,     D-90409 Nuernberg
T: +49 (0) 911 74053 0        F:  +49 (0) 911 741 77 55