[ mailman-Bugs-789897 ] Shunt clogged up - RFC2231 unicode problem?

SourceForge.net noreply at sourceforge.net
Wed Jan 14 21:08:53 EST 2004


Bugs item #789897, was opened at 2003-08-16 22:31
Message generated for change (Comment added) made by joaofraga
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=100103&aid=789897&group_id=103

Category: mail delivery
Group: 2.1 (stable)
Status: Closed
Resolution: Fixed
Priority: 5
Submitted By: Colin Allen (ventoux)
Assigned to: Nobody/Anonymous (nobody)
Summary: Shunt clogged up - RFC2231 unicode problem?

Initial Comment:
Dozens of messages are backed up in my shunt directory 
with the message "TypeError: unicode() argument 2 must 
be string, not None" (full traceback example below).

This seems very similar to a problem fixed by ber with 2.0.x 
earlier this year but I'm running 2.1.2 (on FreeBSD).  I tried 
my best to apply a similar solution to Message.py but 
apparently I don't know enough about python to make it 
work.

Here's a typical Traceback --


Aug 16 16:08:25 2003 (46338) Uncaught runner 
exception: unicode() argument 2 must be string, not None
Aug 16 16:08:25 2003 (46338) Traceback (most recent 
call last):
  File "/usr/local/mailman/Mailman/Queue/Runner.py", line 
105, in _oneloop
    self._onefile(msg, msgdata)
  File "/usr/local/mailman/Mailman/Queue/Runner.py", line 
155, in _onefile
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "/usr/local/mailman/Mailman/Queue/
IncomingRunner.py", line 130, in _dispose
    more = self._dopipeline(mlist, msg, msgdata, pipeline)
  File "/usr/local/mailman/Mailman/Queue/
IncomingRunner.py", line 153, in _dopipeline
    sys.modules[modname].process(mlist, msg, msgdata)
  File "/usr/local/mailman/Mailman/Handlers/ToDigest.py", 
line 89, in process
    send_digests(mlist, mboxfp)
  File "/usr/local/mailman/Mailman/Handlers/ToDigest.py", 
line 130, in send_digests
    send_i18n_digests(mlist, mboxfp)
  File "/usr/local/mailman/Mailman/Handlers/ToDigest.py", 
line 303, in send_i18n_digests
    msg = scrubber(mlist, msg)
  File "/usr/local/mailman/Mailman/Handlers/Scrubber.py", 
line 257, in process
    url = save_attachment(mlist, part, dir)
  File "/usr/local/mailman/Mailman/Handlers/Scrubber.py", 
line 348, in save_attachment
    fnext = os.path.splitext(msg.get_filename(''))[1]
  File "/usr/local/mailman/pythonlib/email/Message.py", line 
707, in get_filename
    return unicode(newvalue[2], newvalue[0])
TypeError: unicode() argument 2 must be string, not None



----------------------------------------------------------------------

Comment By: Joao Fraga (joaofraga)
Date: 2004-01-15 02:08

Message:
Logged In: YES 
user_id=594460

I am experiencing this bug with Mailman 2.1.4 and Python
2.3.3.  
Here goes a relevant part of the error log:

Jan 15 02:02:58 2004 (25537) Uncaught runner exception:
unicode() argument 2 must be string, not None
Jan 15 02:02:58 2004 (25537) Traceback (most recent call last):
  File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 105,
in _oneloop
    self._onefile(msg, msgdata)
  File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 155,
in _onefile
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "/usr/lib/mailman/Mailman/Queue/IncomingRunner.py",
line 130, in _dispose
    more = self._dopipeline(mlist, msg, msgdata, pipeline)
  File "/usr/lib/mailman/Mailman/Queue/IncomingRunner.py",
line 153, in _dopipeline
    sys.modules[modname].process(mlist, msg, msgdata)
  File "/usr/lib/mailman/Mailman/Handlers/ToDigest.py", line
89, in process
    send_digests(mlist, mboxfp)
  File "/usr/lib/mailman/Mailman/Handlers/ToDigest.py", line
130, in send_digests
    send_i18n_digests(mlist, mboxfp)
  File "/usr/lib/mailman/Mailman/Handlers/ToDigest.py", line
303, in send_i18n_digests
    msg = scrubber(mlist, msg)
  File "/usr/lib/mailman/Mailman/Handlers/Scrubber.py", line
257, in process
    url = save_attachment(mlist, part, dir)
  File "/usr/lib/mailman/Mailman/Handlers/Scrubber.py", line
348, in save_attachment
    fnext = os.path.splitext(msg.get_filename(''))[1]
  File "/usr/lib/mailman/pythonlib/email/Message.py", line
707, in get_filename
    return unicode(newvalue[2], newvalue[0])
TypeError: unicode() argument 2 must be string, not None

Jan 15 02:02:58 2004 (25537) SHUNTING:
1074132178.1086111+ae4e7452c810775c6904c8a4e8c71431dbc4944d


----------------------------------------------------------------------

Comment By: Barry A. Warsaw (bwarsaw)
Date: 2003-08-27 15:19

Message:
Logged In: YES 
user_id=12800

Please wait until 2.1.3 is released (whenever I can crawl
out of SoBig consequences).  If the bug persists, please
submit a new one then.

----------------------------------------------------------------------

Comment By: jared mauch (jaredmauch)
Date: 2003-08-27 06:23

Message:
Logged In: YES 
user_id=131445

I'm seeing what appears to be a similar error related to
unicode.

i can send you .db and .pck files if it would help.
mine is with mailman-2.1.2

Aug 27 01:12:03 2003 (24565) Uncaught runner exception:
ASCII encoding error: ordinal not in range(128)
Aug 27 01:12:03 2003 (24565) Traceback (most recent call last):
  File "/home/mailman/Mailman/Queue/Runner.py", line 105, in
_oneloop
    self._onefile(msg, msgdata)
  File "/home/mailman/Mailman/Queue/Runner.py", line 155, in
_onefile
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "/home/mailman/Mailman/Queue/IncomingRunner.py", line
130, in _dispose
    more = self._dopipeline(mlist, msg, msgdata, pipeline)
  File "/home/mailman/Mailman/Queue/IncomingRunner.py", line
153, in _dopipeline
    sys.modules[modname].process(mlist, msg, msgdata)
  File "/home/mailman/Mailman/Handlers/ToDigest.py", line
89, in process
    send_digests(mlist, mboxfp)
  File "/home/mailman/Mailman/Handlers/ToDigest.py", line
130, in send_digests
    send_i18n_digests(mlist, mboxfp)
  File "/home/mailman/Mailman/Handlers/ToDigest.py", line
303, in send_i18n_digests
    msg = scrubber(mlist, msg)
  File "/home/mailman/Mailman/Handlers/Scrubber.py", line
305, in process
    t = unicode(t, 'ascii', 'replace').encode('ascii')
UnicodeError: ASCII encoding error: ordinal not in range(128)

Aug 27 01:12:03 2003 (24565) SHUNTING:
1061961121.185183+0b73a771780f550a6c2e25855f37ea5f250ed212


----------------------------------------------------------------------

Comment By: Barry A. Warsaw (bwarsaw)
Date: 2003-08-19 05:06

Message:
Logged In: YES 
user_id=12800

This was caused by a bug in the email package.  It'll be
fixed in email 2.5.4 and in Mailman 2.1.3.

----------------------------------------------------------------------

Comment By: Barry A. Warsaw (bwarsaw)
Date: 2003-08-19 02:11

Message:
Logged In: YES 
user_id=12800

A better thing to do is to attach a .pck/.db pair of files
for a shunted message.  Then I can run it through my system
and hopefully reproduce the bug.

If the message contains sensitive information or you don't
want to upload it for other reasons, please email them as
attachments to me: barry at python.org.  Make sure you put
"Mailman" in the subject.

----------------------------------------------------------------------

Comment By: Colin Allen (ventoux)
Date: 2003-08-16 22:43

Message:
Logged In: YES 
user_id=846026

ps - moving the various digest.mboxes freed up the blocked lists - 
too many messages with attachments in the digests for me to 
figure out exactly which one was causing the problem, but I'll be 
happy to forward copy of offending mbox to anyone interested.


----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=100103&aid=789897&group_id=103



More information about the Mailman-coders mailing list