[Mailman-Users] two errors causing shunting.

[Mitchell Marks]

(Just another data point ...)

I also rather frequently see the first of these two errors, associated with 
a message going into shunt.

The occasions when it happens are when BOTH of the following conditions hold:

         1.  The list has Personalization set to Yes (and there is a 
percent-substitution for fullname and address in the footer -- though i 
haven't experimented with this as a separate variable)

         2.  The message contains an extended-Ascii character with high bit 
on.  E.g., begin/end quotes, copyright, \226 for a dash.

These don't simply unshunt with bin/shunt, but I can get them to dislodge 
with a little preparation, either:

         A. I edit the .pck, substituting another character where I see the 
high-bit one.  (Take care to keep the same number of characters or it will 
be tossed out as a bad pickle.)
         B. Go to the web admin interface for the list, turn off 
personalization (and save the substitution strings); run bin/unshunt; turn 
personalization back on (and restore the substitution strings).

A bit of a pain either way.  Today I'm hoping to transfer some lists to a 
server where we have MM 2.1.3 and am hoping that as a side benefit this 
problem might go away.  (I've been seeing it in 2.1, 2.1.1, 2.1.2).

regards,

  Mitch Marks

At 03:17 AM 5/11/03, Sumeet wrote:
>I have two errors that cause most of my shunting with a stock mailman 
>2.1.2 and Python 2.2.2 both compiled on Red Hat 9 w/ stock 2.4.20-8 
>kernel. Any help would be greatly appreciated. Thanks. They are:
>
>May 10 20:57:24 2003 (4146) SHUNTING: 
>1052625116.7849211+19dccb687bd137300e85be6
>4c228d460e16287ab
>May 10 21:03:36 2003 (4146) Uncaught runner exception: ASCII encoding 
>error: ord
>inal not in range(128)
>May 10 21:03:36 2003 (4146) Traceback (most recent call last):
>   File "/usr/local/mailman/Mailman/Queue/Runner.py", line 105, in _oneloop
>     self._onefile(msg, msgdata)
>   File "/usr/local/mailman/Mailman/Queue/Runner.py", line 155, in _onefile
>     keepqueued = self._dispose(mlist, msg, msgdata)
>   File "/usr/local/mailman/Mailman/Queue/IncomingRunner.py", line 130, in 
> _dispo
>se
>     more = self._dopipeline(mlist, msg, msgdata, pipeline)
>   File "/usr/local/mailman/Mailman/Queue/IncomingRunner.py", line 153, in 
> _dopip
>eline
>     sys.modules[modname].process(mlist, msg, msgdata)
>   File "/usr/local/mailman/Mailman/Handlers/ToDigest.py", line 89, in process
>     send_digests(mlist, mboxfp)
>   File "/usr/local/mailman/Mailman/Handlers/ToDigest.py", line 130, in 
> send_dige
>sts
>     send_i18n_digests(mlist, mboxfp)
>   File "/usr/local/mailman/Mailman/Handlers/ToDigest.py", line 303, in 
> send_i18n
>_digests
>     msg = scrubber(mlist, msg)
>   File "/usr/local/mailman/Mailman/Handlers/Scrubber.py", line 305, in 
> process
>     t = unicode(t, 'ascii', 'replace').encode('ascii')
>UnicodeError: ASCII encoding error: ordinal not in range(128)

--
Mitchell Marks
CUIP Tech Coordinator    http://cuip.uchicago.edu
CUIP: Chicago Public Schools / Univ. of Chicago Internet Project
5640 S Ellis Ave  AAC-045, Univ of Chgo, Chgo IL 60637

Telephone:  Ofc 773-702-6041
         Fax 702-8212
         Home (v.m. only, ok any time) 241-7166
Email: Primary address: mitch at cuip.uchicago.edu
         Alternate UofC addresses (use especially to report problems with 
cuip.uchicago.edu): mitchell at cs.uchicago.edu and mmar at midway.uchicago.edu
         Off-campus (ISP) address: mmarks at pobox.com

Man in cafe (shouting on phone): Bouriana! Yes, that's me.  Yes, I'm 
holding ...  Bouriana.  Bouriana!  ... All right:  B as in Bouriana, O as 
in Ouriana, U as in Uriana, R as in Riana, I as in Iana, A as in Ana, N as 
in Na, A as in --- Albert!  Albert Bouriana!