Involuntary attachment archiving bug
Hello,
Versions first, this is Debian Sarge, so mailman 2.1.4-5 and python 2.3.4-1. And I'm perfectly fine to take this up with the Debian package maintainer, but I believe this to be not entirely distribution specific.
2 days ago a mailing list here stopped working while all other lists on the same server continued to work. All new mails to it wound up in qfiles/shunt and a typical error.log entry looked like this:
Jul 28 16:06:58 2004 (27374) SHUNTING: 1090998399.1266079+7ffb6a7f9ae96f08b57292134da84fc995792442 Jul 28 16:10:07 2004 (27374) Uncaught runner exception: [Errno 36] File name too long: '/var/lib/mailman/archives/private/abuse/attachments/20040727/f9525c89/iso-2022-jpBSRskQicwGyhCNSAtIDVJIC0gODYgLSAbJEInISdfJ1QnXSdaJ20bKEIiso-2022-jpBGyRCJ2MnXCdaJ1sbKEIgGyRCJ2MbKEIgGyRCJ2EnYidWJ2EnYCdVGyhCiso-2022-jpBGyRCJ1EnUydRJ2QnViddJ3EnXidaGyhCIBskQidaGyhCiso-2022-jpBGyRCJ1kbKEIgGyRCJzMbKEIgGyRCJzobKEIgGyRCJyEbKEIuZW1s.mht' Jul 28 16:10:07 2004 (27374) Traceback (most recent call last): File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 110, in _oneloop self._onefile(msg, msgdata) File "/usr/lib/mailman/Mailman/Queue/Runner.py", line 160, in _onefile keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/lib/mailman/Mailman/Queue/IncomingRunner.py", line 130, in _dispose more = self._dopipeline(mlist, msg, msgdata, pipeline) File "/usr/lib/mailman/Mailman/Queue/IncomingRunner.py", line 153, in _dopipeline sys.modules[modname].process(mlist, msg, msgdata) File "/var/lib/mailman/Mailman/Handlers/ToDigest.py", line 91, in process send_digests(mlist, mboxfp) File "/var/lib/mailman/Mailman/Handlers/ToDigest.py", line 132, in send_digests send_i18n_digests(mlist, mboxfp) File "/var/lib/mailman/Mailman/Handlers/ToDigest.py", line 306, in send_i18n_digests msg = scrubber(mlist, msg) File "/var/lib/mailman/Mailman/Handlers/Scrubber.py", line 240, in process url = save_attachment(mlist, part, dir) File "/var/lib/mailman/Mailman/Handlers/Scrubber.py", line 447, in save_attachment fp = open(path, 'w') IOError: [Errno 36] File name too long: '/var/lib/mailman/archives/private/abuse/attachments/20040727/f9525c89/iso-2022-jpBSRskQicwGyhCNSAtIDVJIC0gODYgLSAbJEInISdfJ1QnXSdaJ20bKEIiso-2022-jpBGyRCJ2MnXCdaJ1sbKEIgGyRCJ2MbKEIgGyRCJ2EnYidWJ2EnYCdVGyhCiso-2022-jpBGyRCJ1EnUydRJ2QnViddJ3EnXidaGyhCIBskQidaGyhCiso-2022-jpBGyRCJ1kbKEIgGyRCJzMbKEIgGyRCJzobKEIgGyRCJyEbKEIuZW1s.mht'
Note that: a) archiving is turned off for list. b) it rejected ALL mails like this, no matter if they actually had attachments or not.
An unshunt of course did not fix things and in the end I "fixed" things the M$ way by blowing away the original list and re-creating it. After that the unshunt worked and new mails did get through fine, too. Alas it's still archiving (just) attachments, so I can foresee this happening again...
So my question is:
What the heck is causing it to archive those attachments in the first place? I don't want this stuff archived, esp. not considering it might trigger the above bug again.
Of course somebody who understands the code might also want to take a look what caused it to create these oversized filenames (again, even for mails w/o attachments), since some lists do use archiving here. A guess would be something in a .db or .pck of that list did overflow, it sees a LOT of traffic (1000 mails/day).
Regards,
Christian Balzer
Christian Balzer Network/Systems Engineer NOC chibi@gol.com Global OnLine Japan/Fusion Network Services http://www.gol.com/
Christian Balzer wrote:
So my question is:
What the heck is causing it to archive those attachments in the first place? I don't want this stuff archived, esp. not considering it might trigger the above bug again.
It archives the attachments because digests (at least non-MIME digests) do not include attachments. Instead they include links to the attachments which therefore must have been saved somewhere so they can be linked from the digest.
Sorry I can't help with the cause of the bug or any solution, but at least you can understand why the attachments are being saved.
-- Mark Sapiro msapiro@value.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Hi,
Jul 28 16:10:07 2004 (27374) Uncaught runner exception: [Errno 36] File name too long: '/var/lib/mailman/archives/private/abuse/attachments/20040727/f9525c89/iso-2022-jpBSRskQicwGyhCNSAtIDVJIC0gODYgLSAbJEInISdfJ1QnXSdaJ20bKEIiso-2022-jpBGyRCJ2MnXCdaJ1sbKEIgGyRCJ2MbKEIgGyRCJ2EnYidWJ2EnYCdVGyhCiso-2022-jpBGyRCJ1EnUydRJ2QnViddJ3EnXidaGyhCIBskQidaGyhCiso-2022-jpBGyRCJ1kbKEIgGyRCJzMbKEIgGyRCJzobKEIgGyRCJyEbKEIuZW1s.mht' IOError: [Errno 36] File name too long: '/var/lib/mailman/archives/private/abuse/attachments/20040727/f9525c89/iso-2022-jpBSRskQicwGyhCNSAtIDVJIC0gODYgLSAbJEInISdfJ1QnXSdaJ20bKEIiso-2022-jpBGyRCJ2MnXCdaJ1sbKEIgGyRCJ2MbKEIgGyRCJ2EnYidWJ2EnYCdVGyhCiso-2022-jpBGyRCJ1EnUydRJ2QnViddJ3EnXidaGyhCIBskQidaGyhCiso-2022-jpBGyRCJ1kbKEIgGyRCJzMbKEIgGyRCJzobKEIgGyRCJyEbKEIuZW1s.mht'
If you really want to archive this file, then apply this patch http://sourceforge.net/tracker/index.php?func=detail&aid=891491&group_id=103&atid=300103 and set SCRUBBER_DONT_USE_ATTACHMENT_FILENAME = True
Or, if you don't want attachments get archived go to the digest option page and set 'digestable' No.
-- Tokio Kikuchi, tkikuchi@ is.kochi-u.ac.jp http://weather.is.kochi-u.ac.jp/
participants (3)
-
Christian Balzer
-
Mark Sapiro
-
Tokio Kikuchi