Custom handler applied to digest to filter excessive quoted text?
Hi all,
Is it possible to create a custom handler for digests only?
I want a mail list that automatically strips out duplicated quoted text in digests, so the same quoted text doesn't appear over and over. Such a thing doesn't appear to exist in any mailing list software, so I'm looking for the second-best thing, which is currently software that easily allows such a filter to be inserted.
Any other ways people handle this problem, aside from telling users to not quote excessively?
Thanks
John Williams jodawi@gmail.com
John Williams writes:
Is it possible to create a custom handler for digests only?
Yes. The standard pipeline contains a handler named "ToDigest" or something like that. You edit the pipeline either in mm_cfg.py (for global effect) or create a local pipeline with bin/with_list (this has some UI gotchas although once you get the pipeline actually edited and saved it works great; feel free to remind me but I don't have time to go into it now).
So what you do is write your handler to do its job, then chain ToDigest's "process" function from there.
On 8/7/2009, Stephen J. Turnbull (stephen@xemacs.org) wrote:
Is it possible to create a custom handler for digests only?
<snip>
I want a mail list that automatically strips out duplicated quoted text in digests,
Yes.
Wow, I'd be interested in this if you get it working... and I'd think the mainline devs might be interested too.
By the way John... I'm guessing you sent your post twice becaqsue you didn't realize that when posting from your gmail account, you won't see your own posts? It considers the message you 'Sent' and the one the list sends as 'duplicates', so hides (or deletes?) the second one (from the list). I really hate that about gmail...
--
Best regards,
Charles
Stephen J. Turnbull wrote:
See the FAQ at <http://wiki.list.org/x/l4A9>.
So what you do is write your handler to do its job, then chain ToDigest's "process" function from there.
This may or may not work depending on whether the filtering of quotes needs to look at more that the current message. Of course, I suppose it could look at the list's digest.mbox for prior messages if necessary.
However, why do this only for digests. Granted, that's where the problem is most apparent, but I think in most cases the excessive quotes could be trimmed from individual messages too. Every once in a while, someone replis to something in a digest and quotes the entire digest. Generally, these get caught on my lists for "too big", but I'd want those quotes and less egregious ones removed from messages too. And, if someone really needs more context for a reply, they can get it from the archive.
I would have implemented it myself by now, but I haven't spent the time to come up with a good algorithm for recognizing and removing excessive quotes. Of course I could always use a gross cut approach and make the users adapt to it ;)
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
On Fri, Aug 7, 2009 at 3:40 AM, <tanstaafl@libertytrek.org> wrote:
No...first one didn't appear when checking online archives. I sent without being subscribed to the list, intending to check the online archives for answers. Waited a day, decided it had been silently discarded, then joined list and sent again. Then both showed up, of course. :)
-- John Williams jodawi@gmail.com
John Williams writes:
Is it possible to create a custom handler for digests only?
Yes. The standard pipeline contains a handler named "ToDigest" or something like that. You edit the pipeline either in mm_cfg.py (for global effect) or create a local pipeline with bin/with_list (this has some UI gotchas although once you get the pipeline actually edited and saved it works great; feel free to remind me but I don't have time to go into it now).
So what you do is write your handler to do its job, then chain ToDigest's "process" function from there.
On 8/7/2009, Stephen J. Turnbull (stephen@xemacs.org) wrote:
Is it possible to create a custom handler for digests only?
<snip>
I want a mail list that automatically strips out duplicated quoted text in digests,
Yes.
Wow, I'd be interested in this if you get it working... and I'd think the mainline devs might be interested too.
By the way John... I'm guessing you sent your post twice becaqsue you didn't realize that when posting from your gmail account, you won't see your own posts? It considers the message you 'Sent' and the one the list sends as 'duplicates', so hides (or deletes?) the second one (from the list). I really hate that about gmail...
--
Best regards,
Charles
Stephen J. Turnbull wrote:
See the FAQ at <http://wiki.list.org/x/l4A9>.
So what you do is write your handler to do its job, then chain ToDigest's "process" function from there.
This may or may not work depending on whether the filtering of quotes needs to look at more that the current message. Of course, I suppose it could look at the list's digest.mbox for prior messages if necessary.
However, why do this only for digests. Granted, that's where the problem is most apparent, but I think in most cases the excessive quotes could be trimmed from individual messages too. Every once in a while, someone replis to something in a digest and quotes the entire digest. Generally, these get caught on my lists for "too big", but I'd want those quotes and less egregious ones removed from messages too. And, if someone really needs more context for a reply, they can get it from the archive.
I would have implemented it myself by now, but I haven't spent the time to come up with a good algorithm for recognizing and removing excessive quotes. Of course I could always use a gross cut approach and make the users adapt to it ;)
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
On Fri, Aug 7, 2009 at 3:40 AM, <tanstaafl@libertytrek.org> wrote:
No...first one didn't appear when checking online archives. I sent without being subscribed to the list, intending to check the online archives for answers. Waited a day, decided it had been silently discarded, then joined list and sent again. Then both showed up, of course. :)
-- John Williams jodawi@gmail.com
participants (4)
-
John Williams -
Mark Sapiro -
Stephen J. Turnbull -
tanstaafl＠libertytrek.org