Has anyone created a script they'd like to share that kills off the sobig stuff sitting on hold?
I'll make one but if there's one already out there, it'd save me some time. I'm leaving on vacation Friday night. Lots to do 'till then...
--
Democracy is two wolves and a lamb voting on what to have for lunch. Liberty is a well-armed lamb contesting the vote.
Hi,
Get auto_discard script here,
http://sourceforge.net/tracker/?func=detail&aid=636412&group_id=103&atid=300103
and place it in somewhere it can import paths.py (cron dir is suitable). Edit the expire parameter for shorter time and run the script (python auto_discard).
It will kill all the pending posts older than the expire parameter. (it doesn't sort sobig stuff though ...)
Phil Barnett wrote:
Has anyone created a script they'd like to share that kills off the sobig stuff sitting on hold?
I'll make one but if there's one already out there, it'd save me some time. I'm leaving on vacation Friday night. Lots to do 'till then...
-- Tokio Kikuchi, tkikuchi@ is.kochi-u.ac.jp http://weather.is.kochi-u.ac.jp/
On Wednesday 20 August 2003 11:35 pm, Phil Barnett wrote:
Has anyone created a script they'd like to share that kills off the sobig stuff sitting on hold?
I'll make one but if there's one already out there, it'd save me some time. I'm leaving on vacation Friday night. Lots to do 'till then...
In the grand tradition of replying to myself...
Here is the script I cobbled up.
It deletes the worst of the muck. I let cron run it hourly. Watch the wrap. All lines should start with /bin/grep.
45 * * * * /home/mailman/data/cleanup.sh
#! /bin/bash
cd /home/mailman/data
/bin/grep -H -m 1 -l -i '6.00.2600.0000' *.txt | /usr/bin/xargs rm >/dev/null 2>&1 /bin/grep -H -m 1 -l -i 'nigeria' *.txt | /usr/bin/xargs rm >/dev/null 2>&1 /bin/grep -H -m 1 -l -i 'winning notification' *.txt | /usr/bin/xargs rm
/dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: Invalid address' *.txt | /usr/bin/xargs rm /dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: Warning! Virus found in message from you!' *.txt | /usr/bin/xargs rm >/dev/null 2>&1 /bin/grep -H -m 1 -l -i 'INTRODUCTORY OFFER' *.txt | /usr/bin/xargs rm /dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: Undeliverable' *.txt | /usr/bin/xargs rm /dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: PRECIOS DE TRANSFERENCIA' *.txt | /usr/bin/xargs rm >/dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: PROGRAMA MEDICO' *.txt | /usr/bin/xargs rm /dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Amalgamated Bank of South Africa' *.txt | /usr/bin/xargs rm >/dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Prescription Weight Loss' *.txt | /usr/bin/xargs rm /dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: URGENT ASSISTANCE' *.txt | /usr/bin/xargs rm /dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: EXPO CAPACITATE EMPRESARIAL' *.txt | /usr/bin/xargs rm >/dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: DONATION FOR THE LORD' *.txt | /usr/bin/xargs rm >/dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: ALERT:' *.txt | /usr/bin/xargs rm >/dev/null 2>&1 /bin/grep -H -m 1 -l -i 'Subject: your opinion is worth money' *.txt | /usr/bin/xargs rm >/dev/null 2>&1
--
Democracy is two wolves and a lamb voting on what to have for lunch. Liberty is a well-armed lamb contesting the vote.
--- Phil Barnett <philb@philb.us> wrote:
On Wednesday 20 August 2003 11:35 pm, Phil Barnett wrote:
Has anyone created a script they'd like to share that kills off the sobig stuff sitting on hold?
In the grand tradition of replying to myself...
Here is the script I cobbled up.
It deletes the worst of the muck. I let cron run it hourly. Watch the wrap. All lines should start with /bin/grep.
45 * * * * /home/mailman/data/cleanup.sh
#! /bin/bash
cd /home/mailman/data
/bin/grep -H -m 1 -l -i 'nigeria' *.txt | /usr/bin/xargs rm >/dev/null 2>&1
How do you go about getting .txt files in your /home/mailman/data dir ? All I see are binary pck files (which one could run dumpdb on, but was curious to know). I'm running mailman-2.1.2. BTW, does deleting those .pck files have any baring on anything else (is it dangerous) ? Meaning, are there any adverse affects in doing that (is there a db that cares or anything) ?
BTW: for those mailman users looking to incorporate spamassassin, do look into this site - it would be wonderful if mailman proper included these hooks natively in its future releases (or at a min include the info on the URL below on list.org or the FAQ).
http://www.daa.com.au/~james/articles/mailman-spamassassin/
One thing this setup is lacking is "learning" - ie. the ability for
spamassassin to play nicer with mailman (ie. to know what things you
discarded to build-up a more profound history affecting future action).Regards,
- Nadim
Do you Yahoo!? Yahoo! SiteBuilder - Free, easy-to-use web site design software http://sitebuilder.yahoo.com
Take a look in cvs. There's a script called bin/discard which takes a list of file names and does proper discards on all those files. I'll be testing it on mail.python.org when 1) I dig out from the mail hell we've been in for the last few days, and 2) SF's CVS stops sucking <wink>.
-Barry
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
"baw" == Barry Warsaw "Re: [Mailman-Developers] script" 05 Sep 2003 08:08:41 -0400
baw> Take a look in cvs. There's a script called bin/discard
baw> which takes a list of file names and does proper discards on
baw> all those files. I'll be testing it on mail.python.org when
baw> 1) I dig out from the mail hell we've been in for the last
baw> few days, and 2) SF's CVS stops sucking <wink>.I hope this is something where the choice of what to discard rests with the individual list owner/moderator.
Until now, with Mailman, content discrimination has been solely up to the individual list owner and his minions. IMHO it is good to make it easy for the individual list owners to do their job, but anything that requires content decisions to be made across all lists on a Mailman will be inappropriate for at least some, and probably many, mailing list operators. Consider a Mailman that carries many diverse lists including some that, for example, are directly involved with Nigerian affairs and Nigerian folk. Also, depending who operates Mailman and under what auspices and under what jurisdiction, an operator that exercises some discrimination based upon content may viewed as being responsible for content in general. For the sake of those operators who cannot take such responsibility, please continue to make any facilities for discriminating based upon content be tailored to the needs of individual lists and by the individual list owners.
Elsewhere recently there has been mention of Baysen spam filters or the like for Mailman. Again, to be generally useful, it would, IMHO, be necessary to allow these features to be tailored to the needs of individual lists and to continue to plaice all responsibility firmly with the individual list owner where that is the policy of the Mailman operator.
jam-----BEGIN PGP SIGNATURE-----
iD8DBQE/WK/oUEvv1b/iXy8RAuNFAKCHAsjxKoi8KjvfVd4TQTyoYcNH9ACbBB5M 7n6h6vlje0h83mvozPghpPU= =NUsK -----END PGP SIGNATURE-----
On Fri, 2003-09-05 at 11:46, John A. Martin wrote:
I hope this is something where the choice of what to discard rests with the individual list owner/moderator.
The script is just a hack, and must be run by the site admin on the command line. It's just a way to mass discard a ton of crap. It works on file names so it's easy to focus it on a single list.
Elsewhere recently there has been mention of Baysen spam filters or the like for Mailman. Again, to be generally useful, it would, IMHO, be necessary to allow these features to be tailored to the needs of individual lists and to continue to plaice all responsibility firmly with the individual list owner where that is the policy of the Mailman operator.
That's how my Spambayes patch to Mailman works. It hooks into the normal approval process. It'll likely need updating to the latest versions of Spambayes (which recently underwent an interface upheaval). I'd probably be inclined to put this on the feature list for Mailman 2.2.
-Barry
On Friday 05 September 2003 18:16, Barry Warsaw wrote:
Elsewhere recently there has been mention of Baysen spam filters or the like for Mailman. Again, to be generally useful, it would, IMHO,
That's how my Spambayes patch to Mailman works. It hooks into the normal approval process. It'll likely need updating to the latest versions of Spambayes (which recently underwent an interface upheaval). I'd probably be inclined to put this on the feature list for Mailman 2.2.
I'm using this patch (slightly adapted) on our servers since early april. It works almost seamlessly and its very effective but still lacks some UI controls, e.g. actually there's no way to train the filter TTW with a message which is not in the moderation queue. Also, if a message gets discarded or posted to the list, there's no way to recoved the pristine copy, the one that was inspected by the filter, and the only copy one can use is Decorate'ed, mangled and/or filled with unwanted Received headers. Hopefully I'm going to work again on this patch in the next few months.
-- Adde parvum parvo magnus acervus erit -- Ovidio
On Fri, 2003-09-05 at 16:33, Simone Piunno wrote:
I'm using this patch (slightly adapted) on our servers since early april. It works almost seamlessly and its very effective but still lacks some UI controls, e.g. actually there's no way to train the filter TTW with a message which is not in the moderation queue. Also, if a message gets discarded or posted to the list, there's no way to recoved the pristine copy, the one that was inspected by the filter, and the only copy one can use is Decorate'ed, mangled and/or filled with unwanted Received headers. Hopefully I'm going to work again on this patch in the next few months.
Excellent feedback, thanks Simone! I think we can fix the u/i problems, but it's nice to know the basic approach has utility.
-Barry
On Friday 05 September 2003 1:48 am, Nadim Shaikli wrote:
How do you go about getting .txt files in your /home/mailman/data dir ? All I see are binary pck files (which one could run dumpdb on, but was curious to know). I'm running mailman-2.1.2. BTW, does deleting those .pck files have any baring on anything else (is it dangerous) ? Meaning, are there any adverse affects in doing that (is there a db that cares or anything) ?
It only deletes the messages that are caught by my filters. In this case, it is:
# Lines that *start* with a '#' are comments. to: friend@public.com message-id: relay.comanche.denmark.eu from: list@listme.com from: .*@uplinkpro.com from: .*@lithesoft.com from: .*@paid4survey.net from: .*@freegift4u.com.* from: .*q-crystal.com.* subject: .*@Podtal.* subject: .*URGENT ASSISTANCE.* from: .*etoyshop.* from: .*bdavisa.* subject: .*new photos from my party.* Content-type: text/html Content-type: text/enriched Content-type: text/x-vcard Content-type: multipart/alternative Content-type: multipart/related Content-type: multipart/mixed Content-type: application/octet-stream Content-Type: text/html Content-Type: text/enriched Content-Type: text/x-vcard Content-Type: multipart/alternative Content-Type: multipart/related Content-Type: multipart/mixed Content-Type: application/octet-stream Content-Disposition: attachment from: .*@lehugo.com.br.* subject: .*Autoreply:.* Precedence: .*bulk.*
--
Democracy is two wolves and a lamb voting on what to have for lunch. Liberty is a well-armed lamb contesting the vote.
On Friday 05 September 2003 1:48 am, Nadim Shaikli wrote:
BTW, does deleting those .pck files have any baring on anything else (is it dangerous) ? Meaning, are there any adverse affects in doing that (is there a db that cares or anything) ?
I forgot to answer this.
Yes, the html admin page complains that the mail is lost.
Hit the submit button and it cleans up after itself.
Doesn't appear to cause any problems.
--
Democracy is two wolves and a lamb voting on what to have for lunch. Liberty is a well-armed lamb contesting the vote.
participants (6)
-
Barry Warsaw -
John A. Martin -
Nadim Shaikli -
Phil Barnett -
Simone Piunno -
Tokio Kikuchi