Mailman 3 December 2000 - Mailman-Developers

Re: [Mailman-Developers] about qrunner and locking
by Ralph Corderoy 09 Dec '00

09 Dec '00

Hi, > > Sorry if this is wandering a little off topic, but what's a `beat'? > > What stops > > > > A writes `A' > > A waits a beat > > A short wait. Just long enough to let things settle so you get > reliable data. It's really a musical term that's I've absconded > with... This won't work. A doesn't know how long to wait because it doesn't know how quickly B might get around to trampling the `A'. Ralph.

1 0

Re: [Mailman-Developers] about qrunner and locking
by Ralph Corderoy 09 Dec '00

09 Dec '00

Hi Chuq, > here's another way that should work: each record has a locking field > in it. When qrunner wants to execute that item, it reads the field. > If the field is NULL, it writes its ID (hwatever it is, guaranteed > unique) into that locking field. It then waits a beat, and reads it > back. if it reads back its own ID, it knows it owns the record and > can execute it. If it reads back someone else's ID, it lost the lock, > but someone else owns the record so it can skip it and move on. Sorry if this is wandering a little off topic, but what's a `beat'? What stops A reads, gets NULL B reads, gets NULL A writes `A' A waits a beat A reads `A' and has the lock B held up for a little writes `B' B waits a beat B reads `B' and also has the lock I think I'm missing something and that's annoying :-) Ralph.

2 1

Thoughts on splitting qrunner
by barry＠digicool.com 08 Dec '00

08 Dec '00

http://www.zope.org/Members/bwarsaw/MailmanDesignNotes/SplittingQrunner Comments please, either here or in the Wiki! -Barry

3 6

Re: [Mailman-Developers] about qrunner and locking
by J C Lawrence 08 Dec '00

08 Dec '00

On Fri, 8 Dec 2000 09:36:11 +0100 Thomas Wouters <thomas(a)xs4all.net> wrote: > Over NFS, almost nothing is atomic. And even if you do grab an > atomic operation, you can get .... The only operation which I've found guaranteed atomic across all NFS implementations is creat(). > I'm afraid that there isn't a good solution to your problem, right > now. In all honesty, and I say this with all my professional years > of experience in this area, NFS sucks large granite elephant > testicles through a very thin straw. (To butcher a Pratchett > quote, "NFS is like a vampire; it bites, it sucks, and it leaves > you lifeless") Yuo're beginning to sound a bit like me, only you're more polite. -- J C Lawrence claw(a)kanga.nu ---------(*) : http://www.kanga.nu/~claw/ --=| A man is as sane as he is dangerous to his environment |=--

1 0

Re: Huge qrunner process
by sigma＠pair.com 08 Dec '00

08 Dec '00

Following up on my own message... qrunner isn't the only culprit. senddigests is worse, since it doesn't stop itself from running indefinitely. There is a definite memory leak or inefficiency somewhere. Just the following fragment of code, edited from senddigests, is enough to send the memory usage sky-high: def main(): for listname in Utils.list_names(): mlist = MailList.MailList(listname, lock=0) del mlist The "del mlist" doesn't help. I've noticed that one pathological list has a 12MB config.db file. If loading config.db is inefficient by a factor of eleven, then that could explain the swelling to 135MB. With that list removed, the memory usage peak is just 89MB. Is there a way to tell if Python is deleting the MailList object when mlist gets reassigned, so I can find out if there is a leak each time a list is loaded? Otherwise it's just inefficient memory usage in proportion to the size of config.db Thanks, Kevin ----- Forwarded message from sigma(a)pair.com ----- >From mailman-developers-admin(a)python.org Thu Dec 07 12:00:16 2000 Delivered-To: sigma(a)smx.pair.com Delivered-To: sigma(a)pair.com Delivered-To: mailman-developers(a)new.python.org Delivered-To: mailman-developers(a)python.org Message-ID: <20001207115954.1364.qmail(a)smx.pair.com> From: sigma(a)pair.com To: mailman-developers(a)python.org X-Mailer: ELM [version 2.4ME+ PL40 (25)] Subject: [Mailman-Developers] Huge qrunner process Sender: mailman-developers-admin(a)python.org Errors-To: mailman-developers-admin(a)python.org X-BeenThere: mailman-developers(a)python.org X-Mailman-Version: 2.0 Precedence: bulk List-Help: <mailto:mailman-developers-request@python.org?subject=help> List-Post: <mailto:mailman-developers@python.org> List-Subscribe: <http://www.python.org/mailman/listinfo/mailman-developers>, <mailto:mailman-developers-request@python.org?subject=subscribe> List-Id: Mailman mailing list developers <mailman-developers.python.org> List-Unsubscribe: <http://www.python.org/mailman/listinfo/mailman-developers>, <mailto:mailman-developers-request@python.org?subject=unsubscribe> List-Archive: <http://www.python.org/pipermail/mailman-developers/> Date: Thu, 7 Dec 2000 06:59:54 -0500 (EST) Can anyone enlighten me about why the qrunner process might need a tremendous amount of memory? Running Mailman 2.0 on a FreeBSD 4.1.1-STABLE server with Python 2.0. There are about 1500 lists, but the qfiles directory only has 32 files in it. Nonetheless, each minute when qrunner runs, it looks like this in top: 59606 mailman -2 20 135M 74456K getblk 0:01 8.93% 3.52% python 135 MB? It seems excessive. Any insight would be appreciated :) Thanks, Kevin _______________________________________________ Mailman-Developers mailing list Mailman-Developers(a)python.org http://www.python.org/mailman/listinfo/mailman-developers ----- End of forwarded message from sigma(a)pair.com -----

3 7

glitch in 2.0 check_perms
by Chuq Von Rospach 08 Dec '00

08 Dec '00

Justfound a glitch in 2.0 check_perms. I was getting a failure on one of my lists when trying to process an admin request, because of a permission problem. I found that the listname/request.db file was mode 644 instead of 664, so that anything trying to open it for writing failed. I don't know how it got that way, none of the other lists have had this problem. But when I found the problem, I ran check_perms, and it reported no problem, which is clearly wrong... -- Chuq Von Rospach - Plaidworks Consulting (mailto:chuqui@plaidworks.com) Apple Mail List Gnome (mailto:chuq@apple.com) We're visiting the relatives. Cover us.

2 1

giving mailman egroups like functionality?
by Rajat 08 Dec '00

08 Dec '00

hello friends, am new to this list ... but have been using mailman for quite some time. am also aware of howto program in python .... but am no big expert in python! one of my implementation projets requires what egroups gives .... Now mailman is an excellent tool for mailing list management with excellent web based GUI interface .... what i want is howto - 1.) a web page thru which users can login ( that i have taken care of - assumed that users are already in my ldap database and they get into their user area say like a mailbox ) and can create their own mailing lists rather than someone makes for them from a shell! 2.) then everytime they login they see what lists they are moderator are for plus also thise lists which they have subscribed too. 3.) when they click on the list they are moderator are for then it should give the link to http://hostname/mailman/admin/listname 4.) and when they click the link to the list they have been subscribed they go the link http://hostnanme/mailman/listindo/listname 5.) also how can i execute the commands present in my ~Mailman/bin directory .. eg: list_lists i would really appreciate if you could help me out in doing this ... plus if these functional are, if u think not required in mailman or do not confer to mailman standards, then please at least do help me out howto go about it .. either, a) changing the python code of mailman b) any way i can achieve this my executing any existing binary commands which comes with Mailman thru perl or PHP. The requirements are on a urgent basis ... so would appreciate all your help Thnx Regards Rajat P.S. : i have told that s/w like lyris list manager does this .. but am a hardcore mailman fan .. and i would never like to use any other mailing list manager :) __________________________________________________ Do You Yahoo!? Yahoo! Shopping - Thousands of Stores. Millions of Products. http://shopping.yahoo.com/

1 0

Re: [Mailman-Developers] msg_header: insertion of sender name/address
by J C Lawrence 07 Dec '00

07 Dec '00

On Thu, 7 Dec 2000 15:07:36 -0800 (PST) Dan Mick <Dan.Mick(a)West.Sun.COM> wrote: > Well, it looks like the header and footer get the entire mlist's > dictionary, plus mm_cfg.CGIEXT, to interpolate with, but nothing > per-message. I suppose the right answer would be to change > Decorate.py (or add a new module parallel to it) to add in > selected fields from the message dictionary (assuming there are no > name clashes between the mlist dictionary and the message > dictionary, anyway). Simpler would be to prefix Mailman with a procmail/maildrop/whatwever script that copied the From: header into the body of the message. The handling of MIME problems of course is a different matter. -- J C Lawrence claw(a)kanga.nu ---------(*) : http://www.kanga.nu/~claw/ --=| A man is as sane as he is dangerous to his environment |=--

1 0

Re: [Mailman-Developers] msg_header: insertion of sender name/address
by Dan Mick 07 Dec '00

07 Dec '00

Well, it looks like the header and footer get the entire mlist's dictionary, plus mm_cfg.CGIEXT, to interpolate with, but nothing per-message. I suppose the right answer would be to change Decorate.py (or add a new module parallel to it) to add in selected fields from the message dictionary (assuming there are no name clashes between the mlist dictionary and the message dictionary, anyway). d = Utils.SafeDict(mlist.__dict__) d['cgiext'] = mm_cfg.CGIEXT # interpolate into the header try: header = string.replace(mlist.msg_header % d, '\r\n', '\n') I don't see a way it can be done without hackery. > I had to read it twice, but this is not another question about whether user > names can be merged into a message for custom stuff. Any idea if there is > a way to grab the Sender/From lines and put them into the message body? I > think that the problem is that the mail systems that she is using munge up > the display of senders. > > Cheers. > > --chris > > > >From: Patrick_Healy(a)nywd.uscourts.gov > >X-Mailer: ccMail Link to SMTP R8.30.00.7 > >Date: Thu, 07 Dec 2000 16:39:40 -0500 > >To: <ckolar(a)admin.aurora.edu> > >Subject: Mailman > > > > > >Mr. Kolar, > > > >Sorry to bother you with this question, but I've not received any responses to > >my question on the list. I really appreciate any help you could give me > >on this > >problem. > > > >In a nutshell - The federal judiciary uses Cc:Mail as it's enterprise email > >system (soon to be replaced by Notes). The Mailman lists that I've > >created and > >administer work great to those clients. However, they have no indication > >in the > >body of the message of who sent the message. > > > >This means that unless the sender remembers to sign there note, it essentially > >becomes anonymous. > > > >Is there an environment variable that I can insert into the custom header that > >will cause the sender's name to be displayed? > > > >Thanks! > > > >Pat Healy > >U.S. District Court, Western District of New York > > > _______________________________________________ > Mailman-Developers mailing list > Mailman-Developers(a)python.org > http://www.python.org/mailman/listinfo/mailman-developers

1 0

msg_header: insertion of sender name/address
by Christopher Kolar 07 Dec '00

07 Dec '00

I had to read it twice, but this is not another question about whether user names can be merged into a message for custom stuff. Any idea if there is a way to grab the Sender/From lines and put them into the message body? I think that the problem is that the mail systems that she is using munge up the display of senders. Cheers. --chris >From: Patrick_Healy(a)nywd.uscourts.gov >X-Mailer: ccMail Link to SMTP R8.30.00.7 >Date: Thu, 07 Dec 2000 16:39:40 -0500 >To: <ckolar(a)admin.aurora.edu> >Subject: Mailman > > >Mr. Kolar, > >Sorry to bother you with this question, but I've not received any responses to >my question on the list. I really appreciate any help you could give me >on this >problem. > >In a nutshell - The federal judiciary uses Cc:Mail as it's enterprise email >system (soon to be replaced by Notes). The Mailman lists that I've >created and >administer work great to those clients. However, they have no indication >in the >body of the message of who sent the message. > >This means that unless the sender remembers to sign there note, it essentially >becomes anonymous. > >Is there an environment variable that I can insert into the custom header that >will cause the sender's name to be displayed? > >Thanks! > >Pat Healy >U.S. District Court, Western District of New York

1 0

Mailman-Developers December 2000