Mailman 3 May 2006 - Twisted

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 21 May '06

21 May '06

Bug summary ______________________ Summary for 2006-05-14 through 2006-05-21 Bugs opened: 13 Bugs closed: 18 Total open bugs: 605 (-5) |== Type Changes |== Priority Changes |== Component Changes |Defect: +0 |Highest: -5 |Core: +0 |Enhancement: -4 |Normal: +1 |Mail: -1 |Task: +0 |Trial: +1 |Vfs: -1 |Web2: +0 |Website: -1 |Words: -2 New / Reopened Bugs ______________________ ===== Highest ===== [#1717] Test failures on win32 (test_process.UtilTestCase) (opened by teratorn) (CLOSED, fixed) defect core http://twistedmatrix.com/trac/ticket/1717 [#1718] Release Twisted core 2.3.0 (opened by radix) (CLOSED, fixed) task core http://twistedmatrix.com/trac/ticket/1718 [#1722] Make t.p.policies.TimeoutMixin and t.i.base.DelayedCall more unittest-friendly (opened by exarkun) (CLOSED, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1722 ===== Normal ===== [#1716] iocpreactor should use WSA functions for sockets (opened by ghazel) defect core http://twistedmatrix.com/trac/ticket/1716 [#1719] Review pyflakes warnings for Trial (opened by jml) (CLOSED, fixed) task trial http://twistedmatrix.com/trac/ticket/1719 [#1720] Trial's display of setUp errors is wonky (opened by exarkun) defect trial http://twistedmatrix.com/trac/ticket/1720 [#1721] Document DelayedCall because docstrings for maintainers are nice (opened by radix) (CLOSED, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1721 [#1723] twisted.web2.http_headers.parseWWWAuthenticate doesn't work without a challenge. (opened by dreid) defect web2 http://twistedmatrix.com/trac/ticket/1723 [#1724] twisted.web2.auth doesn't address multi-step authentication (opened by dreid) defect web2 http://twistedmatrix.com/trac/ticket/1724 [#1725] selectreactor 'winsock error' (opened by ghazel) defect core http://twistedmatrix.com/trac/ticket/1725 [#1726] Enhanced docstring for callFromThread (opened by moonfallen) enhancement core http://twistedmatrix.com/trac/ticket/1726 [#1727] custom log observer support for twistd (opened by harshaw) (CLOSED, duplicate) enhancement core http://twistedmatrix.com/trac/ticket/1727 [#1728] ThrottlingProtocol incorrectly calls stopReading and startReading on its transport (opened by exarkun) (CLOSED, fixed) defect core http://twistedmatrix.com/trac/ticket/1728 Closed Bugs ______________________ ===== Highest ===== [#1479] make setup.py and admin/sumo-setup.py share code (opened by radix, closed by radix, fixed) defect core http://twistedmatrix.com/trac/ticket/1479 [#1517] /bugs/issue# should redirect to /trac/ticket/# (opened by dreid, closed by exarkun, fixed) enhancement website http://twistedmatrix.com/trac/ticket/1517 [#1655] typos (group<->user) in twisted.words.service (opened by j2a, closed by exarkun, fixed) defect words http://twistedmatrix.com/trac/ticket/1655 [#1718] Release Twisted core 2.3.0 (opened by radix, closed by radix, fixed) task core http://twistedmatrix.com/trac/ticket/1718 [#1717] Test failures on win32 (test_process.UtilTestCase) (opened by teratorn, closed by teratorn, fixed) defect core http://twistedmatrix.com/trac/ticket/1717 [#1686] Better XML Stanza and error support (opened by ralphm, closed by ralphm, fixed) enhancement words http://twistedmatrix.com/trac/ticket/1686 [#1722] Make t.p.policies.TimeoutMixin and t.i.base.DelayedCall more unittest-friendly (opened by exarkun, closed by exarkun, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1722 [#1701] Most twisted.mail.pop3.IMailbox should be allowed to return Deferreds (opened by exarkun, closed by exarkun, fixed) enhancement mail http://twistedmatrix.com/trac/ticket/1701 ===== Normal ===== [#1705] Test failure on win32 (FilePathTestCase.testGetAndSet) (opened by teratorn, closed by teratorn, fixed) defect core http://twistedmatrix.com/trac/ticket/1705 [#1563] trial --testmodule should be usable without causing test methods to run repeatedly (opened by exarkun, closed by jml, ) defect trial http://twistedmatrix.com/trac/ticket/1563 [#1719] Review pyflakes warnings for Trial (opened by jml, closed by jml, fixed) task trial http://twistedmatrix.com/trac/ticket/1719 [#1661] KeyError exception in twisted.internet.process.Process.childConnectionLost (opened by andrea, closed by glyph, invalid) defect core http://twistedmatrix.com/trac/ticket/1661 [#1436] add getCookie/setCookie to web2.http_headers.Headers (opened by andrea, closed by glyph, invalid) enhancement web2 http://twistedmatrix.com/trac/ticket/1436 [#1475] Basic and Digest HTTP-Auth Implementation. (opened by dreid, closed by dreid, fixed) enhancement web2 http://twistedmatrix.com/trac/ticket/1475 [#1721] Document DelayedCall because docstrings for maintainers are nice (opened by radix, closed by radix, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1721 [#1727] custom log observer support for twistd (opened by harshaw, closed by harshaw, duplicate) enhancement core http://twistedmatrix.com/trac/ticket/1727 [#1728] ThrottlingProtocol incorrectly calls stopReading and startReading on its transport (opened by exarkun, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/1728 [#1673] twisted.vfs.adapters.sftp doesn't translate VFSErrors consistently and completely (opened by spiv, closed by spiv, fixed) defect vfs http://twistedmatrix.com/trac/ticket/1673

1 0

[Twisted-Python] implementing a tftp protocol
by Michael P. Soulier 21 May '06

21 May '06

Hi there, I'm new to twisted, and I'm trying to implement a tftp protocol, since I don't see one in the API and I need one. I'm finding the docs on UDP clients to be _very_ sparse. So far it seems that I need to use the reactor.listenUDP() method and then call transport.connect() somehow. I was going to use the protocol.ClientFactory as the TFTPFactory superclass. For the protocol I assume that DatagramProtocol would be an appropriate parent. I'm not sure of what the override exactly though, to drop in the right bits to request a file from a remote tftp server. Could someone point me in the right direction? Thanks, Mike -- Michael P. Soulier <msoulier(a)digitaltorque.ca> "Any intelligent fool can make things bigger and more complex... It takes a touch of genius - and a lot of courage to move in the opposite direction." --Albert Einstein

1 0

Re: Hilarious dream-logic (was Re: [Twisted-Python] [patch] (etc)
by glyph＠divmod.com 20 May '06

20 May '06

Well, I can't get to sleep, so here I go again... On Fri, 19 May 2006 06:18:18 +0200, Andrea Arcangeli <andrea(a)cpushare.com> wrote: >On Fri, May 19, 2006 at 03:15:40AM +0200, Terry Jones wrote: >> My impression is the following: Andrea, having not followed project >> guidelines and rules because he doesn't have the time, having not been >> treated like a coding God for whom others will naturally rush to do the >> mundane tasks in order to receive his patches, and being unwilling to go >> the extra few yards to get his patches (eventually) incorporated, is now >> using his formerly precious time to go out of his way to undermine the >> project. Thank you, Terry! It's nice to have a vote of confidence from the larger community. This is my impression exactly, and it is why I have become so rude. I write these replies for other people's benefit (they do nothing for me but make my blood pressure go up) and I'm happy to see they've been useful to someone. >My impression is that most of my fixes I did over the last years were >getting merged for some time. As far as I can tell things derailed when >I didn't like the fact that epsilon was becoming a dependency for nevow. Andrea, things derailed when you went from simply submitting mostly-useful fixes without tests to agressively badmouthing our developers, our quality-control process and a company (Divmod) that contributes heavily to Twisted and employs both the Twisted project lead (myself) and its most active maintainer (JP Calderone). The epsilon thing was a coincidence of timing, and as a matter of fact, I ultimately agreed with you on that particular point. ((An aside on the point of Divmod - yes, it is where I work, and yes, I am *very* offended at the characterization of the company as a bunch of control freaks trying to destroy Twisted. There are lots of companies that deserve scorn from the open source and free software communities, but Divmod not one of them. Divmod is an _impeccably_ good citizen of the open source world. We consider credibility with the technical people who make smart decisions like the use of Twisted extremely important. So important, in fact, that we have made a number of decisions to preserve that credibility, to fold things back upstream into the community, at considerable pain and expense to ourselves. Divmod has contributed more to Twisted than any other company at this point, period, and although I'm confident that is the right decision in the long run, we have had very few opportunities to reap any benefits from this good citizenship yet.)) Not only did you disregard and insult our quality control process, it was explicitly instituted to avoid applying patches like the callFromThread 'fix' which you insisted we apply. From my perspective, you seem to be actively trying to sabotage Twisted. (Your attitude certainly implies that you are.) For all we know, all your other patches are similarly broken and there is nothing to demonstrate otherwise. You say you have tracebacks? Produce those tracebacks in the context of a unit test, and I would be happy to discuss them. We're all generally open to constructive criticism - but not only did your comments not provide a realistic direction for improvement, they're not helpful even as flames because they are not based on truth. Below are some more repetitions of the same corrections I've been offering you for the last year. I see that you finally figured out that your callFromThread patch was buggy (after having been told a mere 5 times by 3 different people) so perhaps you will eventually figure the other stuff out and stop posting those, too. Given that everyone I've spoken with about your posts here is under the impression that you are trying to cause trouble, maybe you could take a step back and reconsider your tone. I am slow to anger and quick to forgive, but if you are really interested in participating in the community in a productive and useful way, you are going to have to stop posting insulting lies 3 or 4 times a day. >I was nevow user at the time. You think it's good that next time there >is a twisted bug you've to upgrade epsilon instead of upgrading twisted >in the first place? Upgrading twisted would fix the bug for _all_ apps >and not only the apps shipped by divmod. For those of you just tuning in, Epsilon is a Divmod utility package which includes certain things which are destined for inclusion in Twisted but which are still stabilizing, may not be a good idea, or depend on python features too recent for Twisted to use, such as Python 2.4. In particular, Andrea is referring to the fact that it may include "hot fixes" for Twisted functionality that Divmod products will be broken without, but which has not yet made it into a public release of Twisted. (The particular fix that Andrea was concerned might have been included in Epsilon and depended upon by Nevow was never actually necessary, and therefore not made. Epsilon was never actually a dependency of Nevow. Nevertheless, he continues to complain about it.) This practice was instituted so that Divmod projects could both work with older versions of Twisted (so that Divmod products may be installed on stable distributions with system-installed Twisted such as Debian or Ubuntu) and be released before parallel versions of Twisted were ready for release, as Twisted has a larger community and a more rigorous, slower, release process. Here is the process for including a "hot fix" in epsilon. I am not airing my opinion about how things should work here, I am stating a fact, as I am responsible for setting this policy, and there are only three hotfixes yet made in Epsilon and they have all followed this exact procedure: - Bug gets fixed **in Twisted SVN HEAD**, not in Epsilon. - It is submitted, tested, reviewed, merged to trunk. - Twisted release process begins. - Twisted fix gets copied into Epsilon. - Divmod projects are released with Epsilon, including the fix. - Twisted is released, with the fix. If you are interested, see the revision log here: http://divmod.org/trac/log/trunk/Epsilon/epsilon/hotfixes and compare with the various Twisted revisions / commit times that these fixes were applied in. These fixes will ALWAYS be contributed to Twisted. They are made in Twisted FIRST. The amount of time between the Epsilon release and the Twisted release will be kept to an absolute minimum. It is absolutely, completely untrue that we would ever deliberately make fixes to Twisted functionality and not contribute them back to the project. >When I noticed a combination of weirdness (to mention one more, the new >axiom api that cannot work with real DBMS in the async way because it >doesn't return deferreds) Another good way to convince people that you are not deliberately trying to cause trouble is to stop bringing up unrelated disagreements. The other things you are trying to talk about here have nothing to do with Axiom, and showcasing your ignorance in this fashion doesn't do much for your case. But, in the hopes of bringing some useful technical insight to this thread, I will correct your misconception here yet again. "real" RDBMSes have almost universally blocking interfaces; yet Twisted manages to make them "async" with adbapi. A similar simple threadpooling system could easily make Axiom "real"-RDBMS friendly; in fact, there are reasons it may be desirable for some application architectures even with SQLite. Per-thread isolation of store caches is fine; there is no reason the Store object has to be the same everywhere. This is another thing that I hope someone will contract Divmod to do, since Divmod as such doesn't need it, but it is abstractly interesting to me. However, as it turns out, the people using Axiom (and there are several) are mostly happy with its synchronous mode of operation and it turns out to be quite fast. Scaling is achieved differently than with other RDBMS systems, but that is a topic too complex to cover here. >So then I fail to see why twisted-web mailing list is on twistedmatrix >domain if only divmod projects like nevow should be discussed. Can you >provide a reasonable answer? I never asked cause I think I already knew >the answer. Nevow is the next version of *twisted*.web.woven, developed outside Twisted due to explicit community displeasure at the disparity between woven's breakneck and chaotic development pace and twisted.web's relatively sedate one. It was initially created by Donovan Preston, the same developer who wrote Woven, who was employed by Divmod at the time. It was done on Divmod time and for Divmod projects, because Woven was not working well enough. It is a Twisted-based technology through and through, and only works with twisted web on purpose. Cheetah is a template engine that can be used with multiple web servers and has nothing to do with Twisted. If someone wants to start a Twisted/Cheetah integration project and actually release some code, maybe people wouldn't mind so much if you talked about it. However, cheetah itself is not a "twisted web" technology, even if it's possible to use them together. (You can run PHP or Perl as a CGI under Twisted, but postings about PHP and Perl would similarly be off-topic.) >While I acknowledge I wasn't the best bugfix submitter (and obviously >I'm no coding God either), I'm definitely not trying to undermine >twisted, quite the opposite I'd like twisted to evolve and integrated >with not-invented-here technologies, but I fail to see how it can evolve >and integrate with cheetah or/and django in this environment. You'll notice that certain NIH technologies get a much better reception. For example, the recently announced sAsync <http://foss.eepatents.com/sAsync/> "competes" with Axiom, but nobody bothered Ed when he posted about it here. I'm not going to use SQLAlchemy, I don't particularly like it: but sAsync seems like a neat idea and I'm perfectly happy to see Twisted integrating with lots and lots of different third-party libraries that I am, personally, not interested in. In fact, we all love Ed, because he has promised to write some docs! (Hi Ed!) Here is an example of how to begin a release announcement. Ed's announcement began like this: "sAsync offers asynchronous access to the outstanding SQLAlchemy package by Michael Bayer." Notice how it begins with a compliment? Try that next time. >It would be great to talk about >these things if only we were allowed. I created the cpushare-twisted >list as a place to talk about those things that seems not appropriate to >talk about here. I'm sure that the bustling cpushare-twisted and web2/cheetah integration community appreciates your attention a lot more than this one. Perhaps you should go talk to them instead -- or maybe, as you keep saying you must do, write some code rather than trolling mailing lists. I seriously think you could have written comprehensive unit tests for all your patches in the time it's taken to write all these posts.

4 3

[Twisted-Python] trial and setUpClass
by Manlio Perillo 19 May '06

19 May '06

Hi. Just to be sure: setUpClass will be called *once* at the beginning of the TestCase? Thanks Manlio Perillo

2 6

RE: [Twisted-Python] A tcp server that handles many connections
by Deillon Thomas-WTD008 19 May '06

19 May '06

I just have a general question using python. It is possible that a python script will be a XmlRPC server on the port 5555 and at the same time a tcp-server on the port 6666 ? If yes. What I have to do to do a such thing ? Thanks, Thomas -----Original Message----- From: twisted-python-bounces(a)twistedmatrix.com [mailto:twisted-python-bounces@twistedmatrix.com] On Behalf Of Deillon Thomas-WTD008 Sent: 19 May 2006 14:16 To: Twisted general discussion Subject: RE: [Twisted-Python] A tcp server that handles many connections Ok, thanks to both of you Thomas -----Original Message----- From: twisted-python-bounces(a)twistedmatrix.com [mailto:twisted-python-bounces@twistedmatrix.com] On Behalf Of Andrew Bennetts Sent: 19 May 2006 14:08 To: Twisted general discussion Subject: Re: [Twisted-Python] A tcp server that handles many connections On Fri, May 19, 2006 at 12:58:34PM +0200, Johann Borck wrote: [...] > > and if you're looking for "real world" apps using twisted... uups > can't find that page right now (does it still exist?) ahem, look at > divmod.org :) You're probably thinking of this: http://twistedmatrix.com/trac/wiki/ProjectsUsingTwisted And maybe this: http://twistedmatrix.com/trac/wiki/SuccessStories -Andrew. _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

2 1

RE: [Twisted-Python] A tcp server that handles many connections
by Deillon Thomas-WTD008 19 May '06

19 May '06

Ok, thanks to both of you Thomas -----Original Message----- From: twisted-python-bounces(a)twistedmatrix.com [mailto:twisted-python-bounces@twistedmatrix.com] On Behalf Of Andrew Bennetts Sent: 19 May 2006 14:08 To: Twisted general discussion Subject: Re: [Twisted-Python] A tcp server that handles many connections On Fri, May 19, 2006 at 12:58:34PM +0200, Johann Borck wrote: [...] > > and if you're looking for "real world" apps using twisted... uups > can't find that page right now (does it still exist?) ahem, look at > divmod.org :) You're probably thinking of this: http://twistedmatrix.com/trac/wiki/ProjectsUsingTwisted And maybe this: http://twistedmatrix.com/trac/wiki/SuccessStories -Andrew. _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

1 0

RE: [Twisted-Python] A tcp server that handles many connections
by Deillon Thomas-WTD008 19 May '06

19 May '06

I will maybe be give more information. What I wanted to do for the moment is to begin, a server and two clients. Each client open a connection with the server and wait. The server, send "client1" to the client 1 waiting a random time between each sending and the same thing with the client 2. The final aim is to send different information to each client. The information will be given by a other processus via a pipe or something like this. Hope it's more clear, Thomas ________________________________ From: twisted-python-bounces(a)twistedmatrix.com [mailto:twisted-python-bounces@twistedmatrix.com] On Behalf Of Deillon Thomas-WTD008 Sent: 19 May 2006 10:39 To: twisted-python(a)twistedmatrix.com Subject: [Twisted-Python] A tcp server that handles many connections Hi, I'm looking for a solution to make a server that handle many tcp connections and where I can send different information to each one. I read that twisted is maybe a good way to do this. Can you confirm that it's a better way to learn twisted than to try with Socket Server ? And if maybe you have a sample to help me to understand the basic thing... thks Thanks a lot for your help, Thomas

3 2

[Twisted-Python] A tcp server that handles many connections
by Deillon Thomas-WTD008 19 May '06

19 May '06

Hi, I'm looking for a solution to make a server that handle many tcp connections and where I can send different information to each one. I read that twisted is maybe a good way to do this. Can you confirm that it's a better way to learn twisted than to try with Socket Server ? And if maybe you have a sample to help me to understand the basic thing... thks Thanks a lot for your help, Thomas

2 1

[Twisted-Python] Binding a twisted application to only one interface
by Christian Schneider 19 May '06

19 May '06

Hi all, I have written a service as shown below. Now, I'd like this service to only be available on one specific network interface but have been unable to find any documentation on how to achieve that. Any hints or pointers would be very welcome. chris from twisted.application import service from jobsservice import JobsService from twisted.internet import reactor class JobsService(internet.TCPServer): def __init__(self): internet.TCPServer.__init__(self, 8000, JobsFactory(self)) application = service.Application("Jobs") serviceCollection = service.IServiceCollection(application) jobsService = JobsService() jobsService.setServiceParent(serviceCollection)

2 1

[Twisted-Python] Twisted Sprint in Australia
by Jonathan Lange 19 May '06

19 May '06

Hello, I reckon it's about time for another AU sprint. The likely locations are Sydney or Melbourne, and the likely dates are any weekend in May, the first weekend of June or the last weekend of June. Topics are as yet undecided. I intend to remove wait() entirely. I tentatively suggest that the Sprint be: - In Sydney - June 24-25 (patches accepted) Can you make it? Reply today! cheers, jml

5 7

Twisted May 2006