Mailman 3 March 2005 - Twisted

[Twisted-Python] Twisted a4 releases
by Christopher Armstrong March 20, 2005

March 20, 2005

I released a4 tonight, which includes fixes for all known release-critical issues, notably the problem with installing on Python 2.2. Please take a look and verify that this release is worthy of going out For Real. Also thanks to Tim Stebbing for pushing the Big Red Release Button and providing his dialup connection for the release tonight ;-) http://twistedmatrix.com/projects/ -- Twisted | Christopher Armstrong: International Man of Twistery Radix | -- http://radix.twistedmatrix.com | Release Manager, Twisted Project \\\V/// | -- http://twistedmatrix.com |o O| | Founding Member, Hobart Hacking Society w----v----w-+ -- http://hackingsociety.org/chapters/hash

1 0

[Twisted-Python] Twisted website redesign
by Lenny G Arbage March 19, 2005

March 19, 2005

I don't see that anyone else has mentioned this, and it has been broken for several days, so I thought the interested parties might want to know that: 1- links to project mailing lists from the project pages are wrong ("No such Resource. File not found"). Links from the main page do work, however. 2- links to documentation don't include links to the API docs. The API docs are still there if you have a bookmark or ask google, but I can't see any way to find them from the website. Other than that, the site looks great! I'd send this to the site maintainer instead of posting it to the mailing list, but I can't seem to find an email link on the site for that either. thanks, Lenny G. __________________________________ Do you Yahoo!? Yahoo! Small Business - Try our new resources site! http://smallbusiness.yahoo.com/resources/

3 3

[Twisted-Python] Weekly Bug Summary
by James Y Knight March 19, 2005

March 19, 2005

Bug summary ______________________ Since 2005-03-14 22:20:50.500000: Bugs opened: 17 Bugs closed: 10 Total open bugs: 333 (+7) Urgent: 7 (-2) Bug: 127 (+9) Feature: 131 (+0) Wish: 68 (+0) New / Reopened Bugs ______________________ ==== Urgent ==== BUG: Installer raises exception for Python 2.2 (yesterday) http://twistedmatrix.com/bugs/issue933 opened by exarkun [WORDS, XISH] [PATCH] cleanup of docs and imports for xish and words/protocols/jabber (yesterday) CLOSED http://twistedmatrix.com/bugs/issue935 opened by ralphm [PATCH] xmlstream ConnectAuthenticator bails on self.streamHost of type unicode (4 days ago) CLOSED http://twistedmatrix.com/bugs/issue924 opened by ralphm [PATCH] mktap is broken with new plugin system (4 days ago) CLOSED http://twistedmatrix.com/bugs/issue923 opened by radix ==== Bug ==== [XISH] restore priority sorting in xish/xpath.py (yesterday) http://twistedmatrix.com/bugs/issue934 opened by ralphm [WEBSITE] Sort out redirects from old products website hierachy (4 hours ago) http://twistedmatrix.com/bugs/issue938 opened by hypatia [PAIR, WEBSITE] Add description of pair to its project site (6 hours ago) http://twistedmatrix.com/bugs/issue937 opened by hypatia [WEBSITE] minor website rendering problem (yesterday) http://twistedmatrix.com/bugs/issue936 opened by teratorn [WEBSITE, XISH] Add description of xish to its project site (2 days ago) http://twistedmatrix.com/bugs/issue932 opened by hypatia [WEBSITE, WORDS] Add description of words to its project site (2 days ago) http://twistedmatrix.com/bugs/issue931 opened by hypatia [RUNNER, WEBSITE] Add description of runner to its project site (2 days ago) http://twistedmatrix.com/bugs/issue930 opened by hypatia [WEB, WEBSITE] Add description of Twisted Web to its project site (2 days ago) http://twistedmatrix.com/bugs/issue927 opened by hypatia [FLOW, WEBSITE] Add description of flow to its project site (2 days ago) http://twistedmatrix.com/bugs/issue929 opened by hypatia [LORE, WEBSITE] Add description of lore to its project site (2 days ago) http://twistedmatrix.com/bugs/issue928 opened by hypatia "which: no dia" error when running mktap names (2 days ago) http://twistedmatrix.com/bugs/issue926 opened by justinj t.test.test_plugin doesn't work in "deployed" mode (3 days ago) http://twistedmatrix.com/bugs/issue925 opened by marienz Bugs Closed ______________________ ==== Urgent ==== [WEBSITE] Website needs to be suitable for 2.0 (5 months ago) http://twistedmatrix.com/bugs/issue728 opened by hypatia, closed by radix [WORDS, XISH] [PATCH] cleanup of docs and imports for xish and words/protocols/jabber (yesterday) http://twistedmatrix.com/bugs/issue935 opened by ralphm, closed by dizzyd [PATCH] xmlstream ConnectAuthenticator bails on self.streamHost of type unicode (4 days ago) http://twistedmatrix.com/bugs/issue924 opened by ralphm, closed by dizzyd win32: reactor.spawnProcess does not grant permission to open sockets (2 months ago) http://twistedmatrix.com/bugs/issue837 opened by stefanomasini, closed by exarkun [PATCH] mktap is broken with new plugin system (4 days ago) http://twistedmatrix.com/bugs/issue923 opened by radix, closed by exarkun ==== Bug ==== MANIFEST.in misses files (9 months ago) http://twistedmatrix.com/bugs/issue629 opened by cmg, closed by radix [PATCH] rename xish.xpath's intern to internQuery (2 weeks ago) http://twistedmatrix.com/bugs/issue913 opened by ralphm, closed by dizzyd protocols/jabber/jid refers to jid.intern(), should be plain intern() (8 months ago) http://twistedmatrix.com/bugs/issue656 opened by ralphm, closed by dizzyd [XISH] [PATCH] twisted.xish.domish.elementStream fails to parse xml (12 months ago) http://twistedmatrix.com/bugs/issue530 opened by naz, closed by dizzyd

1 0

[Twisted-Python] enable ports 0-1023 to plain users
by Andrzej Leszczynski March 19, 2005

March 19, 2005

Hi, I need a help. In particural I need to allow plain users under Linux to run SMTP servers (in Python) under 25. Is there any way to remap it to the over 1024 space or just enable (without hacking the kernel). The varoius sudo or permissions solutions are not an options for me. Thanks in advance, A.

2 4

[Twisted-Python] Synchronous Wrapper for Deferreds
by Ken Kinder March 19, 2005

March 19, 2005

A day or two ago, I inquired on IRC about making calls from an existing synchronous script. The script is not related to any Twisted activity, so minimal intervention was sort of a goal. Obviously this doesn't work on non-transient objects such as Perspective Broker ones, but here's what I came up with... (See attached) Obviously there is some cleaning up to do, but it demonstrates the idea. I have three questions: (1) I know this isn't the ideal way to use Twisted, but is there anything inherently problematic about my solution for one-off calls to Twisted. (2) I understand there are problems with running the same reactor twice. What are those problems and is there a recommended work around? (3) Are there any ideas on making a synchronous version of a Perspective Broker client to integrate into existing synchronous applications more easily? Thanks -Ken

4 4

[Twisted-Python] listening on several ports
by Sinang, Danny March 19, 2005

March 19, 2005

Hello, How do I make a server listen in on several ports ? As far as I know, reactor.listenTCP() only accepts 1 port parameter. Regards, Danny

2 1

[Twisted-Python] both 'package' and 'py_modules'
by Judson Bishop March 18, 2005

March 18, 2005

All, Having trouble building Twisted on RHEL 3. Using python-2.2.3-6.1. # python setup.py build running build running build_py error: build_py: supplying both 'packages' and 'py_modules' options is not allowed Error: Subprocess exited with result 1 for project core Any help would be appreciated. Jud

2 1

[Twisted-Python] help with ssl timeout and not reconnecting client factory
by Andrea Arcangeli March 18, 2005

March 18, 2005

>From a client I'm getting this error: 2005/03/16 10:42 CET [cpushare_protocol,client] 'limit sell' 2005/03/17 06:31 CET [cpushare_protocol,client] Traceback (most recent call last): File "/usr/lib64/python2.3/site-packages/twisted/python/log.py", line 65, in callWithLogger callWithContext({"system": lp}, func, *args, **kw) File "/usr/lib64/python2.3/site-packages/twisted/python/log.py", line 52, in callWithContext return context.call({ILogContext: newCtx}, func, *args, **kw) File "/usr/lib64/python2.3/site-packages/twisted/python/context.py", line 43, in callWithContext return func(*args,**kw) File "/usr/lib64/python2.3/site-packages/twisted/internet/pollreactor.py", line 160, in _doReadOrWrite why = selectable.doRead() --- <exception caught here> --- File "/usr/lib64/python2.3/site-packages/twisted/internet/tcp.py", line 98, in doRead return Connection.doRead(self) File "/usr/lib64/python2.3/site-packages/twisted/internet/tcp.py", line 239, in doRead data = self.socket.recv(self.bufferSize) OpenSSL.SSL.SysCallError: (110, 'Connection timed out') 2005/03/17 06:31 CET [cpushare_protocol,client] <twisted.internet.ssl.Connector instance at 0x2aaaac28d950> will retry in 2 s econds 2005/03/17 06:31 CET [cpushare_protocol,client] Stopping factory <cpushare.proto.cpushare_factory instance at 0x2aaaad414290> 2005/03/17 06:31 CET [-] Starting factory <cpushare.proto.cpushare_factory instance at 0x2aaaad414290> 2005/03/17 06:31 CET [-] Connection failed. Reason: [Failure instance: Traceback: twisted.internet.error.TimeoutError, User t imeout caused connection failure. 2005/03/17 06:31 CET [-] ] 2005/03/17 06:31 CET [-] Stopping factory <cpushare.proto.cpushare_factory instance at 0x2aaaad414290> This is a reconnecting client factory, the python version is 2.3.4 and twisted version is 1.3.0a. The socket should sit in a idle state. No communication over that socket will happen (the app is under development), but it should not go in timeout unless the connection with the server ends and the keepalive events triggers a disconnect (I enabled keepalive on the tcp level). Even if it goes in timeout it must try to reconnect immediatly while it seems like it's hanging after the "Stopping factory". Earlier when I got the connection timed out event (for no apparent good reason) at least it was immediatly trying to reconnect: 2005/03/14 05:30 CET [cpushare_protocol,client] 'limit sell' 2005/03/14 17:59 CET [cpushare_protocol,client] Traceback (most recent call last): File "/usr/lib64/python2.3/site-packages/twisted/python/log.py", line 65, in callWithLogger callWithContext({"system": lp}, func, *args, **kw) File "/usr/lib64/python2.3/site-packages/twisted/python/log.py", line 52, in callWithContext return context.call({ILogContext: newCtx}, func, *args, **kw) File "/usr/lib64/python2.3/site-packages/twisted/python/context.py", line 43, in callWithContext return func(*args,**kw) File "/usr/lib64/python2.3/site-packages/twisted/internet/pollreactor.py", line 160, in _doReadOrWrite why = selectable.doRead() --- <exception caught here> --- File "/usr/lib64/python2.3/site-packages/twisted/internet/tcp.py", line 98, in doRead return Connection.doRead(self) File "/usr/lib64/python2.3/site-packages/twisted/internet/tcp.py", line 239, in doRead data = self.socket.recv(self.bufferSize) OpenSSL.SSL.SysCallError: (110, 'Connection timed out') 2005/03/14 17:59 CET [cpushare_protocol,client] <twisted.internet.ssl.Connector instance at 0x2aaaac28d950> will retry in 2 s econds 2005/03/14 17:59 CET [cpushare_protocol,client] Stopping factory <cpushare.proto.cpushare_factory instance at 0x2aaaad414290> 2005/03/14 17:59 CET [-] Starting factory <cpushare.proto.cpushare_factory instance at 0x2aaaad414290> So my first priority is to understand why it stopped trying to reconnect (which is the major bug) and the second priority is to understand why it was going in timeout in the first place. (I can't exclude there have been a temporary network disruption that caused the keepalive to trigger the disconnect.) Could this be a bug in 1.3.0a? I expect the client will be mostly run with 1.3.0a, only on the server side I use SVN + pending fixes. This is the reconnecting code: class cpushare_factory(ReconnectingClientFactory): maxDelay = 600 # limit the maximum delay to 10 min protocol = cpushare_protocol def buildProtocol(self, addr): self.resetDelay() protocol = self.protocol() assert not hasattr(protocol, 'factory') protocol.factory = self return protocol def clientConnectionFailed(self, connector, reason): print 'Connection failed. Reason:', reason ReconnectingClientFactory.clientConnectionFailed(self, connector, reason) def connectionMade(self): self.transport.setTcpKeepAlive(1) Is the above correct? It works fine when the connection failed reason is "ConnectionRefusedError" instead of TimeoutError. What else should I do to prevent this error to leave the factory stopped? 2005/03/17 06:31 CET [-] Connection failed. Reason: [Failure instance: Traceback: twisted.internet.error.TimeoutError, User t imeout caused connection failure. Where does the "twisted.internet.error.TimeoutError" come from? The full source is LGPL and downloadable here: https://www.cpushare.com/downloads/cpushare-0.11.tar.bz2 The server side logs are absolutely not-interesting, all I get is a connectionLost event without any apparent error (server side is SVN-trunk). Any help is greatly appreciated, thanks!

3 5

Re: [Twisted-Python] newbie: scheduling/queuing tasks with xmlrpc
by Jp Calderone March 18, 2005

March 18, 2005

On Thu, 17 Mar 2005 10:29:09 -0700, Dustin Lee <qhfgva(a)gmail.com> wrote: >So I've got a simple prototype of what I'm trying to achieve with my > "queued tasks" xmlrpc server. > > I'd appreciate any comments, suggestions. So far it seems to work > exactly I wanted but I have a feeling I'm abusing the intended use of > deferreds. And that by polling I'm deviating from the twisted > workflow model. But you have to start somewhere. Yes, much abuse is present in this code. A couple grievous wrongs: Deferreds (and almost all other Twisted APIs) are not thread-safe. You cannot invoke their methods in a thread other than that of the reactor. The called and paused Deferred attributes are not really public. You should avoid using them if at all possible (and it almost always is). Likewise, the pause() and unpause() methods are more for the convenience of Deferred's implementation and you should never need to call them. Attached is a modified version. It has a problem with shutdown, which I imagine is related to not properly closing the reactor's threadpool. Maybe someone else can suggest the correct way to deal with that. Jp

3 2

RE: [Twisted-Python] help with InsecureJelly for unkown objects inclasses
by Henning.Ramm＠mediapro-gmbh.de March 17, 2005

March 17, 2005

>twisted.spread.jelly.InsecureJelly: Type not allowed for object: <type >'Rect'> <rect(0, 0, 32, 32)> That's not related to pygame, but general pb behaviour. See my question about "declare pb.Copyable once" and look at this howto: http://twistedmatrix.com/documents/current/howto/pb-copyable Best regards, Henning Hraban Ramm Südkurier Medienhaus / MediaPro Support/Admin/Development Dept.

3 3