Mailman 3 June 2007 - Twisted

[Twisted-Python] Mailing list or RSS feed of trunk commits?
by Jonathan Lange 11 Jun '07

11 Jun '07

Hello all, Is there a mailing list or RSS feed of commits to trunk? If so, how do I get at it? Thanks, jml

2 1

[Twisted-Python] Still problems debugging with twisted...
by Simon Pickles 10 Jun '07

10 Jun '07

Hi, I've still got my problem with zope and twisted: [Dbg]>>> Traceback (most recent call last): File "<string>", line 97, in run File "C:\Python25\lib\bdb.py", line 366, in run exec cmd in globals, locals File "F:\_Dev\twisted server 20070608\SERVER.py", line 7, in <module> import twistedServer File "F:\_Dev\twisted server 20070608\twistedServer.py", line 4, in <module> from zope.interface import Interface File "C:\Python25\lib\site-packages\zope\interface\__init__.py", line 58, in <module> _wire() File "C:\Python25\lib\site-packages\zope\interface\interface.py", line 936, in _wire classImplements(Attribute, IAttribute) File "C:\Python25\lib\site-packages\zope\interface\declarations.py", line 464, in classImplements spec = implementedBy(cls) File "C:\Python25\lib\site-packages\zope\interface\declarations.py", line 330, in implementedByFallback if isinstance(spec, Implements): TypeError: isinstance() arg 2 must be a class, type, or tuple of classes and types Strangely, if I run the python module from file or python command window it runs perfectly fine, no tracebacks. It only crashes like this when run within PyScripter. Very annoying since thats my favourite IDE. I've installed zope.interface-3.3.0.1-win32.egg from the python cheeseshop using easy_install. No Change. Still can't debug. Thanks for your help. Simon _________________________________________________________________ Play your part in making history - Email Britain! http://www.emailbritain.co.uk/

2 1

[Twisted-Python] Socket number
by Simon Pickles 10 Jun '07

10 Jun '07

Hello, In my C++ game server, I used the socket number as the temporary ID of the connected player. Is there anyway to retrieve the socket number of a new player? Atm, I am just using self.transport.getPeer().host, but this is only the IP address, not socket. Thanks Simon _________________________________________________________________ The next generation of Hotmail is here! http://www.newhotmail.co.uk/

5 4

[Twisted-Python] implementing an adbapi connectionpool idle timer
by Phil Mayers 10 Jun '07

10 Jun '07

All, I'm using t.e.adbapi with psycopg against a Postgres 8 database. This database is replicated using Slony-I and I'm hitting this problem: http://linuxfinances.info/info/faq.html#AEN45927 Basically, holding open SQL connections for a long time causes postgres to cache query plans; these cached plans need to be freed for Slony to rollover its internal SQL replication log table. So I'd like to add something to ConnectionPool to disconnect unused connections after a certain time. Any suggestions how to start? Also - looking at the ConnectionPool/Transaction code, it appears a ConnectionPool's "connections" dictionary is modified from multiple threads without locking. Is this safe?

2 2

Re: [Twisted-Python] Asynchronicity
by Simon Pickles 10 Jun '07

10 Jun '07

Just to point out, iterate() does seem to run a loop of reactor, before returning. No call to run() is required. This is contrary to the API docs. Why would iterate() be a dead end, jean? Simon Pickles wrote: >Wow! it works... iterate does indeed return. Must've had a small mistake >before! > >I am amazed I solved my own problem for a change! > >Thanks for the advice, Jean > >Simon Pickles wrote: >>Integrating into a GUI is just one example. In my case, I am using >>Tkinter on win32. The GUI will be switched off when the server is >>running, its simply a debug controller... >> >>I'm more interested in how a twisted server manages to perform any other >>logic. For a game server, a fair amount of time needs to be devoted to >>object and memory management, AI, database access etc >> >>My first server, in C++ could do this simply, with a winSock thread >>listening and storing incoming network comms in a message queue. Easily >>integrated into a game loop. >> >>I was tempted to move to python due to the ease of modification. >> >>So... with twisted, how can I manage to spend any time doing AI, for >>instance? >> >>I thought twisted.interface.reactor.iterate() might be my answer. API >>docs say about iterate: >> >>"Run the main loop's I/O polling function for a period of time. This is >>most useful in applications where the UI is being drawn "as fast as >>possible", such as games." >> >>Unfortunately, the next sentence seems a little contradictory.... >> >>" The reactor must have been started (via the run() method) prior to any >>invocations of this method. It must also be stopped manually after the >>last call to this method (via the stop() method). " >> >>Now, I am only a beginner at twisted, but it looks to me if I called >>run(), I won't have a chance to call iterate() cos twisted will have >>gone into its mainloop and stolen all control! >> >>Am i making sense? >> >>Regards >> >>Simon >> >> >>Jean-Paul Calderone wrote: >>>On Sat, 09 Jun 2007 16:09:29 +0100, Simon Pickles <sipickles(a)hotmail.com> >>>wrote: >>>>Hi, >>>> >>>>I have managed to get a simple server going. It seems to accept multiple >>>>connections correctly. >>>> >>>>I am a little puzzled as to how to achieve an asynchonous application >>>>using twisted. Twisted itself seems asynchronous, but my code is blocked >>>>by the call: >>>> >>>>reactor.run() >>>> >>> >>>Quite so. reactor.run enters the Twisted mainloop and does not return >>>until the mainloop is stopped (via reactor.stop). >>> >>>>Is there anyway I can return from the reactor to run other code, like >>>>GUI stuff, or other processing? >>> >>>No, but you can call into your other code from Twisted event handlers or >>>you can write a custom reactor which integrates an existing mainloop with >>>Twisted's. As far as GUIs go, Twisted already includes reactors which >>>integrate glib, gtk, gtk2, various kinds of Windows loops, wxPython, and >>>a few others. >>> >>>Precisely how you integrate two mainloops depends on various details >>>about the loops in question. Which GUI library are you trying to >>>integrate with? >>> >>>Jean-Paul >>> >>>_______________________________________________ >>>Twisted-Python mailing list >>>Twisted-Python(a)twistedmatrix.com >>>http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python >>> >>> >>> >> >>_________________________________________________________________ >>The next generation of Hotmail is here! http://www.newhotmail.co.uk >> >> >>_______________________________________________ >>Twisted-Python mailing list >>Twisted-Python(a)twistedmatrix.com >>http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python >> >> >> > >_________________________________________________________________ >Play your part in making history - Email Britain! >http://www.emailbritain.co.uk/ > > >_______________________________________________ >Twisted-Python mailing list >Twisted-Python(a)twistedmatrix.com >http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python > > > _________________________________________________________________ The next generation of Hotmail is here! http://www.newhotmail.co.uk

2 1

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 09 Jun '07

09 Jun '07

Bug summary ______________________ Summary for 2007-06-03 through 2007-06-10 Bugs opened: 15 Bugs closed: 10 Total open bugs: 974 (+5) |== Type Changes |== Priority Changes |== Component Changes |Defect: +6 |Highest: -4 |Conch: +1 |Enhancement: +0 |High: +1 |Core: +3 |Task: -1 |Normal: +7 |Mail: +2 |Low: +2 |Runner: +1 |Lowest: -1 |Trial: +1 |Web2: -1 |Words: -2 New / Reopened Bugs ______________________ ===== Highest ===== [#2688] isIPAddress has no unit tests (opened by exarkun) (CLOSED, fixed) defect core http://twistedmatrix.com/trac/ticket/2688 [#2691] internet.task.Clock.callLater does not fulfill IReactorTime.callLater contract (opened by washort) (CLOSED, fixed) defect core http://twistedmatrix.com/trac/ticket/2691 [#2700] IMAP4Client.lineReceived() fails to parse literals (opened by jenner) defect mail http://twistedmatrix.com/trac/ticket/2700 [#2701] twisted.words.xish.yappsrt.Scanner.__init__ is not proper epytext (opened by therve) defect core http://twistedmatrix.com/trac/ticket/2701 [#2702] twisted.words.xish.yappsrt.Scanner.__init__ is not proper epytext (opened by therve) defect core http://twistedmatrix.com/trac/ticket/2702 ===== High ===== [#2698] Build Bug on Cygwin (opened by donfanning) defect core http://twistedmatrix.com/trac/ticket/2698 ===== Normal ===== [#2689] twisted.test.test_assertions is lonely (opened by exarkun) defect trial http://twistedmatrix.com/trac/ticket/2689 [#2690] assertRaises can accept a sequence of exceptions as first parameter, but errors if assertion fails (opened by jml) defect trial http://twistedmatrix.com/trac/ticket/2690 [#2692] before-shutdown triggers are fired multiple times (opened by yaubi) defect core http://twistedmatrix.com/trac/ticket/2692 [#2693] procmon.DummyTransport doesn't implement ITransport and is pretty much completely bogus. (opened by dreid) defect runner http://twistedmatrix.com/trac/ticket/2693 [#2695] IMAP4Client breaks if server uses CONDSTORE (opened by slamb) defect mail http://twistedmatrix.com/trac/ticket/2695 [#2696] amp.AmpList cannot serialize [] (opened by Lacrymology) defect core http://twistedmatrix.com/trac/ticket/2696 [#2697] web2's access log should include the username for requests authenticated with twisted.web2.auth.wrapper (opened by dreid) enhancement web2 http://twistedmatrix.com/trac/ticket/2697 ===== Low ===== [#2694] ITerminalProtocol.terminalSize should take a winsize object (opened by exarkun) enhancement conch http://twistedmatrix.com/trac/ticket/2694 [#2699] UDP DatagramProtocol reconnecting (opened by Vazde) enhancement core http://twistedmatrix.com/trac/ticket/2699 Closed Bugs ______________________ ===== Highest ===== [#2654] twisted.internet.abstract.isIPAddress rejects valid IPv4 strings (opened by exarkun, closed by exarkun, wontfix) defect core http://twistedmatrix.com/trac/ticket/2654 [#2691] internet.task.Clock.callLater does not fulfill IReactorTime.callLater contract (opened by washort, closed by washort, fixed) defect core http://twistedmatrix.com/trac/ticket/2691 [#2612] Deferreds not returned in web2 test_wsgi (opened by karlb, closed by therve, fixed) defect web2 http://twistedmatrix.com/trac/ticket/2612 [#2626] trial needs something to check DeprecationWarning (opened by therve, closed by therve, fixed) enhancement trial http://twistedmatrix.com/trac/ticket/2626 [#2688] isIPAddress has no unit tests (opened by exarkun, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/2688 [#2502] 'and' and 'or' operator suport for xpath (opened by jack, closed by ralphm, fixed) enhancement words http://twistedmatrix.com/trac/ticket/2502 [#2630] XMPP stream error conditions incorrectly qualified. (opened by njoyce, closed by ralphm, fixed) defect words http://twistedmatrix.com/trac/ticket/2630 [#1042] Add blockingCallFromThread to twisted.internet.threads (opened by spiv, closed by therve, fixed) enhancement core http://twistedmatrix.com/trac/ticket/1042 [#2536] Deprecated TimeoutQueue so we can remove it (opened by exarkun, closed by therve, fixed) task core http://twistedmatrix.com/trac/ticket/2536 ===== Lowest ===== [#1724] twisted.web2.auth doesn't address multi-step authentication (opened by dreid, closed by dreid, invalid) defect web2 http://twistedmatrix.com/trac/ticket/1724

1 0

Re: [Twisted-Python] Asynchronicity
by Simon Pickles 09 Jun '07

09 Jun '07

Integrating into a GUI is just one example. In my case, I am using Tkinter on win32. The GUI will be switched off when the server is running, its simply a debug controller... I'm more interested in how a twisted server manages to perform any other logic. For a game server, a fair amount of time needs to be devoted to object and memory management, AI, database access etc My first server, in C++ could do this simply, with a winSock thread listening and storing incoming network comms in a message queue. Easily integrated into a game loop. I was tempted to move to python due to the ease of modification. So... with twisted, how can I manage to spend any time doing AI, for instance? I thought twisted.interface.reactor.iterate() might be my answer. API docs say about iterate: "Run the main loop's I/O polling function for a period of time. This is most useful in applications where the UI is being drawn "as fast as possible", such as games." Unfortunately, the next sentence seems a little contradictory.... " The reactor must have been started (via the run() method) prior to any invocations of this method. It must also be stopped manually after the last call to this method (via the stop() method). " Now, I am only a beginner at twisted, but it looks to me if I called run(), I won't have a chance to call iterate() cos twisted will have gone into its mainloop and stolen all control! Am i making sense? Regards Simon Jean-Paul Calderone wrote: >On Sat, 09 Jun 2007 16:09:29 +0100, Simon Pickles <sipickles(a)hotmail.com> >wrote: >>Hi, >> >>I have managed to get a simple server going. It seems to accept multiple >>connections correctly. >> >>I am a little puzzled as to how to achieve an asynchonous application >>using twisted. Twisted itself seems asynchronous, but my code is blocked >>by the call: >> >>reactor.run() >> > >Quite so. reactor.run enters the Twisted mainloop and does not return >until the mainloop is stopped (via reactor.stop). > >>Is there anyway I can return from the reactor to run other code, like >>GUI stuff, or other processing? > >No, but you can call into your other code from Twisted event handlers or >you can write a custom reactor which integrates an existing mainloop with >Twisted's. As far as GUIs go, Twisted already includes reactors which >integrate glib, gtk, gtk2, various kinds of Windows loops, wxPython, and >a few others. > >Precisely how you integrate two mainloops depends on various details >about the loops in question. Which GUI library are you trying to >integrate with? > >Jean-Paul > >_______________________________________________ >Twisted-Python mailing list >Twisted-Python(a)twistedmatrix.com >http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python > > > _________________________________________________________________ The next generation of Hotmail is here! http://www.newhotmail.co.uk

3 2

Re: [Twisted-Python] Asynchronicity
by Simon Pickles 09 Jun '07

09 Jun '07

Wow! it works... iterate does indeed return. Must've had a small mistake before! I am amazed I solved my own problem for a change! Thanks for the advice, Jean Simon Pickles wrote: >Integrating into a GUI is just one example. In my case, I am using >Tkinter on win32. The GUI will be switched off when the server is >running, its simply a debug controller... > >I'm more interested in how a twisted server manages to perform any other >logic. For a game server, a fair amount of time needs to be devoted to >object and memory management, AI, database access etc > >My first server, in C++ could do this simply, with a winSock thread >listening and storing incoming network comms in a message queue. Easily >integrated into a game loop. > >I was tempted to move to python due to the ease of modification. > >So... with twisted, how can I manage to spend any time doing AI, for >instance? > >I thought twisted.interface.reactor.iterate() might be my answer. API >docs say about iterate: > >"Run the main loop's I/O polling function for a period of time. This is >most useful in applications where the UI is being drawn "as fast as >possible", such as games." > >Unfortunately, the next sentence seems a little contradictory.... > >" The reactor must have been started (via the run() method) prior to any >invocations of this method. It must also be stopped manually after the >last call to this method (via the stop() method). " > >Now, I am only a beginner at twisted, but it looks to me if I called >run(), I won't have a chance to call iterate() cos twisted will have >gone into its mainloop and stolen all control! > >Am i making sense? > >Regards > >Simon > > >Jean-Paul Calderone wrote: >>On Sat, 09 Jun 2007 16:09:29 +0100, Simon Pickles <sipickles(a)hotmail.com> >>wrote: >>>Hi, >>> >>>I have managed to get a simple server going. It seems to accept multiple >>>connections correctly. >>> >>>I am a little puzzled as to how to achieve an asynchonous application >>>using twisted. Twisted itself seems asynchronous, but my code is blocked >>>by the call: >>> >>>reactor.run() >>> >> >>Quite so. reactor.run enters the Twisted mainloop and does not return >>until the mainloop is stopped (via reactor.stop). >> >>>Is there anyway I can return from the reactor to run other code, like >>>GUI stuff, or other processing? >> >>No, but you can call into your other code from Twisted event handlers or >>you can write a custom reactor which integrates an existing mainloop with >>Twisted's. As far as GUIs go, Twisted already includes reactors which >>integrate glib, gtk, gtk2, various kinds of Windows loops, wxPython, and >>a few others. >> >>Precisely how you integrate two mainloops depends on various details >>about the loops in question. Which GUI library are you trying to >>integrate with? >> >>Jean-Paul >> >>_______________________________________________ >>Twisted-Python mailing list >>Twisted-Python(a)twistedmatrix.com >>http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python >> >> >> > >_________________________________________________________________ >The next generation of Hotmail is here! http://www.newhotmail.co.uk > > >_______________________________________________ >Twisted-Python mailing list >Twisted-Python(a)twistedmatrix.com >http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python > > > _________________________________________________________________ Play your part in making history - Email Britain! http://www.emailbritain.co.uk/

1 0

[Twisted-Python] Asynchronicity
by Simon Pickles 09 Jun '07

09 Jun '07

Hi, I have managed to get a simple server going. It seems to accept multiple connections correctly. I am a little puzzled as to how to achieve an asynchonous application using twisted. Twisted itself seems asynchronous, but my code is blocked by the call: reactor.run() Is there anyway I can return from the reactor to run other code, like GUI stuff, or other processing? My code: import GUI from zope.interface import Interface from twisted.internet import reactor from twisted.protocols import basic from twisted.internet.protocol import Protocol, Factory class CNetwork(basic.LineReceiver): def connectionMade(self): GUI.Print("New Client: %s" % self.transport.getPeer().host) self.send = lambda x: self.transport.write(x+"\r\n") ## if self.factory.server_data: ## self.send("\r\n".join(self.factory.server_data)) ## else: ## self.send("You are logged in") GUI.Print("Entering loop for client %s" % self.transport.getPeer().host) def connectionLost(self, reason): GUI.Print( "%s has closed the connection" % self.transport.getPeer().host ) def dataReceived(self, data): data = data.strip() if not data: self.transport.loseConnection() return GUI.Print("%s says %r" % (self.transport.getPeer().host,data)) self.transport.write("You said: %r\r\n" % data ) ## self.factory.server_data.append(data + "~~") GUI.Print("Ready to receive more data") class CNetworkFactory(Protocol): factory = Factory() factory.protocol = CNetwork def __init__(self, max_clients): self.max_clients = max_clients self.connected_clients = 0 self.server_data = [] def doStart(self): GUI.Print("Factory started -- server is waiting for a connection") def doStop(self): GUI.Print("Factory stopped -- server is now closed") def buildProtocol(self, addr): GUI.Print("Connection attempt....") return CNetwork() def main(): reactor.listenTCP(14500, CNetworkFactory(max_clients = 2)) reactor.run() if __name__ == "__main__": main() ##DO SOMETHING ELSE HERE! ################################### Thanks for your help _________________________________________________________________ The next generation of Hotmail is here! http://www.newhotmail.co.uk

2 1

[Twisted-Python] Using Twisted with MQ
by David Mitchell 09 Jun '07

09 Jun '07

Hello all, I've got what I think is a potential application for Twisted, but I'm having trouble figuring out whether Twisted is going to be the best path or not. I've worked through the Twisted Finger tutorial and read through the "Ball of snakes" O'Reilly book, but I'm not sure I've got my head around Twisted sufficiently. I have to simulate a server that reads messages off IBM's MQ queues, and posts responses back to different MQ queues. I've used both pymqi and Python/COM (on Windows only) to perform this sort of task in the past, but now I need something that's going to be able to respond to incoming MQ messages at a very high rate. I suspect I'm going to have to use reactor.callInThread to spawn off threads within Twisted in order to handle IO with the MQ queues, as I'm not aware of any event-based interface to MQ and therefore any reads/writes from queues are potentially going to block for a while. Is Twisted suited for this sort of application? Better yet, is anyone aware of info I can access regarding this sort of application with Twisted? - Google hasn't been much help... Thanks in advance Dave Mitchell

2 2