Mailman 3 September 2007 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz 05 Aug '21

05 Aug '21

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |_____| |_____ | | | | @ t w i s t e d m a t r i x . c o m http://www.twistedmatrix.com/~glyph/

4 5

[Twisted-Python] Get IP of connecting client in XMLRPC server
by Remy C. Cool 28 Apr '13

28 Apr '13

Hello, On 18 May 2004, the following message was posted to this mailinglist: Jp Calderone exarkun at divmod.com wrote: >Daniel Newton wrote: > > I have a simple XML-PRC server similar to the example below: > > from twisted.web import xmlrpc, server > > class Example(xmlrpc.XMLRPC): > """An example object to be published.""" > > def xmlrpc_add(self, a, b): > """Return sum of arguments.""" > return a + b def xmlrpc_whatIsMyAddress(self): return self.transport.getPeer().host > > if __name__ == '__main__': > from twisted.internet import reactor > r = Example() > reactor.listenTCP(7080, server.Site(r)) > reactor.run() > > I want to be able to get the address of the client that calls the xmlrpc > method can anyone help me with this? This solution didn't work because 'transport' isn't a property of the Example class. I'm currently in the process of changing from a customized SimpleXMLRPCServer to a twisted XMLRPC server solution and I need to insert the client IP into the attributes passed to the called xmlrpc method. Anyone who knows the answer and is willing to share the info? Regards, Remy

3 3

[Twisted-Python] 2006, 'MySQL server has gone away'
by Werner Thie 15 Oct '07

15 Oct '07

Hi all While using mySQL V 5.0.33 and MySQL-python-1.2.2 with twisted/adbapi with the following connection params DB_DRIVER = "MySQLdb" DB_ARGS = { 'host': 'xxx.xxx.xxx.xxx', 'db': 'db', 'user': 'dbuser', 'passwd': 'dbpasswd' } I noticed (2006, 'MySQL server has gone away') errors, which seem to be not recoverable from an adbapi standpoint. Further analysis and reading the mySQL manual showed, that the mySQL server in versions > 5 seems to close open connections after (default) 8 hours. The reconnect feature of the db is disabled by default and there is no parameter to preset it via MySQL-python. Further digging brought up this link http://sourceforge.net/tracker/index.php?func=detail&aid=1483074&group_id=2… which patches the (also 1.2.2) version such, that a reconnect keyword is introduced in the DB_ARGS. Questions: - are there any adverse effects in applying this patch and setting reconnect: 1 in DB_ARGS? - is there a better, safer way to avoid this nasty error? Thxs, Werner

3 3

[Twisted-Python] Discovering Twisted : reactor.stop()
by Steve MULLER 03 Oct '07

03 Oct '07

Hello, I discovered Python recently and even more recently the Twisted module. I have a problem with the Twisted reactor and I would like to understand for which reason my program freezes. Here the code which should loop forever : from twisted.internet import reactor from twisted.internet import task class reactorProb(object): def __init__(self): self.count = 5 self._callback = task.LoopingCall(self.Heartbeat) self._callback.start(1, now = False) def Heartbeat(self): print "Top" self.count -= 1 if (self.count == 0): print "Exit" self._callback.stop() del self._callback reactor.stop() while (True): rp = reactorProb() print "Enter into reactor.run()" reactor.run() print "Leave from reactor.run()" I got this: Enter into reactor.run() Top Top Top Top Top Exit Leave from reactor.run() Enter into reactor.run() Top Top Top Top Top Exit Thus I start first once the reactor, I stop it then I start again and it freezes instead of stopping it the reactor. Could somebody explain me it why? Thank you in advance. smu

4 6

[Twisted-Python] Aborting callback chain with an errback
by Andy Fundinger 01 Oct '07

01 Oct '07

What is the proper way to handle an uncorrectable error? I have code that looks like: def callXMLRPC(self,stringValue,intValue): return(xmlProxy.callRemote("myFunc",{...}) \ .addCallback(self.rpcSuccess).addErrback(self.rpcFailure)) and in a derived class: def specificQuery(self): return self.callXMLRPC("Ask Thing", 3).addCallback(self.handleResult) what I'd like to have happen is if an error is raised in callRemote, rpcFailure does some cleanup and no further callbacks are executed. I can't fix the failure, but I don't want a message logged into my error log everytime, it's not unhandled, just that there's nothing to be done and callbacks won't have the data to run. If I want to deal with it further I'd want to do it in the base class. How can I do that? Am I doing something nonsensical here? Andy Fundinger -- Blog: http://channel3b.wordpress.com Second Life Name: Ciemaar Flintoff

2 1

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 30 Sep '07

30 Sep '07

Bug summary ______________________ Summary for 2007-09-23 through 2007-09-30 Bugs opened: 4 Bugs closed: 4 Total open bugs: 1035 (+0) |== Type Changes |== Priority Changes |== Component Changes |Defect: +2 |Highest: -1 |Core: -2 |Enhancement: -2 |High: +1 |Trial: +1 |Normal: +0 |Web2: +1 New / Reopened Bugs ______________________ ===== Highest ===== [#2836] limits of web2.resource.PostableResource can't be customized (opened by therve) enhancement web2 http://twistedmatrix.com/trac/ticket/2836 ===== High ===== [#2837] TreeReporter setup/teardown error handling broke (opened by pjd) defect trial http://twistedmatrix.com/trac/ticket/2837 ===== Normal ===== [#2838] _dumbwin32proc does not IProcessTransport make (opened by Peaker) defect core http://twistedmatrix.com/trac/ticket/2838 [#2839] _pollingfile fails to call stopProducing when connection is lost (opened by Peaker) defect core http://twistedmatrix.com/trac/ticket/2839 Closed Bugs ______________________ ===== Highest ===== [#2684] t.p.t.ThreadPool.dispatch should be deprecated (opened by indigo, closed by therve, fixed) enhancement core http://twistedmatrix.com/trac/ticket/2684 [#2216] Coding Standard update: Lines should not have trailing whitespace (opened by jml, closed by therve, fixed) enhancement core http://twistedmatrix.com/trac/ticket/2216 ===== Normal ===== [#2636] stdio.StandardIO breaks, readhack code in process.py to blame (opened by gtalvola, closed by therve, duplicate) defect core http://twistedmatrix.com/trac/ticket/2636 [#2101] Coding standard should fallback to PEP 8 (opened by jml, closed by therve, duplicate) enhancement core http://twistedmatrix.com/trac/ticket/2101 Ticket Lifetime Stats ______________________ Oldest open ticket - [#38] Should be a way to create documentation aliases (since 2003-07-12 16:08:03). Newest open ticket - [#2839] _pollingfile fails to call stopProducing when connection is lost (since 2007-09-25 12:50:46). Mean open ticket age: 530 days, 11:12:33.587451. Median: 429 days, 23:27:03.200978. Standard deviation: 402 days, 14:36:13.748171. Interquartile range: 504 days, 22:01:06. Mean time between ticket creation and ticket resolution: 121 days, 13:43:11.437464. Median: 14 days, 13:40:23. Standard deviation is 224 days, 14:04:54.647686. The interquartile range is 128 days, 3:43:59. Mean time spent in review: 65 days, 18:18:25.859556. Median: 4 days, 5:45:01. Standard deviation: 145 days, 4:55:30.540939. Interquartile range: 29 days, 10:44:36. Mean number of times a ticket is reviewed: 1.95081967213. Median: 1 Standard deviation: 1.58592108825. Interquartile range: 1. Contributor Stats ______________________ In the last 4 weeks, 12 unique ticket reporters 6 unique ticket reviewers 2 unique ticket resolvers In the last 24 weeks, 76 unique ticket reporters 15 unique ticket reviewers 14 unique ticket resolvers In the last 48 weeks, 155 unique ticket reporters 19 unique ticket reviewers 26 unique ticket resolvers

1 0

[Twisted-Python] How to stop reactor when execution finishes on more than one ssh server?
by James Deng 29 Sep '07

29 Sep '07

Hi, in the sample sshsimpleclient.py, it demostrated how to connect to a ssh server and issue a command. my question is what should I do if I want to connect to more than one ssh server. I did try to create more than one SimpleTransport by using the following code HOSTS=[host1, host2, host3] protocol.ClientCreator(reactor, SimpleTransport).connectTCP(host1, 22) protocol.ClientCreator(reactor, SimpleTransport).connectTCP(host2, 22) protocol.ClientCreator(reactor, SimpleTransport).connectTCP(host3, 22) reactor.run() this really behaves as what i expected, and executed the command on all remote hosts, but after it finishes, i just hangs there, I know I need a place to call something like reactor.stop() when all transport finishes the execution. but i do not know where to call it, need some deffereds? and how? thanks very much! James

2 1

[Twisted-Python] tests for web2/channel/http
by Eduardo Schettino 27 Sep '07

27 Sep '07

Hello all, I am trying to learn trial... I am looking for examples of trial testing web2 code. I could not find tests for web2/channel/http.py They exist? Regards, Eduardo

2 1

[Twisted-Python] tracebacks in twisted web2
by Paul Perez 26 Sep '07

26 Sep '07

Dear List: I am having a heck of a time trying to figure out why this traceback is happening, and I was hoping that you could shed some light on the situation. I am sorry for bothering you with this simple thing, but I can't seem to figure it out! The code and traceback are below. The traceback only happens when I call httprequest.writeResponse(httpresponse) from a callback. When the same code is called inline and not in a deferred, it works just fine. Even stranger is that the response is written to the client even though the traceback occurs. An explanation of what I am trying to do: A consumer requests data. If there is data in the queue when the consumer first checks, return the result right away. If there is no data present, return a deferred and wait. When the producer inserts data into the queue, check if there is a consumer waiting. If so, begin callback chain on consumer. The code works fine (no traceback) in the case where there is no deferred needed (in QueueCache.maybedefer). When there is a deferred, the traceback happens during the callback (in QueueCache.put). Again, the consumer actually gets the correct result, but the traceback still occurs! Any ideas? Thanks in advance! ~P from twisted.internet import reactor, defer from twisted.web2 import http, responsecode import Queue TIMEOUT = 10 def respond(result, httprequest): httpresponse = http.Response(responsecode.OK, {}, stream=result) httprequest.writeResponse(httpresponse) class QueueCache(object): def __init__(self): self.queue = {} self.defer = {} def get_data(self, xSig): return self.get_queue(xSig).get_nowait() def push_data(self, xSig, value): self.get_queue(xSig).put(value) def get_queue(self, xSig): try: return self.queue[xSig] except KeyError: q = Queue.Queue() self.queue[xSig] = q return q def defer_request(self, xSig, httprequest): if self.defer.has_key(xSig): raise Exception("Client %s already has a deferred request!" %(xSig)) def timeout(deferred, request): xSig = request.args['X-Signature'][0] try: self.defer.pop(xSig) except KeyError: print 'Timeout called and xSig `%s` was not in cache!' % xSig respond('ACK',request) d = defer.Deferred() d.addCallback(respond, httprequest) d.setTimeout(TIMEOUT, timeout, httprequest) self.defer[xSig] = d return d def put(self, data): xSig = data['X-Signature'] try: d = self.defer.pop(xSig) d.callback(data['message']) except KeyError: self.push_data(xSig,data) def maybedefer(self, httprequest): xSig = httprequest.args['X-Signature'][0] try: data = self.get_data(xSig) result = http.Response( responsecode.OK, {}, stream=data['message'] ) except Queue.Empty: result = self.defer_request(xSig, httprequest) return result ----------------------------------------------------------------------------------------------------- 2007-09-25 18:38:38-0700 [-] Original exception: 2007-09-25 18:38:38-0700 [-] Unhandled Error Traceback (most recent call last): File "C:\Projects\PyServer\twisted\internet\defer.py", line 304, in _startRunCallbacks File "C:\Projects\PyServer\twisted\internet\defer.py", line 317, in _runCallbacks File "C:\Projects\PyServer\twisted\internet\defer.py", line 281, in _continue File "C:\Projects\PyServer\twisted\internet\defer.py", line 277, in unpause --- <exception caught here> --- File "C:\Projects\PyServer\twisted\internet\defer.py", line 317, in _runCallbacks File "C:\Projects\PyServer\twisted\web2\server.py", line 518, in _cbFinishRender exceptions.TypeError: html is not a resource or a response 2007-09-25 18:38:39-0700 [-] Unhandled error in Deferred: 2007-09-25 18:38:39-0700 [-] Unhandled Error Traceback (most recent call last): File "C:\Projects\PyServer\twisted\internet\defer.py", line 317, in _runCallbacks File "C:\Projects\PyServer\twisted\web2\server.py", line 476, in _processingFailed File "C:\Projects\PyServer\twisted\internet\defer.py", line 200, in addErrback File "C:\Projects\PyServer\twisted\internet\defer.py", line 182, in addCallbacks --- <exception caught here> --- File "C:\Projects\PyServer\twisted\internet\defer.py", line 317, in _runCallbacks File "C:\Projects\PyServer\twisted\web2\server.py", line 492, in _processingReallyFailed File "C:\Python24\lib\site-packages\twisted\web2\http.py", line 446, in writeResponse self.chanRequest.writeHeaders(response.code, response.headers) File "C:\Projects\PyServer\twisted\web2\channel\http.py", line 431, in writeHeaders File "C:\Projects\PyServer\twisted\web2\channel\http.py", line 466, in _writeHeaders exceptions.AttributeError: 'HTTPChannelRequest' object has no attribute 'transport'

1 0

[Twisted-Python] reactor.stop() doesn't stop the select reactor?
by Sam Roberts 25 Sep '07

25 Sep '07

I have unittests where each test: def test_this .. setup reactor.run() # ... when test is done reactor.stop() will be called def test_that .. same as above does some setup, runs the reactor until test is complete, then stops the reactor, asserting all went as intended. However, second call to reactor.stop() doesn't stop the reactor. strace shows reactor going back into select(), blocking forever, but killable with sigquit. Is this really intentional? Example code and testrun follow. ~/w/engine % python t_reactor_stop.py 2.5.1 (r251:54863, May 2 2007, 16:27:44) [GCC 4.1.2 (Ubuntu 4.1.2-0ubuntu4)] [twisted, version 2.5.0] <twisted.internet.selectreactor.SelectReactor object at 0x2b684344a310> stopping reactor running? 1 reactor stopped stopping reactor running? 1 zsh: quit (core dumped) python t_reactor_stop.py ~/w/engine % cat t_reactor_stop.py import sys print sys.version from twisted.internet import reactor import twisted print twisted._version.version print reactor def stop_reactor(): print "stopping reactor running? " + repr(reactor.running) try: reactor.stop() except: print "stop died!" reactor.callWhenRunning(stop_reactor) reactor.run() print "reactor stopped" reactor.callWhenRunning(stop_reactor) reactor.run() # Unreachable, why? print "reactor stopped" reactor.callWhenRunning(stop_reactor) reactor.run() print "reactor stopped"

3 4