Mailman 3 March 2014 - Twisted

[Twisted-Python] Simple way to halt all timers?
by Russell E. Owen 13 Mar '14

13 Mar '14

Is there a simple way to cancel all Twisted timers (pending reactor.callLater calls)? The reason I want to do this is to clean up a unit test without getting "dirty reactor" complaints. The system is a server that will rarely be shut down and does not have to shut down gracefully (i.e. I don't care if the reactor is dirty). But I want the unit tests to run cleanly, so for now I've been keeping a reference to each timer that I start, so my test cleanup code can manually cancel it. It's a lot of fuss, and makes timers harder to use than they should be. I admit that in many cases I need a reference to the timer anyway, since I may have to cancel it for reasons that matter to the server. But I hate having to do it for *every* timer. If there was a simple way to tell the reactor to cancel any outstanding "callLater" calls, the code would be much cleaner. -- Russell

2 2

[Twisted-Python] Tor Project has GSoC projects which need Twisted developers!
by isis 13 Mar '14

13 Mar '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Heyo Twisted Python peoples! Google recently accepted The Tor Project into their 2014 Google Summer of Code program. [0][1] We have several GSoC project ideas which include development tasks using Twisted, for example: * Design and develop better Pluggable Transports [2] * Contribute to better parsing integration between Stem and Txtorcon [3] * Design and develop a new Tor bridge distributor for BridgeDB [4] * Develop a censorship analyzer [5] Or feel free to submit a GSoC application for another idea, and we'll try to find a mentor for you. GSoC is a great way to not only get paid for contributing to FLOSS projects, but also to get involved and familiar with the Tor Project. Several current Tor developers were once-upon-a-time GSoC students. Hope to see your applications soon! :) [0]: https://blog.torproject.org/blog/tor-google-summer-code-2014 [1]: https://www.google-melange.com/gsoc/homepage/google/gsoc2014?ModPagespeed=n… [2]: https://www.torproject.org/getinvolved/volunteer.html.en#betterPluggableTra… [3]: https://www.torproject.org/getinvolved/volunteer.html.en#txtorcon-stemInteg… [4]: https://www.torproject.org/getinvolved/volunteer.html.en#newBridgeDBDistrib… [5]: https://www.torproject.org/getinvolved/volunteer.html.en#censorshipAnalyzer - -- ♥Ⓐ isis agora lovecruft _________________________________________________________ GPG: 4096R/A3ADB67A2CDB8B35 Current Keys: https://blog.patternsinthevoid.net/isis.txt -----BEGIN PGP SIGNATURE----- iQMhBAEBCgELBQJTIfqxBYMB4TOAVhSAAAAAACUAKGlzaXMrc2lnbnN1YmtleUBw YXR0ZXJuc2ludGhldm9pZC5uZXRGQzYzQUE1Q0QxOTM4NjlDMzIzNzE0NUE1QzE3 Nzc2RTI3RjdFODRESxSAAAAAABoAKGlzaXNAcGF0dGVybnNpbnRoZXZvaWQubmV0 MEE2QTU4QTE0QjU5NDZBQkRFMThFMjA3QTNBREI2N0EyQ0RCOEIzNS4aaHR0cHM6 Ly9ibG9nLnBhdHRlcm5zaW50aGV2b2lkLm5ldC9wb2xpY3kudHh0LJhodHRwczov L2Jsb2cucGF0dGVybnNpbnRoZXZvaWQubmV0L2lzaXMudHh0AAoJEFwXd24n9+hN 028P/0TNIvBVus2nI+KBTUh5JLyDrG3+C3Unf+MS4N6IkJmL0x1+oGw0R4WgqhCv lJPYvkdr06qcCAsDaOsv/n5v6yyvSxFbVVGftPffqmhe6u952mvDSaYHx05v5f4M pc8+Wss4gyA5KtVuttWqr2QfdNEpoUXtGUHJCREQHU/PiuUEn6sNPx88by3WBKjB jqhX7oEMBrB3cakYXYnZZO0VjoqRHf0PafJrpLaBdkOSezbPqKm40dIZ8v8axXzi /e2d6FLT0D3wDzj1c/4kfRDZIogL83Q4VaIZvT+YpADeEGonzB2uQGqB75OWWkVk +lwJW2saKzQEc0E+iBa2fLDiYLHiauVN1epRrj9EPuXfbte4fn2ntQf6Cr+dVuAM RKfN6HquKCDaW2mY50xOEzawYfPYWJJxDnjG5i2+Wy4N479b9DxmqxpsIBmlElpa 9qPnY9M33doAARx1FDJn39OyynHMMvoD65hBa4ZMzSFTyu8xEhTO9s/NXiRKr8K2 SqZjh9xywNeOiFrPaFB3G+/T8JZGyjsURPIWs9WuGFtOI5SLob7B6K7IpVJG2XGB eeJCrk2KtvpwhPdw561cZHT8V8tHlcBzhV/hsbfbtXlFFFlfkWsdf/BI76AIEKXc 4yjlmAPg9Tlul+AYle3byBTDYDwjN+vgIpn9vKbvGvNnMCtY =S2Nq -----END PGP SIGNATURE-----

1 0

[Twisted-Python] building offline docs
by Chris Withers 12 Mar '14

12 Mar '14

Sorry, more questions... Unfortunately, most of the time I have for learning and research is offline. How can I build the docs for browsing (html) from a subversion checkout? Chris -- Simplistix - Content Management, Batch Processing & Python Consulting - http://www.simplistix.co.uk

3 2

[Twisted-Python] ping?
by Chris Withers 12 Mar '14

12 Mar '14

Sorry, not sure mail is getting through from the list... -- Simplistix - Content Management, Batch Processing & Python Consulting - http://www.simplistix.co.uk

2 1

[Twisted-Python] Work around pyflakes errors
by Adi Roiban 10 Mar '14

10 Mar '14

I would like to see twisted code base free of pyflakes errors. In this way, when someone sees pyflakes errors in his/her branch will know for sure that those errors are generated by changes in that branch. Also developers could run pyflakes on local computers, before sending a patch and have instance feedback for pyflakes errors. One problem is that pyflakes will complain about unused imports. JP suggested a fix for that and I have created a ticket: https://twistedmatrix.com/trac/ticket/7014 I am not sure how the suggested requireModule("OpenSSL") style API should work, but in the same comment, JP suggested to use 'namedAny' to get the same effect as the unused import. My problem with namedAny is that it does not raise ImportError ... but rather ModuleNotFound or ObjectNotFound. But I found 'namedModule' which raise ImportError Here is an example of namedModule usage which should work around pyflakes errors. Old code: try: import threading threading # Silence the linter. except ImportError: self.assertFalse(Platform().supportsThreads()) New code try: namedModule('threading') except ImportError: self.assertFalse(Platform().supportsThreads()) What do you think, is namedModule usage acceptable or we should work at implementing the requireModule("OpenSSL") API? Thanks! -- Adi Roiban

2 2

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com 09 Mar '14

09 Mar '14

1 0

[Twisted-Python] improving foolscap's use of Twisted
by David Stainton 08 Mar '14

08 Mar '14

Greetings, My goal is to get Brian Warner's foolscap library ported to Twisted endpoints instead of the older Twisted api interfaces it currently uses (ClientFactory and IConnector). This effort has been documented in foolscap trac ticket #203: http://foolscap.lothar.com/trac/ticket/203 and also part of Tahoe-LAFS trac ticket #517 - make tahoe Tor- and I2P-friendly: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/517 My question is this: Since Foolscap's TubConnectorClientFactory does rely on clientConnectionFailed... What is the equivalent to this for the new interfaces? I have tried to braindump all my foolscap twisted endpoint thoughts to foolscap trac ticket #203 : http://foolscap.lothar.com/trac/ticket/203#comment:30 http://foolscap.lothar.com/trac/ticket/203#comment:31 If we look at line 1223 of https://github.com/warner/foolscap/blob/master/foolscap/negotiate.py (at 0395476c7cb154f925d67abf6858a8200126352b) we see that there's this TubConnectorClientFactory: class TubConnectorClientFactory(protocol.ClientFactory, object): and later at line 1384 it is used with connectTCP like this: f = TubConnectorClientFactory(self, host, lp) c = reactor.connectTCP(host, port, f) In my endpoints2 branch (https://github.com/david415/foolscap/tree/endpoints2) I changed it to: class TubConnectorFactory(protocol.Factory, object): I suspected that TubConnector?'s clientConnectionFailed doesn't get called and then I found a relevent quaote this twisted doc: https://twistedmatrix.com/documents/current/core/howto/endpoints.html here's the quote: """Note: If you've used ClientFactory before, keep in mind that the connect method takes a Factory, not a ClientFactory. Even if you pass a ClientFactory to endpoint.connect, its clientConnectionFailed and clientConnectionLost methods will not be called.""" Currently foolscap's extensive collection of unittests are exercising bugs in my code when I try to port foolscap to twisted endpoints. foolscap$ trial foolscap.test.test_appserver.RunCommand.test_run foolscap.test.test_appserver RunCommand test_run ... [ERROR] =============================================================================== [ERROR] Traceback (most recent call last): Failure: foolscap.tokens.NegotiationError: no connection established within client timeout foolscap.test.test_appserver.RunCommand.test_run ------------------------------------------------------------------------------- Ran 1 tests in 60.576s FAILED (errors=1) foolscap$ Cheers! David Stainton

2 2

[Twisted-Python] Using DeferredList, on the remote method get parameter of None type?
by yangyouxiu 07 Mar '14

07 Mar '14

When developing server-client software, on the client i call the method getTrafficDate, but on the server end, i got nio is None(d2=d.addCallback(lambda object: object.callRemote("getNIOTrafficInfo", node, nio))) ,so, what's the key point? Thanks all! ------------------------------------------------------------------------------------------------------------- client end def getTrafficDate(self): if self.interfacenio_dict is not None and self.k: nodelist = self.interfacenio_dict.keys() trafficDataList=[]#DeferredList for node in nodelist: interfaces=self.interfacenio_dict[node]['interfaceinfo'].keys() if len(interfaces): for interface in interfaces: nio= self.interfacenio_dict[node]['interfaceinfo'][interface] if nio is not None: if 'nio_tap' in nio or 'NIO_NF_tap' in nio: d= globals.perspective.callRemote('getServerRoot') d2=d.addCallback(lambda object: object.callRemote("getNIOTrafficInfo", node, nio)) d2.addCallback(self.setTrafficSpeed_Tap, node, interface) trafficDataList.append(d2) else: d= globals.perspective.callRemote('getServerRoot') d2=d.addCallback(lambda object: object.callRemote("getNIOTrafficInfo", node, nio)) d2.addCallback(self.setTrafficSpeed_NotTap, node, interface) trafficDataList.append(d2) trafficDataDeferredList=defer.DeferredList(trafficDataList, consumeErrors=True) trafficDataDeferredList.addCallback(self.getTrafficDataHandle) server end def remote_getNIOTrafficInfo(self,node,nio): print nio if nio.name==nioName: pass Bug info is: File "/home/gddw/Documents/gddw-server-branche/src/Server.py", line 154, in remote_getNIOTrafficInfo if nio.name==nioName: exceptions.AttributeError: 'NoneType' object has no attribute 'name'

2 2

[Twisted-Python] t.w.client.Agent exceptions
by Phil Mayers 06 Mar '14

06 Mar '14

All, I'm having a head-poundingly annoying time getting detailed exception info out of the new Agent stuff. Specifically, I have some bug inside my code somewhere, but I can't get decent tracebacks out because _WrapperException is the base class for RequestGenerationFailed, but there's no public (non-underscore-prefixed) way to get that. It seems like an API error; how is one supposed to err.track/check other than importing a non-public API?

3 5

[Twisted-Python] Where are the documentation files?
by Daniel Sank 04 Mar '14

04 Mar '14

I am following the instructions on this web page https://twistedmatrix.com/trac/wiki/ReviewingDocumentation to prepare a submission for a documentation edit in the pb section of the howto. However, I can't find any of the supposed xhtml files that are supposed to comprise the documentation. For example, the web page mentions trunk/doc/core/howto/choosing-reactor.xhtml In my SVN checkout, that file simply does not exist. In fact there aren't any documentation files in the SVN checkout. I would blame this on improper SVN checkout, but here's a copy/paste of the url from whence I got the checkout svn://svn.twistedmatrix.com/svn/Twisted/trunk Anyone know what's going on? Daniel

4 7