Mailman 3 March 2014 - Twisted

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com March 9, 2014

March 9, 2014

1 0

[Twisted-Python] improving foolscap's use of Twisted
by David Stainton March 8, 2014

March 8, 2014

Greetings, My goal is to get Brian Warner's foolscap library ported to Twisted endpoints instead of the older Twisted api interfaces it currently uses (ClientFactory and IConnector). This effort has been documented in foolscap trac ticket #203: http://foolscap.lothar.com/trac/ticket/203 and also part of Tahoe-LAFS trac ticket #517 - make tahoe Tor- and I2P-friendly: https://tahoe-lafs.org/trac/tahoe-lafs/ticket/517 My question is this: Since Foolscap's TubConnectorClientFactory does rely … [View More]on clientConnectionFailed... What is the equivalent to this for the new interfaces? I have tried to braindump all my foolscap twisted endpoint thoughts to foolscap trac ticket #203 : http://foolscap.lothar.com/trac/ticket/203#comment:30 http://foolscap.lothar.com/trac/ticket/203#comment:31 If we look at line 1223 of https://github.com/warner/foolscap/blob/master/foolscap/negotiate.py (at 0395476c7cb154f925d67abf6858a8200126352b) we see that there's this TubConnectorClientFactory: class TubConnectorClientFactory(protocol.ClientFactory, object): and later at line 1384 it is used with connectTCP like this: f = TubConnectorClientFactory(self, host, lp) c = reactor.connectTCP(host, port, f) In my endpoints2 branch (https://github.com/david415/foolscap/tree/endpoints2) I changed it to: class TubConnectorFactory(protocol.Factory, object): I suspected that TubConnector?'s clientConnectionFailed doesn't get called and then I found a relevent quaote this twisted doc: https://twistedmatrix.com/documents/current/core/howto/endpoints.html here's the quote: """Note: If you've used ClientFactory before, keep in mind that the connect method takes a Factory, not a ClientFactory. Even if you pass a ClientFactory to endpoint.connect, its clientConnectionFailed and clientConnectionLost methods will not be called.""" Currently foolscap's extensive collection of unittests are exercising bugs in my code when I try to port foolscap to twisted endpoints. foolscap$ trial foolscap.test.test_appserver.RunCommand.test_run foolscap.test.test_appserver RunCommand test_run ... [ERROR] =============================================================================== [ERROR] Traceback (most recent call last): Failure: foolscap.tokens.NegotiationError: no connection established within client timeout foolscap.test.test_appserver.RunCommand.test_run ------------------------------------------------------------------------------- Ran 1 tests in 60.576s FAILED (errors=1) foolscap$ Cheers! David Stainton [View Less]

2 2

[Twisted-Python] Using DeferredList, on the remote method get parameter of None type?
by yangyouxiu March 7, 2014

March 7, 2014

When developing server-client software, on the client i call the method getTrafficDate, but on the server end, i got nio is None(d2=d.addCallback(lambda object: object.callRemote("getNIOTrafficInfo", node, nio))) ,so, what's the key point? Thanks all! ------------------------------------------------------------------------------------------------------------- client end def getTrafficDate(self): if self.interfacenio_dict is not None and self.k: nodelist = self.… [View More]

2 2

[Twisted-Python] t.w.client.Agent exceptions
by Phil Mayers March 6, 2014

March 6, 2014

All, I'm having a head-poundingly annoying time getting detailed exception info out of the new Agent stuff. Specifically, I have some bug inside my code somewhere, but I can't get decent tracebacks out because _WrapperException is the base class for RequestGenerationFailed, but there's no public (non-underscore-prefixed) way to get that. It seems like an API error; how is one supposed to err.track/check other than importing a non-public API?

3 5

[Twisted-Python] Where are the documentation files?
by Daniel Sank March 4, 2014

March 4, 2014

I am following the instructions on this web page https://twistedmatrix.com/trac/wiki/ReviewingDocumentation to prepare a submission for a documentation edit in the pb section of the howto. However, I can't find any of the supposed xhtml files that are supposed to comprise the documentation. For example, the web page mentions trunk/doc/core/howto/choosing-reactor.xhtml In my SVN checkout, that file simply does not exist. In fact there aren't any documentation files in the SVN checkout. I … [View More]

4 7

[Twisted-Python] Configuration options for twisted code
by Adi Roiban March 4, 2014

March 4, 2014

While using twisted.web (but not only) I had to sub-class twisted code to implement the following: HTTPChannel * reduce limit of HTTP headers length * reduce number of HTTP headers * connection timeout HTTPRequest * change HTTP server signature * change HTTP cookie name and secure/HTTPOnly flag Static.File * resource for child not found * resource for forbidden * template for directory listing. During review process, one feedback was to add these options as part of __init__ method for the … [View More]

4 6

[Twisted-Python] treq // Agent and Content-Length
by Donald Stufft March 4, 2014

March 4, 2014

I’m making a small proxy server in Twisted which is supposed to essentially "mask" the original destination of an URL. Specifically it does the following: 1. Receives an HTTP request on /<hmac>/<url encoded url> 2. Verifies that the hmac in the URL matches the url decoded url 3. Makes an HTTP request to the url decoded url 4. Verify the response 4a. Verify that the *on the wire* size is not greater than a set number of bytes, prior to downloading the body. 4b. Verify … [View More]

1 0

[Twisted-Python] Fixing pydoctor / epydocs errors
by Adi Roiban March 3, 2014

March 3, 2014

Hi, I would like to fix pydoctor / epydocs errors generated while building twisted api reference documentation. The goal is to have a clean build so that when a developer sees an error in his/her branch, the errors is for sure produced by his/her changes. My current problem is that I can not reproduce the results generated by Twisted buildbot. For example for pair, Twisted buildbot gives [1]: twisted.pair.tuntap._IInputOutputSystem.ioctl:143 invalid ref to fcntl.ioctl twisted.pair.tuntap.… [View More]

1 0

[Twisted-Python] [twisted-web] I/O error with twisted.web.wsgi and Django
by Orestis Markou March 3, 2014

March 3, 2014

Hi all, I am using Twisted Web WSGIResource to host a Django site. Here's the code I use to setup the WSGI resource (other boilerplate skipped) def wsgi_resource(): from django.core.handlers.wsgi import WSGIHandler pool = threadpool.ThreadPool() pool.start() # Allow Ctrl-C to get you out cleanly: reactor.addSystemEventTrigger('after', 'shutdown', pool.stop) wsgi_resource = wsgi.WSGIResource(reactor, pool, WSGIHandler()) return wsgi_resource This generally … [View More]

2 1

[Twisted-Python] Stream an mp3 file + IP Multicasting
by Jay Kay March 3, 2014

March 3, 2014

Hi everybody, I am trying to stream an mp3 file via ip multicasting and have found the following script: https://sites.google.com/site/ka010notes/python/twisted#TOC-Multicast-ENCOD… When I run this script on the server I am able to open the stream on VLC player from another device on the subnet but it is laggy/missing/choppy. When I try streaming this mp3 file using VLC player on the server, I am able to successfully open the stream with good quality, without any lags. I have tried playing … [View More]

1 0

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com March 2, 2014

March 2, 2014

1 0

[Twisted-Python] Help non-commiter to fully test their changes locally or remote
by Adi Roiban March 1, 2014

March 1, 2014

Hi, I am trying to gather documentation to help non-commiters test their changes before sending them to review. When run locally some tests fail with a lot of errors and is hard for a developer to filter the errors generated by his/her changes. Ex: * twistedchecker * pyflakes * api-reference I have created patches to clean pyflakes and I also plan to start cleaning the api-reference build errors >From information gathered from #twisted-dev it seems that twistedchecker is not … [View More]maintained and that some of its errors are invalid... so one should not try to fix all its errors. ... I wander why twistedchecker is still used ? I would like to investigate how we can fix api-reference build errors. ------ I have created a travis-ci configuration file which can be used as a reference for running tests. It somehow copies the builders observed on buildbot.twistedmatrix.com A sample build result can be found here: https://travis-ci.org/chevah/twisted/builds/19803969 Code changes are here. If you find them useful I can refine them into a public patch. https://github.com/chevah/twisted/pull/1/files Only python 2.7 and 3.3 builders are enabled... but 2.6 builders can also be enabled. py-select-gc tests are not enabled since they are very, very slow. Running all tests on a single process could take about 1 hour. I guess that running only tests with default reactor and then pyflakes/pydoctor on changed files should cover most errors. A developer should run at least the following tests before sending a patch for review: * trial with default reactor * pyflakes for changed files * pydoctor for changed files If documentation was changed he/she should also run documentation tests. ---- Running pydoctor on my computer takes about 3 minutes... a bit long for my taste. I hope that pydoctor can be run on a independent python files so that I can create a separate linter test which will run pyflakes and pydoctor only on changes files. This should provide a big improvements in speed. I used travis-ci as it provides an isolated / reference test environment. Once the configuration is ok, it can be translated into tox [1], private buildbot [2] or custom script to allow developers to run test on their computers. If a Twisted developer has time, I need some help to check the current travis-ci errors and suggest how to fix them. Thanks! [1] https://github.com/msabramo/python-panci [2] https://github.com/isotoma/buildbot_travis -- Adi Roiban [View Less]

2 2