Mailman 3 June 2016 - Twisted

[Twisted-Python] Travis-CI integration work
by Adi Roiban June 7, 2016

June 7, 2016

Hi, I just want to let you know that we are almost done with the work of integrating Travis-CI with Twisted GitHub PRs. The ticket is here https://twistedmatrix.com/trac/ticket/7229 If you have time, please take a look at the current work and suggest any changes or provide any feedback. The goal of this ticket is to have an initial set of tests executed for a patch, on behalf on non-Twisted commiters. In this way, I hope that contributors would be able to get a faster feedback regarding … [View More]

4 3

[Twisted-Python] inlinecallbacks, unhandled error....where?
by steven meier June 7, 2016

June 7, 2016

hi, ive got these two functions: @inlineCallbacks def getUserList(): reload_interval = yield getReloadInterval() print "222", reload_interval target_url = host + "/?ReloaderUserOnline" body = urllib.urlencode({"reloadsequenz":reload_interval}) #body = '\r\n' #headers = {'Content-Type': 'application/x-www-form-urlencoded'} d = getPage(url = target_url, cookies=cookies, agent=useragent, postdata=body, method = 'POST', headers=headers) … [View More] defer.returnValue(d) i can see the output: 222 somenumber, so apparently getReloadInterval works. it returns some magic number as expected now i call getUserList from this function: (response is 1, so d = getUserList gets evaluated) but there i get: 222 5821 Unhandled error in Deferred (short version, complete error at the end) Traceback (most recent call last): File "/home/julius/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1184, in gotResult def printLoginResult(response): #we are in, login accepted if response == ' 1': print "we are in, get user list" #printChat(response) def printResult(result): print repr(result) d = getUserList() d.addCallback(printResult) d.addErrback(printResult) why is printResult not run? Unhandled error in Deferred: Traceback (most recent call last): File "/home/julius/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1184, in gotResult _inlineCallbacks(r, g, deferred) File "/home/julius/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1171, in _inlineCallbacks deferred.callback(e.value) File "/home/julius/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 393, in callback self._startRunCallbacks(result) File "/home/julius/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 501, in _startRunCallbacks self._runCallbacks() --- <exception caught here> --- File "/home/julius/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 588, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/home/julius/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1184, in gotResult _inlineCallbacks(r, g, deferred) File "/home/julius/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1171, in _inlineCallbacks deferred.callback(e.value) File "/home/julius/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 392, in callback assert not isinstance(result, Deferred) exceptions.AssertionError: [View Less]

1 0

[Twisted-Python] buildbot is back
by Glyph June 6, 2016

June 6, 2016

When migrating it to a new VM, we seem to have somewhat underprovisioned buildbot.twistedmatrix.com. I've just moved it from a 1G to a 2G instance. Sorry about the downtime! Hopefully this is enough RAM for it to do its job. It seemed to happily consume only a few hundred megs when we were doing test builds, but there's some kind of load spike that happens periodically which was OOM killing it and I believe this change should fix it. -glyph

1 0

[Twisted-Python] Need clarification on reviews for Python 3 fixes for Twisted
by Craig Rodrigues June 6, 2016

June 6, 2016

Hi, I have submitted some Python 3 patches for Twisted. 1. PATCHES REVIEWED AND COMMITTED TO TRUNK ============================================= Use new syntax for catching exceptions https://twistedmatrix.com/trac/ticket/8344 Use new syntax for raising exceptions https://twistedmatrix.com/trac/ticket/8345 Remove old syntax for octal literals https://twistedmatrix.com/trac/ticket/8347 Fix parentheses in list comprehensions https://twistedmatrix.com/trac/ticket/8351 2. PATCHES WHICH … [View More]

5 10

[Twisted-Python] Why deferToThread is so slow?
by Nagy, Attila June 4, 2016

June 4, 2016

Hi, I have a thread safe synchronous library, which I would like to use in a threadpool using deferToThread. Without using (deferTo)threads I get consistent 1-3 ms response times, with deferring to threadpool, I get 30-300, varying wildly. I've tried to construct a test, which is of course not perfect, but shows some differences, which widen with the number of threads (while directly calling that dumb function remains the same). I can see similar results with using the (database) library,… [View More] but because it's an external dependency and performance gets worse with the number of queries (threads), I thought it would be best to leave that out of the picture, hence the dumb function. # python /tmp/deft.py 1 deferToThread: avg 316.17 us, sync: avg 1.38 us, 228.71x increase deferToThread: avg 312.92 us, sync: avg 1.38 us, 226.96x increase deferToThread: avg 320.22 us, sync: avg 1.39 us, 230.37x increase deferToThread: avg 317.33 us, sync: avg 1.35 us, 235.24x increase # python /tmp/deft.py 8 deferToThread: avg 2542.90 us, sync: avg 1.37 us, 1854.14x increase deferToThread: avg 2544.50 us, sync: avg 1.35 us, 1878.13x increase deferToThread: avg 2544.47 us, sync: avg 1.36 us, 1864.52x increase deferToThread: avg 2544.52 us, sync: avg 1.38 us, 1839.01x increase deferToThread: avg 2544.92 us, sync: avg 1.36 us, 1871.81x increase deferToThread: avg 2546.71 us, sync: avg 1.39 us, 1830.35x increase deferToThread: avg 2552.38 us, sync: avg 1.35 us, 1893.17x increase deferToThread: avg 2552.40 us, sync: avg 1.36 us, 1870.20x increase # python /tmp/deft.py 16 deferToThread: avg 4745.76 us, sync: avg 1.26 us, 3770.11x increase deferToThread: avg 4748.67 us, sync: avg 1.24 us, 3817.03x increase deferToThread: avg 4749.81 us, sync: avg 1.26 us, 3756.39x increase deferToThread: avg 4749.72 us, sync: avg 1.24 us, 3839.88x increase deferToThread: avg 4749.87 us, sync: avg 1.28 us, 3709.99x increase deferToThread: avg 4752.63 us, sync: avg 1.24 us, 3842.90x increase deferToThread: avg 4752.53 us, sync: avg 1.23 us, 3866.08x increase deferToThread: avg 4752.55 us, sync: avg 1.23 us, 3855.40x increase deferToThread: avg 4754.03 us, sync: avg 1.29 us, 3678.09x increase deferToThread: avg 4754.97 us, sync: avg 1.25 us, 3817.19x increase deferToThread: avg 4755.45 us, sync: avg 1.32 us, 3593.28x increase deferToThread: avg 4756.35 us, sync: avg 1.25 us, 3804.18x increase deferToThread: avg 4756.19 us, sync: avg 1.29 us, 3687.73x increase deferToThread: avg 4757.19 us, sync: avg 1.23 us, 3860.74x increase deferToThread: avg 4758.02 us, sync: avg 1.24 us, 3824.33x increase deferToThread: avg 4759.63 us, sync: avg 1.24 us, 3830.40x increase On 16 threads it takes nearly 5 ms(!) to call a local function... The test program is here: https://gist.github.com/bra-fsn/1fd481b44590a939e849cb9073ba1a41 cpython 2.7.11, Twisted 16.2.0 BTW, I've run this on pypy 5.1.1 with even worse results: https://mail.python.org/pipermail/pypy-dev/2016-June/014477.html [View Less]

4 5

[Twisted-Python] buildbots: normal service will resume shortly
by Glyph June 3, 2016

June 3, 2016

We had a minor hiccup earlier today due partially to a new Cryptography release (the Windows builders, which started spuriously failing builds) and some random networking issues (the OS X builders, which went offline). I believe I've gotten them back online and performing to spec and they should chew through their respective backlogs shortly. -glyph

1 2