Mailman 3 February 2014 - Twisted

[Twisted-Python] Buildbot downtime
by Tom Prince 03 Mar '22

03 Mar '22

I am plannig to upgrade twisted's buildbot in the near future. In preperation for that, I am going to take down the production buildbot on Tuesday, June 26, around 1600 UTC[1]. During that time, the result of any builds done will be lost. Thus, I'd ask that people avoid committing to trunk during that time. I will send a reminder before I take down the buildbot both here, and on #twisted and #twisted-dev. Tom [1] http://timeanddate.com/worldclock/meetingtime.html?iso=20120626&p1=80&p2=22…

2 8

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz 05 Aug '21

05 Aug '21

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |_____| |_____ | | | | @ t w i s t e d m a t r i x . c o m http://www.twistedmatrix.com/~glyph/

4 5

[Twisted-Python] Real Viagra Professional - for real sex pros
by Tamika 01 May '19

01 May '19

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> <html> <head> <center> <a href="http://rqf.entercompassion.com"><img src="http://mediapix.ru/pics/685207b3dd437eff7f15c0744b5c1d3a.gif"> <title> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <link rel="stylesheet" href="http://gfx8.nnt.com/mail/12.0.1187.0824/positioning.css" /> </head> <body style="overflow:auto;"> <div id="PrintShellToolbar"> <div class="ContainerPadding"> <span class="FloatRight"> <a href= > <img alt="" src="http://gfx1.nfi.com/mail/w2/pr02/ltr/glyph_close_rest.gif" /> <Close window> <a href= > <img alt="" src="http://gfx2.czb.com/mail/w2/pr02/ltr/i_print.gif" /> <Print> </a> </span> </div> </div> <div> <div class="BorderContainerOutline ContainerPadding"> <div class="ClearBoth"> <span class="HeaderData" style="font-size:large;"> <TuPostal.com Cambia de nombre?> </span> </div> <div class="ClearBoth"> <span class="HeaderLabel"> <From:> </span> <span class="HeaderData"> <b><TuPostal.com></b> </span> </div> <div class="ClearBoth"> <span class="HeaderLabel"> <Sent:> </span> <span class="HeaderData"> <div class="ClearBoth"> <span class="HeaderLabel"> To: </span> <span class="HeaderData"> Mikelelliott (mikelelliott(a)rlo.com) </span> </div> <br /> </div> </div> <div class="MessageBody" style=""> <br /> <div id="MessageBodyText" class="ExternalClass" style="border: 1px solid #fff ;"> <pre>Hola!<br> <br>Tupostal es ahora parte de Sonico!<br> <br>Para conocer nuestro nuevo sitio, haz clic en el siguiente link:<br><a href='http://www.gwpcom/index1.php' target='_blank'>http://www.bjncom/index1.php</a><br> <br>Sonico es un sitio donde puedes...<br>- Guardar fotos ilimitadas<br>- Re encontrarte con viejos amigos<br>- Recibir novedades de tus amigos.<br> <br>Te Esperamos! Ya somos mas de 21 millones de usuarios!!<br> <br>Sonico - Amigos Conectados<br> <br> <br>PD: Ahora tambien podras guardar tus postales<br> <br> <br>------------------------------------------<br>Haz recibido este email porque te encuentras registrado en fdm.com.<br>Si no deseas recibir mas mensajes como este, por favor haz clic en el siguiente link:<br><a href='http://www.cehcom/unsubscribe.php?type=2' target='_blank'>http://www.fyocom/unsubscribe.php?type=2</a><br> <br></pre> </div> </div> </div> </body> </html>

8 10

[Twisted-Python] Better usage of Twisted on multi core processor
by Sumanth Puram 13 Mar '15

13 Mar '15

Hi all, I have a twisted TCP server to listens to client, processes requests, do mysql database operations if needed (using adbapi Connection pool) and return the result. Before deploying this in production, I want to know right way to configure the server. Since twisted is single threaded, how can I leverage multiple cores of my production machine (which has 6 cores and 16 GB RAM) ? One approach that I thought of was to start multiple instances of twisted server on different ports. This would help in using the other cores as well. What do you guys suggest ? Thanks -Sumanth

5 7

[Twisted-Python] [ANN] txZMQ released
by Andrey Smirnov 21 Jul '14

21 Jul '14

Hi! I would like to announce txZMQ, ZeroMQ bindings for Twisted. txZMQ is based on pyzmq and requires recent ØMQ version (>=2.1). txZMQ uses ØMQ APIs to get file descriptor that is used to signal pending actions from ØMQ library IO thread running in separate thread. txZMQ should be usable with any Twisted reactor. ØMQ is: * The socket library that acts as a concurrency framework. * Carries messages across inproc, IPC, TCP, and multicast. * Connect N-to-N via fanout, pubsub, pipeline, request-reply. * Fast enough for clustered products and supercomputing. * Asynch I/O for scalable multicore message-passing apps. Bridging ØMQ and Twisted makes a nice match: fast simple messaging between Twisted instances solving complex problems :) Links: * PyPi: http://pypi.python.org/pypi/txZMQ/ * Source code: https://github.com/smira/pyzmq * pyzmq: http://pypi.python.org/pypi/pyzmq * ØMQ: http://www.zeromq.org/ -- Andrey Smirnov, Qik Web Team Lead

8 11

[Twisted-Python] Distributing apilinks.py
by Adi Roiban 11 May '14

11 May '14

Hi, Right now apilinks.py is located in Twisted at docs/_extensions/apilinks.py, but a copy can also be found in pydoctor project. While reporting a bug for apilinks.py in Twisted I was ask to send the patch upstream in pydoctor [1] During the review of the patch in pydoctor, pydoctor's maintainer agreed that there should be a single copy of this file but don't know what's involved in achieving that. [2] Can someone involved in using apilinks.py in Twisted provide some feedback regarding distribution of apilinks.py file? Many thanks! [1] https://twistedmatrix.com/trac/ticket/6954 [2] https://code.launchpad.net/~adiroiban/pydoctor/1282458-apilinks-anchor/+mer… -- Adi Roiban

3 5

[Twisted-Python] Contributing documentation inside CONTRIBUTING repo file
by Adi Roiban 17 Mar '14

17 Mar '14

Hi. Right now CONTRIBUTING file from twisted repo sends developers to: https://twistedmatrix.com/trac/wiki/ContributingToTwistedLabs What do you think about having basic contributing documentation inside the repo? I am talking about these 2 pages: https://twistedmatrix.com/trac/wiki/BasicGuideToContributingCode https://twistedmatrix.com/trac/wiki/TwistedDevelopment Commiters Check list can be left on the wiki page: https://twistedmatrix.com/trac/wiki/CommitterCheckList -------- I think that those pages are very important to assist new developers in creating a successful patch (ie one that is merged without to much ping-pong) Even if I now have wiki edit page, I don't have the courage to change the wiki page (for example to add information about twistedchecker or how to build the new docs). Changing a file and submitting for review feels more comfortable. Also, developers could always refer to that file from inside their preferred text editor. --------- Is there someone review-ul changes on the wiki pages? Thanks! -- Adi Roiban

6 10

[Twisted-Python] Where are the documentation files?
by Daniel Sank 04 Mar '14

04 Mar '14

I am following the instructions on this web page https://twistedmatrix.com/trac/wiki/ReviewingDocumentation to prepare a submission for a documentation edit in the pb section of the howto. However, I can't find any of the supposed xhtml files that are supposed to comprise the documentation. For example, the web page mentions trunk/doc/core/howto/choosing-reactor.xhtml In my SVN checkout, that file simply does not exist. In fact there aren't any documentation files in the SVN checkout. I would blame this on improper SVN checkout, but here's a copy/paste of the url from whence I got the checkout svn://svn.twistedmatrix.com/svn/Twisted/trunk Anyone know what's going on? Daniel

4 7

[Twisted-Python] [twisted-web] I/O error with twisted.web.wsgi and Django
by Orestis Markou 03 Mar '14

03 Mar '14

Hi all, I am using Twisted Web WSGIResource to host a Django site. Here's the code I use to setup the WSGI resource (other boilerplate skipped) def wsgi_resource(): from django.core.handlers.wsgi import WSGIHandler pool = threadpool.ThreadPool() pool.start() # Allow Ctrl-C to get you out cleanly: reactor.addSystemEventTrigger('after', 'shutdown', pool.stop) wsgi_resource = wsgi.WSGIResource(reactor, pool, WSGIHandler()) return wsgi_resource This generally worked quite well. However I have an API endpoint that gets hit with multiple POST requests per second (not very much - I'd say 10-20 req/sec at most). Sometimes I see this in the logs: Internal Server Error: /cas/eventlog/ Traceback (most recent call last): File "<pythonpath>/site-packages/django/core/handlers/base.py", line 114, in get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "<pythonpath>/site-packages/django/views/decorators/csrf.py", line 57, in wrapped_view return view_func(*args, **kwargs) File "<djangoapp>/views.py", line 488, in event_log data = json.loads(request.body) File "<pythonpath>/site-packages/django/http/request.py", line 192, in body self._body = self.read() File "<pythonpath>/site-packages/django/http/request.py", line 246, in read return self._stream.read(*args, **kwargs) File "<pythonpath>/site-packages/django/core/handlers/wsgi.py", line 45, in read result = self.buffer + self._read_limited() File "<pythonpath>/site-packages/django/core/handlers/wsgi.py", line 39, in _read_limited result = self.stream.read(size) File "<pythonpath>/site-packages/twisted/web/wsgi.py", line 94, in read return self._wrapped.read(size) ValueError: I/O operation on closed file. Any pointers on why would this happen? Why would Twisted close the file early? Could it be that I need to increase the threadpool size? I use treq 0.2.0 for the requests, with the "persistent" flag turned on, if that makes any difference. Twisted 13.2.0 and Django 1.6, python 2.7.1 on OS X 10.7.5. Many thanks, Orestis

2 1

[Twisted-Python] Help non-commiter to fully test their changes locally or remote
by Adi Roiban 01 Mar '14

01 Mar '14

Hi, I am trying to gather documentation to help non-commiters test their changes before sending them to review. When run locally some tests fail with a lot of errors and is hard for a developer to filter the errors generated by his/her changes. Ex: * twistedchecker * pyflakes * api-reference I have created patches to clean pyflakes and I also plan to start cleaning the api-reference build errors >From information gathered from #twisted-dev it seems that twistedchecker is not maintained and that some of its errors are invalid... so one should not try to fix all its errors. ... I wander why twistedchecker is still used ? I would like to investigate how we can fix api-reference build errors. ------ I have created a travis-ci configuration file which can be used as a reference for running tests. It somehow copies the builders observed on buildbot.twistedmatrix.com A sample build result can be found here: https://travis-ci.org/chevah/twisted/builds/19803969 Code changes are here. If you find them useful I can refine them into a public patch. https://github.com/chevah/twisted/pull/1/files Only python 2.7 and 3.3 builders are enabled... but 2.6 builders can also be enabled. py-select-gc tests are not enabled since they are very, very slow. Running all tests on a single process could take about 1 hour. I guess that running only tests with default reactor and then pyflakes/pydoctor on changed files should cover most errors. A developer should run at least the following tests before sending a patch for review: * trial with default reactor * pyflakes for changed files * pydoctor for changed files If documentation was changed he/she should also run documentation tests. ---- Running pydoctor on my computer takes about 3 minutes... a bit long for my taste. I hope that pydoctor can be run on a independent python files so that I can create a separate linter test which will run pyflakes and pydoctor only on changes files. This should provide a big improvements in speed. I used travis-ci as it provides an isolated / reference test environment. Once the configuration is ok, it can be translated into tox [1], private buildbot [2] or custom script to allow developers to run test on their computers. If a Twisted developer has time, I need some help to check the current travis-ci errors and suggest how to fix them. Thanks! [1] https://github.com/msabramo/python-panci [2] https://github.com/isotoma/buildbot_travis -- Adi Roiban

2 2