Mailman 3 September 2014 - Twisted

[Twisted-Python] Buildbot downtime
by Tom Prince March 3, 2022

March 3, 2022

I am plannig to upgrade twisted's buildbot in the near future. In preperation for that, I am going to take down the production buildbot on Tuesday, June 26, around 1600 UTC[1]. During that time, the result of any builds done will be lost. Thus, I'd ask that people avoid committing to trunk during that time. I will send a reminder before I take down the buildbot both here, and on #twisted and #twisted-dev. Tom [1] http://timeanddate.com/worldclock/meetingtime.html?iso=20120626&p1=80&p2=22…

2 8

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz Aug. 5, 2021

Aug. 5, 2021

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |… [View More]

4 5

[Twisted-Python] Real Viagra Professional - for real sex pros
by Tamika May 1, 2019

May 1, 2019

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> <html> <head> <center> <a href="http://rqf.entercompassion.com"><img src="http://mediapix.ru/pics/685207b3dd437eff7f15c0744b5c1d3a.gif"> <title> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <link rel="stylesheet" href="http://gfx8.nnt.com/mail/12.0.1187.0824/positioning.css" /> </head> <body style="overflow:auto;"… [View More]> <div id="PrintShellToolbar"> <div class="ContainerPadding"> <span class="FloatRight"> <a href= > <img alt="" src="http://gfx1.nfi.com/mail/w2/pr02/ltr/glyph_close_rest.gif" /> <Close window> <a href= > <img alt="" src="http://gfx2.czb.com/mail/w2/pr02/ltr/i_print.gif" /> <Print> </a> </span> </div> </div> <div> <div class="BorderContainerOutline ContainerPadding"> <div class="ClearBoth"> <span class="HeaderData" style="font-size:large;"> <TuPostal.com Cambia de nombre?> </span> </div> <div class="ClearBoth"> <span class="HeaderLabel"> <From:> </span> <span class="HeaderData"> <b><TuPostal.com></b> </span> </div> <div class="ClearBoth"> <span class="HeaderLabel"> <Sent:> </span> <span class="HeaderData"> <div class="ClearBoth"> <span class="HeaderLabel"> To: </span> <span class="HeaderData"> Mikelelliott (mikelelliott(a)rlo.com) </span> </div> <br /> </div> </div> <div class="MessageBody" style=""> <br /> <div id="MessageBodyText" class="ExternalClass" style="border: 1px solid #fff ;"> <pre>Hola!<br> <br>Tupostal es ahora parte de Sonico!<br> <br>Para conocer nuestro nuevo sitio, haz clic en el siguiente link:<br><a href='http://www.gwpcom/index1.php' target='_blank'>http://www.bjncom/index1.php</a><br> <br>Sonico es un sitio donde puedes...<br>- Guardar fotos ilimitadas<br>- Re encontrarte con viejos amigos<br>- Recibir novedades de tus amigos.<br> <br>Te Esperamos! Ya somos mas de 21 millones de usuarios!!<br> <br>Sonico - Amigos Conectados<br> <br> <br>PD: Ahora tambien podras guardar tus postales<br> <br> <br>------------------------------------------<br>Haz recibido este email porque te encuentras registrado en fdm.com.<br>Si no deseas recibir mas mensajes como este, por favor haz clic en el siguiente link:<br><a href='http://www.cehcom/unsubscribe.php?type=2' target='_blank'>http://www.fyocom/unsubscribe.php?type=2</a><br> <br></pre> </div> </div> </div> </body> </html> [View Less]

8 10

[Twisted-Python] Better usage of Twisted on multi core processor
by Sumanth Puram March 13, 2015

March 13, 2015

Hi all, I have a twisted TCP server to listens to client, processes requests, do mysql database operations if needed (using adbapi Connection pool) and return the result. Before deploying this in production, I want to know right way to configure the server. Since twisted is single threaded, how can I leverage multiple cores of my production machine (which has 6 cores and 16 GB RAM) ? One approach that I thought of was to start multiple instances of twisted server on different ports. This … [View More]

5 7

[Twisted-Python] Tubes!
by exarkun＠twistedmatrix.com Dec. 12, 2014

Dec. 12, 2014

Hello all, Some of you may have heard rumors of some work in progress on a replacement for Twisted's IConsumer/IProducer interfaces. Tubes have been largely Glyph's effort (though a lot of people have contributed in one way or another). And a large effort it's been. Development is proceeding in a Twisted branch and comes to over three thousand lines of additions so far. Given the large size of the implementation and the long time that this effort has been underway (I remember the … [View More]Twisted meetup at the Rackspace offices that *I* attended when I was visiting SF... a year and a half ago... at which point tubes wasn't exactly a brand new project) I'd like to re-raise the idea that the best next step for the project is to see some distribution in its *current* state. Specifically, I think it would be beneficial to set up a tubes project on Github under the Twisted organization and try for a release in the very near future. I think this has several advantages over the status quo: 1) As an independent project, tubes will attract more attention than it presently gets as a relatively unknown ticket & branch of Twisted. 2) As a separate Python package, the logistics of actually using tubes are simpler (just consider how you might declare a dependency on a branch of Twisted - keeping in mind you may want to use tubes in a project that already depends on some version of Twisted). It may not make sense to say that it is the same quality as Twisted proper right off the bat (on the other hand, it may well - I suspect tubes in its current form actually is a lot higher quality than large sections of Twisted) but that doesn't mean people (not to mention the tubes project) can't benefit from being able to experiment with it. 3) Decoupling tubes from Twisted frees tubes from certain of Twisted's policies which are more challenging to follow for the kind of non- trivial, brand new code base that tubes is. Technically we could just say that these policies don't apply to a tubes package *in* Twisted but this kind of subtle distinction is often lost on users (ie application developers). a) Twisted's compatibility policy need not apply. It could either be sped up or abandoned more thoroughly. I'm generally a fan of being backwards compatible even when you have few users because it actually makes development easier, but loosening the policy to say things might break if it's just really inconvenient to keep them working (whereas Twisted goes to the inconvenience to keep them working) seems reasonable. b) tubes can undergo a faster release cycle to benefit more from user feedback. 4) At this point, a normal review of the tubes branch is going to be a problem. We do not have good tools or mechanisms for dealing with branches this large. The code in the current tubes branch can just become master of a new project. Development going forward from this point should continue to follow the feature-branch, small-changes, pre- commit-peer-review process. But those 3k lines are written already. Short of an extremely expensive effort to break the work up into smaller, self-contained pieces there's simply never going to be a *good* review in the typical style. Additionally, it may turn out that tubes can remain independent indefinitely. Someday perhaps Twisted would come to depend on it to allow the various protocols and applications implemented in Twisted to benefit from the superior abstractions it provides. Or maybe once it has undergone a few iterations it will make sense to bring it back to Twisted. I don't think this needs to be decided now. There are downsides, of course. All of the boring maintenance involved with having a separate project - setting up CI, actually doing the releases, etc. Perhaps we could find some volunteers to help out with these tasks, though, in exchange for getting some great code out there? I'm curious what the folks out there who develop applications using Twisted would find to be the easiest path forward. I'm also curious to hear what Glyph thinks about all this. ;) Jean-Paul [View Less]

10 14

[Twisted-Python] patch for t.p.logger.SyslogObserver (was #7549)
by Roberto Polli Dec. 5, 2014

Dec. 5, 2014

Hi everybody, I found some time for adding a stub of SyslogObserver to the new t.p.logger. https://github.com/ioggstream/twisted/commit/991156e1124d61ad26da0be1212307… Feedback welcome! Peace, R. -- Roberto Polli Community Manager Babel - a business unit of Par-Tec S.p.A. - http://www.babel.it T: +39.06.9826.9651 M: +39.340.652.2736 F: +39.06.9826.9680 P.zza S.Benedetto da Norcia, 33 - 00040 Pomezia (Roma) CONFIDENZIALE: Questo messaggio ed i suoi allegati sono di carattere … [View More]

3 5

[Twisted-Python] naming question before we end up committed...
by Glyph Oct. 8, 2014

Oct. 8, 2014

While working on the package I just brought up in another thread, I realize we have another big new package coming in 14.1, "twisted.python.logger", and I'm wondering what the ".python" part of that package name is doing in there, and what value it adds. It's where "twisted.python.log" used to be, of course, but now I'm just wondering if we're just making the same mistake twice. Does anyone have an opinion on renaming it to "twisted.logger"? Or have a better suggestion? -glyph

5 5

[Twisted-Python] INCOMPATIBLE CHANGE: twisted.python.threadpool
by Glyph Lefkowitz Oct. 2, 2014

Oct. 2, 2014

Hi all, (For those of you wondering about the subject, note that this message is sent in compliance with This email sent in compliance with <https://twistedmatrix.com/trac/wiki/CompatibilityPolicy#ProcedureforExcepti…>.) I've been trying to improve the reliability of the buildbots. (On that note, by the way, several builders are failing and more will be soon as security updates roll out, it would be great if someone could review <https://twistedmatrix.com/trac/ticket/7651> before … [View More]the whole fleet turns red.) In so doing I (re-)discovered this bug: <https://twistedmatrix.com/trac/ticket/2673>. At first I just wanted to delete an intermittently failing test which appears to be nonsense. However, after some prodding from exarkun, I investigated and discovered that this very poorly-written test case does in fact illustrate a real problem with our current threadpool implementation which can result in deadlocks, hangs on exit, and other unpleasantness. In my use of Twisted I have encountered several "huh, this can't happen, maybe cosmic rays or something" bugs which might have been caused by this, so I would very much like to fix it. One reason that our threadpool implementation is problematic is that it has a somewhat complex internal design, lots of weird little features (context preservation, completion callbacks, workload estimation) all built at the same layer with no composition. I tried to figure out a way to salvage its current architecture and I could not reasonably do so. I have prototyped a completely new threadpool implementation ("twisted.threads") in a spike. It is definitely not ready for review, but I would definitely appreciate design-level feedback on the code right now. You can see the implementation here: <https://twistedmatrix.com/trac/browser/branches/desynchronize-2673/twisted/…> (or here: <https://github.com/twisted/twisted/tree/desynchronize-2673/twisted/threads> if that's more your speed) It's less code than the existing implementation and provides more useful features at the same time. It might, in fact, provide some of the threading primitives that we would need for a reactor-per-thread implementation. However, there is a very ugly implementation detail that prevents us from marching onwards to a glorious multithreading future: twisted.internet.interfaces.IReactorThreads.getThreadPool. The nominally "public" interface provided by its documented return type, the concrete (old-style!) class twisted.python.threadpool.ThreadPool, is ridiculously over-broad. Here are the features (attributes and methods) in its "public" interface: callInThread callInThreadWithCallback adjustPoolsize start stop q min max joined started name waiters threads working workers start startAWorker stopAWorker dumpStats __getstate__ __setstate__ threadFactory currentThread Here's what I would like its public interface to be, more or less what it's intended to be, based on the ways it's documented and used in Twisted and in the various projects I can see using it: callInThread callInThreadWithCallback adjustPoolsize start stop It would not be too much effort to also preserve, for legacy purposes: min max joined started name dumpStats However, I would REALLY like to delete these implementation details: workers threads working startAWorker q __getstate__ __setstate__ threadFactory currentThread Deleting these implementation details straight up would also make it such that anyone who inherited from the public class ThreadPool would not be able to override any of these things (oh my goodness, why would you do that, I really hope nobody has done that). The three ways I could proceed, in order of my own preference, are: Put the new implementation with entirely new interfaces into twisted.threads, put a compatibility shim into twisted.python.threadpool.ThreadPool that wraps those objects, provides my more minimal interface proposed above, and deletes 90% of its tests. Change IReactorThreads.getThreadPool to return a documented interface considerably more restricted than Compatibility implications: twisted.internet.interfaces.IReactorThreads's contract would be relaxed. Implementors of IReactorThreads would not see an impact unless they were talking to deleted parts of ThreadPool internally. ThreadPool's clients would have several methods removed, and subclassing would effectively not be possible any more (a bunch of overridable hooks would have been removed, and no replacements would be provided). However, I prefer this option because there are an extremely restrictive set of use-cases (basically: only logging, any behavioral changes would have been broken) where clients could have made legitimate use of these attributes or overriding any of these functions. Delete all of twisted.python.threadpool's test coverage, deprecate the entire module, and delete it in the next release (14.1+1). This has the advantage of making the test suite reliable, and gets the benefits for any users of callInThread, but does not relay any of the benefits to users of ThreadPool. The only ones doing this directly in Twisted are deferToThreadPool (and by extension, deferToThread) and WSGIResource. I could update these in tandem, however; the code changes would be very small. I don't think it would be incompatible to make WSGIResource itself accept a different type of constructor argument (although if we don't, I wonder if subclassing anything with a constructor can be considered applicable to the compatibility policy in Twisted; hmm). Actually go through the trouble of emulating all the attributes on ThreadPool and emulating them as best I can. Delete the direct tests for ThreadPool itself and write a private subclass that will be returned from getThreadPool that returns a compatibility shim which isinstance(ThreadPool) for compatibility and still has all the gross attributes. This change would be technically compatible, but would be a huge amount of additional work and I am doubtful that it would provide any value. So, does anyone out there have any code which makes use of the aforementioned bad attributes of ThreadPool, whose applications would break if I removed them? If so, how can I make you feel as bad about yourselves for using it as I feel bad about myself for writing it? ;-) -glyph [View Less]

7 10

[Twisted-Python] twistedchecker TypeError: modifiedBlankLines() takes exactly 6 arguments (7 given)
by Wolfgang Rohdewald Sept. 30, 2014

Sept. 30, 2014

I am getting this traceback on about every source file like: i5:~/ssdsrc/alt/Twisted/twisted/test (pb3) twistedchecker reflect_helper_ZDE.py ************* Module reflect_helper_ZDE W9001: 1,0: Missing copyright header W9002: 1,0: Missing a reference to test module in header C0103: 1,0: Invalid name "reflect_helper_ZDE" for type module (should match (([a-z_][a-z0-9_]*))$) W9208: 1,0: Missing docstring Traceback (most recent call last): File "/usr/local/bin/twistedchecker", line 5, in … [View More]<module> pkg_resources.run_script('TwistedChecker==0.2.0', 'twistedchecker') File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 528, in run_script self.require(requires)[0].run_script(script_name, ns) File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 1394, in run_script execfile(script_filename, namespace, namespace) File "/usr/lib/python2.7/dist-packages/TwistedChecker-0.2.0-py2.7.egg/EGG-INFO/scripts/twistedchecker", line 10, in <module> Runner().run(sys.argv[1:]) File "/usr/lib/python2.7/dist-packages/TwistedChecker-0.2.0-py2.7.egg/twistedchecker/core/runner.py", line 325, in run self.linter.check(args) File "/usr/lib/python2.7/dist-packages/pylint-0.26.0-py2.7.egg/pylint/lint.py", line 542, in check self.check_astng_module(astng, walker, rawcheckers) File "/usr/lib/python2.7/dist-packages/pylint-0.26.0-py2.7.egg/pylint/lint.py", line 615, in check_astng_module walker.walk(astng) File "/usr/lib/python2.7/dist-packages/pylint-0.26.0-py2.7.egg/pylint/utils.py", line 553, in walk cb(astng) File "/usr/lib/python2.7/dist-packages/TwistedChecker-0.2.0-py2.7.egg/twistedchecker/checkers/pep8format.py", line 179, in visit_module self._runPEP8Checker(node.file) File "/usr/lib/python2.7/dist-packages/TwistedChecker-0.2.0-py2.7.egg/twistedchecker/checkers/pep8format.py", line 188, in _runPEP8Checker recorder = PEP8WarningRecorder(file) File "/usr/lib/python2.7/dist-packages/TwistedChecker-0.2.0-py2.7.egg/twistedchecker/checkers/pep8format.py", line 49, in __init__ self.run() File "/usr/lib/python2.7/dist-packages/TwistedChecker-0.2.0-py2.7.egg/twistedchecker/checkers/pep8format.py", line 78, in run pep8.Checker.check_all(self) File "/usr/lib/python2.7/dist-packages/pep8-1.5.7-py2.7.egg/pep8.py", line 1445, in check_all self.check_logical() File "/usr/lib/python2.7/dist-packages/pep8-1.5.7-py2.7.egg/pep8.py", line 1338, in check_logical for offset, text in self.run_check(check, argument_names) or (): File "/usr/lib/python2.7/dist-packages/pep8-1.5.7-py2.7.egg/pep8.py", line 1278, in run_check return check(*arguments) TypeError: modifiedBlankLines() takes exactly 6 arguments (7 given) -- Wolfgang [View Less]

4 6

[Twisted-Python] glorious green
by Glyph Sept. 29, 2014

Sept. 29, 2014

I will probably be going to sleep before py-select-gc gets around to finishing, but other than that, <http://buildbot.twistedmatrix.com/boxes-supported?branch=/branches/open-fil…> is completely green. If <https://twistedmatrix.com/trac/ticket/7633> were reviewed, we might be able to make <http://buildbot.twistedmatrix.com/boxes-supported?branch=trunk&num_builds=10> look a bit more like the solid green rectangle it really ought to be. -glyph

1 0

[Twisted-Python] Python 3.3 buildslaves
by exarkun＠twistedmatrix.com Sept. 29, 2014

Sept. 29, 2014

Hello, I noticed that https://twistedmatrix.com/trac/ticket/7355 is a blocker for the release of Twisted 14.1 and #7355 is blocked Python 3.3 buildbot configuration/availability issues. Who can look at why one of the Python 3.3 slaves is offline and why the two slaves are configured differently? Thanks, Jean-Paul

5 8

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com Sept. 28, 2014

Sept. 28, 2014

1 0

[Twisted-Python] Security Advisory: bash remote code execution
by Alex Gaynor Sept. 25, 2014

Sept. 25, 2014

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi all, Today a security release of Bash was issued, fixing a critical vulnerability. This vulnerability allows an attacker to inject and execute arbitrary code on many web servers and other applications. This issue does not affect Twisted directly, but will affect many users of Twisted. Any web server which is serving traffic over a CGI or CGI-like interface (including WSGI) should upgrade its version of Bash immediately. This issue has been … [View More]

4 3

[Twisted-Python] advice sought - two database connections in a RunInteraction (adbapi.ConnectionPool)
by Jonathan Vanasco Sept. 23, 2014

Sept. 23, 2014

I've got some database transactional code running within a thread via RunInteraction (it needs to rollback on error). One of the features on the logic is that it interacts with a 3rd party API, which may or may not have a ratelimit in effect. Most 3rd party APIs i consume have a minute/hourly based limit -- so I just do a graceful fail on the transaction to requeue it, and set a local timeout. This particular API has a per-second meter in effect. It is considerably more efficient to just … [View More]

2 2

[Twisted-Python] GPRS/Modem protocol through USB support
by Simon Andrieu Sept. 22, 2014

Sept. 22, 2014

Hi, I work for a company that develops telemetry boxes, and that uses the Twisted framework running on the main board. It is planned to integrate a cellular module connected via USB or serial link to the main board. Could you help me to know if GPRS/3G/Modem protocols through USB are supported with Twisted please? And how it is possible to use this interface? Thanks for your help. Best Regards, Simon Andrieu

4 6

[Twisted-Python] On testing things wrapping other things
by weykent Sept. 21, 2014

Sept. 21, 2014

Hi, Recently I worked on refactoring a project so that it was, in my opinion, more testable. For reference, the diff is available at <https://github.com/Weasyl/txyam/compare/Weasyl:9230b7d09c1413a09d776700f26a…>, and the important parts in the changed version are at <https://github.com/Weasyl/txyam/blob/cdf7aef9e3425f27016f8e97c59bd2143fbf80…>. My question: is this a good factoring for testing a wrapper? It seems to make sense to split apart crafting and issuing requests to … [View More]

2 3

[Twisted-Python] natty64-py2.7maint & twistedchecker builders
by exarkun＠twistedmatrix.com Sept. 21, 2014

Sept. 21, 2014

Hello, These two builders appear to be having problems. See, for example: https://buildbot.twistedmatrix.com/builders/natty64-py2.7maint/builds/4193 https://buildbot.twistedmatrix.com/builders/twistedchecker/builds/2229 Jean-Paul

4 5

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com Sept. 21, 2014

Sept. 21, 2014

1 0

[Twisted-Python] are there known ssl/threading/socket issues with httplib2/httplib and Twisted ?
by Jonathan Vanasco Sept. 18, 2014

Sept. 18, 2014

Background: I'm using a 3rd party API client, which uses httplib2 in the internals. ( the google-plus api ) I'm placing this blocking code within a DeferredList, that runs within a twisted.enterprise.adbapi.ConnectionPool.runInteraction In my initial tests, everything worked fine -- but I was only making a single GET/POST, as I kept the size of the DeferredList to 1 while I worked on the code. As soon as I increased the limit and had 2 GET/POST events firing off at the same time, I started … [View More]

3 3

[Twisted-Python] Twisted 14.0.1 Release Announcement
by HawkOwl Sept. 17, 2014

Sept. 17, 2014

On behalf of Twisted Matrix Laboratories, I’m releasing Twisted 14.0.1, a security release for Twisted 14.0. It is strongly suggested that users of 14.0.0 upgrade to this release. This patches a bug in Twisted Web’s Agent, where BrowserLikePolicyForHTTPS would not honour the trust root given, and would use the system trust root instead. This would have broken, for example, attempting to pin the issuer for your HTTPS application because you only trust one issuer. Note: on OS X, with the system … [View More]

1 0

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com Sept. 14, 2014

Sept. 14, 2014

1 0

[Twisted-Python] workflow
by Daniel Sank Sept. 12, 2014

Sept. 12, 2014

I would greatly benefit from some direction regarding workflow. In particular, how do you guys deal with having an installed version of twisted, and a version (versions?) with which to tinker? Currently, I have twisted installed in the normal end user way, and I have a clone of my fork of the git repo. I mess around in the git repo clone, but I don't know how to e.g. run the tests or run applications using the git clone. glyph explained this to me on irc a while back. Are the instructions … [View More]

2 1

[Twisted-Python] epoll 2.4 kernel
by Reuben Hawkins Sept. 11, 2014

Sept. 11, 2014

Not sure if this is the right mailing list for this.... epoll should *not* be used on 2.4 kernels... I have 2.4 kernel running on a 32-bit x86 machine and another 2.4 kernel running on 64-bit x64 and I'm having an issue with twisted (via buildbot). I can import epoll from select on the 64-bit machine (it *should* fail but doesn't) and this later causes twisted to fail... >>> from select import epoll >>> epoll(1) Traceback (most recent call last): File "<stdin>", … [View More]

3 2

[Twisted-Python] Python3: should paths be bytes or str?
by Wolfgang Rohdewald Sept. 10, 2014

Sept. 10, 2014

The porting guide says No byte paths in sys.path. I am not sure what this means, I would assume that file paths should always be native strings. Or does it mean that sys.path must only contain ascii bytes? doc for FilePath says On both Python 2 and Python 3, paths can only be bytes. and svn commit 35410 by itamarst changed the doc for some path functions in python/filepath.py from str to bytes but not all of them: fgrep 'type path:' filepath.py @type path: L{str} @type … [View More]

4 6

[Twisted-Python] a brief note about buildbots
by Glyph Lefkowitz Sept. 10, 2014

Sept. 10, 2014

Hi Twistosophists, Some of you doing reviews (you ARE all doing code reviews, right!?!?) might have noticed that some of the boxes on the left side of of the supported builds page were dark grey, meaning that they were offline. I spent some time over the last couple of days doing some administrative housekeeping and rebooting computers, and all of our supported builders are now back online! This makes me feel much better about the possibility of doing a release again someday :-). Speaking … [View More]

3 2