Mailman 3 August 2016 - Twisted

[Twisted-Python] Buildbot downtime
by Tom Prince 03 Mar '22

03 Mar '22

I am plannig to upgrade twisted's buildbot in the near future. In preperation for that, I am going to take down the production buildbot on Tuesday, June 26, around 1600 UTC[1]. During that time, the result of any builds done will be lost. Thus, I'd ask that people avoid committing to trunk during that time. I will send a reminder before I take down the buildbot both here, and on #twisted and #twisted-dev. Tom [1] http://timeanddate.com/worldclock/meetingtime.html?iso=20120626&p1=80&p2=22…

2 8

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz 05 Aug '21

05 Aug '21

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |_____| |_____ | | | | @ t w i s t e d m a t r i x . c o m http://www.twistedmatrix.com/~glyph/

4 5

[Twisted-Python] Real Viagra Professional - for real sex pros
by Tamika 01 May '19

01 May '19

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> <html> <head> <center> <a href="http://rqf.entercompassion.com"><img src="http://mediapix.ru/pics/685207b3dd437eff7f15c0744b5c1d3a.gif"> <title> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <link rel="stylesheet" href="http://gfx8.nnt.com/mail/12.0.1187.0824/positioning.css" /> </head> <body style="overflow:auto;"> <div id="PrintShellToolbar"> <div class="ContainerPadding"> <span class="FloatRight"> <a href= > <img alt="" src="http://gfx1.nfi.com/mail/w2/pr02/ltr/glyph_close_rest.gif" /> <Close window> <a href= > <img alt="" src="http://gfx2.czb.com/mail/w2/pr02/ltr/i_print.gif" /> <Print> </a> </span> </div> </div> <div> <div class="BorderContainerOutline ContainerPadding"> <div class="ClearBoth"> <span class="HeaderData" style="font-size:large;"> <TuPostal.com Cambia de nombre?> </span> </div> <div class="ClearBoth"> <span class="HeaderLabel"> <From:> </span> <span class="HeaderData"> <b><TuPostal.com></b> </span> </div> <div class="ClearBoth"> <span class="HeaderLabel"> <Sent:> </span> <span class="HeaderData"> <div class="ClearBoth"> <span class="HeaderLabel"> To: </span> <span class="HeaderData"> Mikelelliott (mikelelliott(a)rlo.com) </span> </div> <br /> </div> </div> <div class="MessageBody" style=""> <br /> <div id="MessageBodyText" class="ExternalClass" style="border: 1px solid #fff ;"> <pre>Hola!<br> <br>Tupostal es ahora parte de Sonico!<br> <br>Para conocer nuestro nuevo sitio, haz clic en el siguiente link:<br><a href='http://www.gwpcom/index1.php' target='_blank'>http://www.bjncom/index1.php</a><br> <br>Sonico es un sitio donde puedes...<br>- Guardar fotos ilimitadas<br>- Re encontrarte con viejos amigos<br>- Recibir novedades de tus amigos.<br> <br>Te Esperamos! Ya somos mas de 21 millones de usuarios!!<br> <br>Sonico - Amigos Conectados<br> <br> <br>PD: Ahora tambien podras guardar tus postales<br> <br> <br>------------------------------------------<br>Haz recibido este email porque te encuentras registrado en fdm.com.<br>Si no deseas recibir mas mensajes como este, por favor haz clic en el siguiente link:<br><a href='http://www.cehcom/unsubscribe.php?type=2' target='_blank'>http://www.fyocom/unsubscribe.php?type=2</a><br> <br></pre> </div> </div> </div> </body> </html>

8 10

Re: [Twisted-Python] More tests running on Python 3
by Craig Rodrigues 15 Nov '16

15 Nov '16

I looked at latest Travis builds on Linux: DATE BUILD ==== ===== August 11, 2016 https://travis-ci.org/twisted/twisted/jobs/151440581 Tests on Python 2.7 =============== 11640 (skips=2083, successes=9557) Tests on Python 3.5 ================ 9647 (skips=2008, successes=7639) -- Craig On Thu, Jun 30, 2016 at 3:43 PM, Craig Rodrigues <rodrigc(a)crodrigues.org <rodrigc(a)freebsd.org>> wrote: > Hi, > > I looked at these two Travis builds on Linux > > DATE BUILD > ==== ===== > June 3, 2016 https://travis-ci.org/twisted/twisted/builds/135219940 > June 30, 2016 https://travis-ci.org/twisted/twisted/builds/141426367 > > > I noticed: > > DATE Tests on Python 2.7 > ==== ===================================== > June 3, 2016 11438 (skips=3013, successes=8425) > June 30, 2016 11496 (skips=2063, successes=9433) > > > DATE Tests on Python 3.5 > ==== ===================================== > June 3, 2016 6367 (skips=1533, successes=4834) > June 30, 2016 7902 (skips=1693, successes=6209) >

3 3

[Twisted-Python] Twisted Challenge Coins!
by Ashwini Oruganti 01 Oct '16

01 Oct '16

Hello! We are planning to get us some challenge coins, which is exciting! You should also be excited with us because this means: - we can now give it out to contributors at sprints and meetups. - challenge coins are awesome. Each coin costs about $6, and the minimum order is 100 coins. Glyph thinks everyone should have some to give out as tokens of appreciation to other contributors, and glyph's thoughts are usually worth following. So, if you are a Twisted contributor and would like to own a challenge coin, please respond to this email. Also, do mention how many coins you would like, and where you are located so that we can send you your coin(s). -ashfall

8 10

[Twisted-Python] How do you determine the buffer size of a transport - a use-case for not using back pressure
by Steve Morin 29 Sep '16

29 Sep '16

Twisted Community Problem: How do you determine the buffer size of a transport, to know how much data is waiting to be transmitted from using transport.write? Wait! You're going to say: use the Producer Consumer API ( http://twistedmatrix.com/documents/current/core/howto/producers.html ) To do what: So that instead of using back pressure I can check the buffer and when it's "too big/full" can decide to do something to the transport I am writing to: Slow transport handling options: - Buffer to disk instead of memory - Kill the transport - Decide to skip sending some data - Send an error or message to the transport I am writing to - Reduce the resolution, increase the compression (things like video or audio) Why not use back pressure?: Some use-cases and some protocols this doesn't make sense. Examples: - You're sending video and if the receiver can't keep up you want to downgrade or upgrade the quality of the video, but if you don't know if you can't tell how much it buffering. - You're receiving from one connection and then broadcasting what you received to multiple clients and you want to handle it by sending an error to a client that doesn't keep up - You're sending a real-time protocol and want to skip sending some data that's no longer relevant if the buffer is too slow. On a server what are the consequences: Too much buffering in many transport write buffer can cause a server to fail. I don't know how to keep track of this to proactively without access to the buffer sizes. Resolutions can then be to, not accept new connections when memory pressure is too high, kill connections with the weakest/slowest clients or have a protocol that can have client switch connections to new servers when instructed to spread out the load. 1) I would like to hear on how people would solve this sort of problem in Twisted for a server? 2) I would like to hear people opinions on this in general. Tobias Oberstein - BCC'ed you on this email because you seems to have tackled similar problems (based on the mailing list) and would really love to get your take on this too. Glyph and Jean-Paul, you're also big on those threads so any opinions you have would be appreciated as well. Some of my background research * http://twistedmatrix.com/pipermail/twisted-python/2015-January/029064.html * Later but good in the chain: http://twistedmatrix.com/pipermail/twisted-python/2015-January/029071.html * Twisted receiving buffers swamped? * Summary: Great thread but runs into a tangent for a while and picks up good at the end again discussing producer again and the need for backpressure * Other: * http://crossbar.io/ * http://tavendo.com/ * Scenario: "Twisted is reading off the TCP stack from the kernel and buffering in userspace faster than the echo server is pushing out stuff to the TCP stack into the kernel. Hence, no TCP backpressure results, netperf happily sends more and more, and the memory of the Twisted process runs away." * Confirmed: Data isn't Buffered in "userspace inside Twisted, and before data is handled by the app in dataReceived." * https://twistedmatrix.com/pipermail/twisted-python/2010-September/022900.ht… * How to cap the buffering size of data to be sent in Protocol class * Summary: Same issue, very short no good info * https://twistedmatrix.com/pipermail/twisted-python/2012-March/025416.html * Limit on transport.write * Summary: Similar issue, very short no good info, glyph confirms that transport.write buffers everything sent to it. * https://twistedmatrix.com/pipermail/twisted-python/2012-February/025215.html * pushing out same message on 100k TCPs * Summary: Interesting discussion but different issue - interesting aside about irc spanning trees for a large broadcasts * http://twistedmatrix.com/pipermail/twisted-python/2008-April/017503.html * Question on push/pull producers inter-workings, was : "Is there a simple Producer/Consumer example or tutorial?" * Summary: Related and goes into what a producer is - an explanation of it * http://twistedmatrix.com/pipermail/twisted-python/2004-May/007732.html * When do calls to transport.write() block ? * Summary: Discusses the right issue, talks about buffer call back if full which would be great (if configurable) * https://pythonhosted.org/qbuf/qbuf.twisted_support.MultiBufferer-class.html * https://launchpad.net/qbuf * Summary: c buffer implementation that's incomplete thought might be promising * http://stackoverflow.com/questions/21821119/twisted-producer-to-many-client… * Summary: Was indicating a similar use-case but source doesn't seem to exist on the internet * http://twistedmatrix.com/documents/current/core/howto/producers.html * Summary: Documentation on Producer and Consumers but only help with a backpressure scenario * http://twistedmatrix.com/pipermail/twisted-python/2007-July/015690.html * Summary: Discussion on how producer-consumer API's work and future enhancement no help * MANY MORE THAT 100% NOT RELEVANT -- Steve Morin | Hacker, Entrepreneur, Startup Advisor twitter.com/SteveMorin | stevemorin.com *Live the dream start a startup. Make the world ... a better place.*

5 4

[Twisted-Python] very weird 16.4 upgrade breakage
by Glyph Lefkowitz 31 Aug '16

31 Aug '16

On Mimic, the requires.io PR that upgraded us to Twisted 16.4 broke the build. It did so in a really weird way: https://travis-ci.org/rackerlabs/mimic/jobs/156439316 Specifically, our mac app CI tests failed like so: File "pkg_resources/extern/__init__.pyc", line 61, in load_module exceptions.ImportError: The 'appdirs' package is required; normally this is bundled with this package so if you get this warning, consult the packager of your distribution. Any idea why 'appdirs' might suddenly become a hard dependency of pkg_resources, but only in the py2app bundle? Did something change about the way we referenced dependencies? -glyph

1 0

[Twisted-Python] Twisted 16.4.0 Release Announcement
by Amber "Hawkie" Brown 28 Aug '16

28 Aug '16

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release of Twisted 16.4.0. The highlights of this release are: - twist, a new command line tool for running Twisted plugins, similar to twistd but with a simpler, cleaner interface. - A new interface for Protocols, IHandshakeListener, which tells Twisted to tell the Protocol when the TLS handshake has been completed. - async/await support for Deferreds, allowing you to write Python 3.5+ coroutines using Twisted - Trial can be invoked with "python -m twisted.trial". - All Twisted executables (trial, twistd, etc) are now Setuptools console scripts, meaning they will work much better on Windows. - 35+ more modules ported to Python 3, and many many cleanups on the way to Python 3 on Windows support. - All the security fixes of Twisted 16.3.1 + 16.3.2 (httpoxy, HTTP session identifier strengthening, HTTP+TLS consuming sockets) - 240+ closed tickets overall. For more information, check the NEWS file (link provided below). You can find the downloads at <https://pypi.python.org/pypi/Twisted <https://pypi.python.org/pypi/Twisted>> (or alternatively <http://twistedmatrix.com/trac/wiki/Downloads <http://twistedmatrix.com/trac/wiki/Downloads>>). The NEWS file is also available at <https://github.com/twisted/twisted/blob/twisted-16.4.0/NEWS <https://github.com/twisted/twisted/blob/twisted-16.4.0/NEWS>>. Many thanks to everyone who had a part in this release - the supporters of the Twisted Software Foundation, the developers who contributed code as well as documentation, and all the people building great things with Twisted! Twisted Regards, Amber Brown (HawkOwl) PS: Twisted 16.4.1 will be coming soon after this with a patch mitigating SWEET32, by updating the acceptable cipher list.

2 1

[Twisted-Python] Twisted 16.3.2/16.4.0 Release Errata
by Amber "Hawkie" Brown 28 Aug '16

28 Aug '16

Hi everyone, Just a note to say that the HTTP/1 + TLS leaking CLOSE_WAIT sockets issue, fixed in 16.3.2 and 16.4.0, has been assigned a CVE, CVE-2016-7100. It'll start showing up on the various CVE databases soon. - Amber

1 0

[Twisted-Python] Twisted 16.4.1 Prerelease 1 Announcement
by Amber "Hawkie" Brown 28 Aug '16

28 Aug '16

Hello again everyone, I bring you a prerelease of the Twisted 16.4.1 security fix release, thus deemed 16.4.1pre1. This release contains: - A mitigation for SWEET32 (https://www.openssl.org/blog/blog/2016/08/24/sweet32/ <https://www.openssl.org/blog/blog/2016/08/24/sweet32/>). - The inclusion of ChaCha20 to our TLS cipher suite, providing your underlying OpenSSL supports it. Please note that the SWEET32 mitigation will break TLS from IE on Windows XP. This shouldn't be an issue for you (hopefully), but if you need to support those poor XP using souls, you can add 3DES back to your CertificateOptions yourself. As usual, it's available for download -- go here (https://twistedmatrix.com/Releases/pre/16.4.1pre1/ <https://twistedmatrix.com/Releases/pre/16.4.1pre1/>) to get the prerelease tarballs and the full NEWS file. If you want to install it right away, run: pip install https://twistedmatrix.com/Releases/pre/16.4.1pre1/Twisted-16.4.1rc1.tar.bz2 <https://twistedmatrix.com/Releases/pre/16.4.1pre1/Twisted-16.4.1rc1.tar.bz2> Please let me know if you have any issues, as well as if you don't! If everything works well, that's a good thing for me to know :) Have fun, and stay secure! Twisted Regards, Amber Brown (HawkOwl)

1 0