Mailman 3 January 2018 - Twisted

[Twisted-Python] Buildbot downtime
by Tom Prince 03 Mar '22

03 Mar '22

I am plannig to upgrade twisted's buildbot in the near future. In preperation for that, I am going to take down the production buildbot on Tuesday, June 26, around 1600 UTC[1]. During that time, the result of any builds done will be lost. Thus, I'd ask that people avoid committing to trunk during that time. I will send a reminder before I take down the buildbot both here, and on #twisted and #twisted-dev. Tom [1] http://timeanddate.com/worldclock/meetingtime.html?iso=20120626&p1=80&p2=22…

2 8

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz 05 Aug '21

05 Aug '21

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |_____| |_____ | | | | @ t w i s t e d m a t r i x . c o m http://www.twistedmatrix.com/~glyph/

4 5

[Twisted-Python] Real Viagra Professional - for real sex pros
by Tamika 01 May '19

01 May '19

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> <html> <head> <center> <a href="http://rqf.entercompassion.com"><img src="http://mediapix.ru/pics/685207b3dd437eff7f15c0744b5c1d3a.gif"> <title> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <link rel="stylesheet" href="http://gfx8.nnt.com/mail/12.0.1187.0824/positioning.css" /> </head> <body style="overflow:auto;"> <div id="PrintShellToolbar"> <div class="ContainerPadding"> <span class="FloatRight"> <a href= > <img alt="" src="http://gfx1.nfi.com/mail/w2/pr02/ltr/glyph_close_rest.gif" /> <Close window> <a href= > <img alt="" src="http://gfx2.czb.com/mail/w2/pr02/ltr/i_print.gif" /> <Print> </a> </span> </div> </div> <div> <div class="BorderContainerOutline ContainerPadding"> <div class="ClearBoth"> <span class="HeaderData" style="font-size:large;"> <TuPostal.com Cambia de nombre?> </span> </div> <div class="ClearBoth"> <span class="HeaderLabel"> <From:> </span> <span class="HeaderData"> <b><TuPostal.com></b> </span> </div> <div class="ClearBoth"> <span class="HeaderLabel"> <Sent:> </span> <span class="HeaderData"> <div class="ClearBoth"> <span class="HeaderLabel"> To: </span> <span class="HeaderData"> Mikelelliott (mikelelliott(a)rlo.com) </span> </div> <br /> </div> </div> <div class="MessageBody" style=""> <br /> <div id="MessageBodyText" class="ExternalClass" style="border: 1px solid #fff ;"> <pre>Hola!<br> <br>Tupostal es ahora parte de Sonico!<br> <br>Para conocer nuestro nuevo sitio, haz clic en el siguiente link:<br><a href='http://www.gwpcom/index1.php' target='_blank'>http://www.bjncom/index1.php</a><br> <br>Sonico es un sitio donde puedes...<br>- Guardar fotos ilimitadas<br>- Re encontrarte con viejos amigos<br>- Recibir novedades de tus amigos.<br> <br>Te Esperamos! Ya somos mas de 21 millones de usuarios!!<br> <br>Sonico - Amigos Conectados<br> <br> <br>PD: Ahora tambien podras guardar tus postales<br> <br> <br>------------------------------------------<br>Haz recibido este email porque te encuentras registrado en fdm.com.<br>Si no deseas recibir mas mensajes como este, por favor haz clic en el siguiente link:<br><a href='http://www.cehcom/unsubscribe.php?type=2' target='_blank'>http://www.fyocom/unsubscribe.php?type=2</a><br> <br></pre> </div> </div> </div> </body> </html>

8 10

[Twisted-Python] Circular references in TLSMemoryBIOProtocol
by Ilya Skriblovsky 10 Mar '18

10 Mar '18

Hello, I have the Twisted app that serves tons of short-lived TLS connections using TLSMemoryBIOFactory. I usually set loosened garbage collector thresholds in production environment for the sake of performance. But I've noticed that this app's RAM usage quickly grows up to unreasonable values. Digging into the issue using pdb and objgraph showed that protocol instances are still living long after they were closed. I found two circular dependencies which are created for each TLS connection: 1. Between twisted.protocols.policies.ProtocolWrapper and its self.wrappedProtocol 2. Between twisted.protocols.tls.TLSMemoryBIOProtocol and its self._tlsConnection Both of them cause protocol instance to not be deleted when the connection is closed. So all OpenSSL-related objects and all business-related data attached to that protocol instance are still living untill the next GC collection. This affects both RAM usage and performance (due to much more often GC collections) I've tried to fix both circular dependencies: replaced https://github.com/twisted/twisted/blob/trunk/src/twisted/protocols/policie… by self.wrappedProtocol.makeConnection(weakref.proxy(self)) and replaced https://github.com/twisted/twisted/blob/trunk/src/twisted/protocols/tls.py#… by: self._tlsConnection = self.factory._createConnection(weakref.proxy(self)) Memory usage pattern changed drastically after this change. I've created demo script that makes 10k TLS loopback connections with GC disabled and measures the number of objects are still living after the work is done and total resident RAM consumption: https://gist.github.com/IlyaSkriblovsky/4dd3abfd5f67c64b13f1c673f56466f9 Output without the fix: N = 10000 , K = 100 objects before 50136 DummyServerProtocols still living 10000 objects after 439919 mem 778 mb Output with the fix: N = 10000 , K = 100 objects before 50133 DummyServerProtocols still living 0 objects after 159919 mem 96 mb So using weakrefs makes all protocol instances and instances of TLSMemoryBIOProtocol to be deleted right after a connection is closed. Less circular-dependent objects → less GC invocations → better performance. And I see much nicer RAM usage pattern in my app. Is it possible to fix circular deps in some more clean way? Can this be solved at all while user's code is able to try to touch both sides of circular dep after connection is closed? Please advice Thanks for consideration Best regards, Ilya

4 15

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com 28 Jan '18

28 Jan '18

1 0

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com 21 Jan '18

21 Jan '18

1 0

[Twisted-Python] stdlib logger, loggerFor and filtering events
by Felipe Dau 15 Jan '18

15 Jan '18

As the logger has been brought up, I'd like to ask a couple things: 1) When I was working on adding logs to an application, I wanted it to use both the `textFileLogObserver` and the `STDLibLogObserver`. As the application could be used either with its CLI or GUI, it seemed interesting to have both these loggers available. I was able to do that but I wanted them to have the same format - specifically, I wanted to use the file's format (which is awesome btw) - and had to override some parts of the `STDLibLogObserver`. It would have made things a lot simpler if that observer accepted a function to format events like the `FileLogObserver`. 2) Why is `_loggerFor` "private/hidden"? That is a great factory which imo should have more visibility - and also works great with attrs!: attr.ib(default=attr.Factory(_loggerFor, takes_self=True)) 3) Is there a way to suppress logs from libs or any other code that is not your own? In my case, I had to manually set which namespaces I wanted to filter but, for example, when you subclass a third-party's class which logs something, that will pass because now it belongs to one of your namespaces. I know it sounds crazy but wanted to know what other people think. If any of these changes sound like they would be useful apart from the specific requirements of that application, I could help implement something based on what I wrote [0]. Thanks, -Felipe [0]: https://github.com/AnemoneLabs/unmessage/blob/develop/unmessage/log.py

2 3

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com 14 Jan '18

14 Jan '18

1 0

[Twisted-Python] twistedmatrix.com is in trouble...
by Barry Scott 09 Jan '18

09 Jan '18

In case you have no noticed yet. *web.Server Traceback (most recent call last):* exceptions.IOError: [Errno 24] Too many open files: '/srv/t-web/config/vhosts/twistedmatrix.com/ documents.rpy' /srv/t-web/virtualenv/site-packages/twisted/web/server.py:185 in process 184 try: 185 resrc = self.site.getResourceFor(self) 186 if resource._IEncodingResource.providedBy(resrc): /srv/t-web/virtualenv/site-packages/twisted/web/server.py:791 in getResourceFor 790 request.sitepath = copy.copy(request.prepath) 791 return resource.getChildForRequest(self.resource, request) 792 /srv/t-web/virtualenv/site-packages/twisted/web/resource.py:98 in getChildForRequest 97 request.prepath.append(pathElement) 98 resource = resource.getChildWithDefault(pathElement, request) 99 return resource /srv/t-web/virtualenv/site-packages/twisted/web/resource.py:201 in getChildWithDefault 200 return self.children[path] 201 return self.getChild(path, request) 202 /srv/t-web/virtualenv/site-packages/twisted/web/rewrite.py:24 in getChild 23 24 25 /srv/t-web/virtualenv/site-packages/twisted/web/resource.py:201 in getChildWithDefault 200 return self.children[path] 201 return self.getChild(path, request) 202 /srv/t-web/virtualenv/site-packages/twisted/web/vhost.py:102 in getChild 101 102 103 /srv/t-web/virtualenv/site-packages/twisted/web/resource.py:201 in getChildWithDefault 200 return self.children[path] 201 return self.getChild(path, request) 202 /srv/t-web/virtualenv/site-packages/twisted/web/static.py:298 in getChild 297 if processor: 298 return resource.IResource(processor(fpath.path, self.registry)) 299 return self.createSimilarFile(fpath.path) /srv/t-web/virtualenv/site-packages/twisted/web/script.py:64 in ResourceScript 63 try: 64 execfile(path, glob, glob) 65 except AlreadyCached as ac: /srv/t-web/virtualenv/site-packages/twisted/python/compat.py:248 in execfile 247 locals = globals 248 with open(filename, "rb") as fin: 249 source = fin.read() exceptions.IOError: [Errno 24] Too many open files: '/srv/t-web/config/vhosts/twistedmatrix.com/ documents.rpy'

2 1

[Twisted-Python] Building Python3 wheels for Win32 and releasing to Pypi
by Craig Rodrigues 08 Jan '18

08 Jan '18

At https://pypi.python.org/pypi/Twisted , there is only a Python 2.7 wheel for Win32. Since we don't push Python3 wheels to Pypi, people need to pick them up from: https://www.lfd.uci.edu/~gohlke/pythonlibs/#twisted which is not ideal. Since I ported the IOCP reactor to Win32 in 2016, it would be good to update the Twisted release scripts to push Python3 wheels to Pypi. Where are these scripts located? -- Craig

4 4