Mailman 3 May 2019 - Twisted

[Twisted-Python] Buildbot downtime
by Tom Prince March 3, 2022

March 3, 2022

I am plannig to upgrade twisted's buildbot in the near future. In preperation for that, I am going to take down the production buildbot on Tuesday, June 26, around 1600 UTC[1]. During that time, the result of any builds done will be lost. Thus, I'd ask that people avoid committing to trunk during that time. I will send a reminder before I take down the buildbot both here, and on #twisted and #twisted-dev. Tom [1] http://timeanddate.com/worldclock/meetingtime.html?iso=20120626&p1=80&p2=22…

2 8

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com Oct. 27, 2021

Oct. 27, 2021

5 5

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz Aug. 5, 2021

Aug. 5, 2021

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |… [View More]

4 5

[Twisted-Python] Binary wheels for Twisted on Windows?
by Griatch Art June 9, 2019

June 9, 2019

Hi, I'm investigating installing the Evennia MU* server on Windows. We use Twisted and will be requiring Python3.7 in our next release. I need to make easy-to-use install instructions since a lot of Windows users use our library. I tested with a Windows7 64bit VM and installed everything from scratch to emulate what a non-dev Windows user would see. I don't have Windows10 so can't compare to the install experience there (but Windows7 64bit is still relevant, having something like 24% of the … [View More]

5 6

[Twisted-Python] farewell to twisted.news
by Glyph May 31, 2019

May 31, 2019

I've just approved a PR to deprecate twisted.news, which paves the way for its removal, as Hawkie brought up over a year ago: https://twistedmatrix.com/pipermail/twisted-python/2018-April/031882.html <https://twistedmatrix.com/pipermail/twisted-python/2018-April/031882.html> As such, I've removed the success story from our website which references twisted.news: https://twistedmatrix.com/trac/wiki/SuccessStories?action=diff&version=33 <https://twistedmatrix.com/trac/wiki/… [View More]

2 2

[Twisted-Python] ldaptor problem with STARTTLS and python 3
by Thomas Westfeld May 29, 2019

May 29, 2019

Dear all, I am experiencing an error when trying to use the quick usage example posted on the ldaptor github page https://github.com/twisted/ldaptor . I have included the starttls command to promote the connection to an encrypted one, but I am experiencing an deprecation warning: DeprecationWarning: LDAPStartTLSInvalidResponseName.__str__ method is deprecated and will not be used for getting bytes representation in the future releases, use LDAPStartTLSInvalidResponseName.toWire instead … [View More]

2 4

[Twisted-Python] Twisted Agent Python 2 ->3 Porting Pitfalls
by Thomas Westfeld May 28, 2019

May 28, 2019

Dear all, I just migrated some quite basic twisted code from Python 2.7 to Python 3. Everything worked quite nicely, the main issue was the correct handling of strings vs. bytes. There was a mean error I made when using the Twisted Agent http client: I specified the method as a Unicode string, instead of using Agent.request(b'GET',b'http://whatever.com'). The mean thing is that the code does not produce any error. It connects to the server via TCP but then stops. It is given correctly in the … [View More]

3 4

[Twisted-Python] Twisted for http/2 (RESTful) webservices - client/server
by Jayanth Acharya May 27, 2019

May 27, 2019

Hi, Quick intro - I am new to Python, and come from Java background (with some exposure to NIO). I am part of a small team setup for testing of some 5G telecom network software that have micro-service decomposition and the components communicate with each other using REST interface over HTTP/2.0 (over TLS). >From my reading so far, I've come to realize that they don't use the edge-HTTP/2.0 approach i.e. delegate HTTP/2.0 termination to nginx as proxy then talk HTTP/1.1 internally, but each … [View More]

5 10

[Twisted-Python] magical and seamless asyncio support
by Glyph May 24, 2019

May 24, 2019

After filing https://github.com/tornadoweb/tornado/issues/2636 <https://github.com/tornadoweb/tornado/issues/2636> recently, I was reminded that Twisted should support asyncio seamlessly, and currently we have some quite-visible seams. There are three major use-cases for asyncio integration: I've got a large Twisted application. I run the reactor at startup. I find a cool asyncio lib. I want to use it. What do I do? I've got a large asyncio application. I run the main loop at … [View More]startup. I find a cool twisted lib. I want to use it. What do I do? I'm noodling around in an environment, like a Jupyter notebook, which already happens to have an event loop but I don't really know which one it is. How do I have the fewest number of steps? What happens today in each case? Case 1: If I've got a large Twisted application, I either start off by doing Deferred.fromFuture or ensureDeferred. These give me Deferreds that never fire, because no asyncio loop is running, but they don't yell at me; they just hang. Now I have to switch my event loop over to be an AsyncioSelectorReactor. Except wait, my application is a GTK+ application, and the only GTK+ main loop I can get that implements the asyncio APIs is unmaintained! So I either give up my custom Twisted reactor or I give up my asyncio functionality or I run it all in a thread. None of these are great experiences. Case 2: if I've got an asyncio application, I have a similar problem; I need a reactor, but one isn't running, so all my Deferred.asFuture(get_event_loop())s just hang. So I need to run AsyncioSelectorReactor, but now I need to know a bunch of obscure Twisted trivia to boostrap all of this properly: Case 3: oh no, how do I even know which one I need to run? In all of these cases I need to know a bunch of really inane trivia: I need to call startRunning() on the reactor, but just once, when it gets set up, or threadpool invocations (such as name resolution) will hang. Unless I'm lucky enough to actually control the whole process startup, in which case I can replace my event loop's .run_forever() with Twisted's .run(). I need to know whether I need subprocess support, and from whom. If I need it in Twisted, I need to do startRunning(installSignalHandlers=True); if I need it in asyncio, I need to do installSignalHandlers=False. I don't think there's a way to have both. I'd better hope that this is not on Windows, because Twisted is going to use its POSIX socket I/O implementation no matter what. Then, once it's up and running, rather than just 'await'-ing Deferreds, I always need to await someDeferred().asFuture(loop=get_event_loop()). From a practical perspective, get_event_loop() is the only correct value that I'd ever want to pass here, but for some reason the library makes me pass it every time. I propose a series of changes that would make this seamless from either side. Make Deferreds awaitable by asyncio by just calling `get_event_loop` and lying about what loop they're connected to. My reading of this is that https://github.com/python/cpython/blob/c5c6cdada3d41148bdeeacfe7528327b481c… <https://github.com/python/cpython/blob/c5c6cdada3d41148bdeeacfe7528327b481c…> will totally let us do that, if we just have a get_loop method (or, gross, _loop property) on Deferred or whatever's returned from Deferred.__await__. It would be fine if this raised a warning or something, as long as it worked in the 80% case so people could get some initial success and a pointer as to how to succeed, and not just hitting a wall with "task got bad yield". Make the reactor automagical. Phase one of this change would be: when you do 'from twisted.internet import reactor', if there's already an asyncio loop installed and running, automatically select the asyncio integration. This only helps you if you're in a context like a Jupyter notebook where you're not doing it at the module level, but that's still interesting. Make 'twisted.internet.reactor' into a dynamic proxy object which forwards reactor calls to whichever the running reactor is at the moment of the method call (connectTCP, callLater, etc). This can move the reactor selection to whenever the "first touch" on the reactor is, rather than whenever it's imported. (This also fixes a ton of of annoying import-order stuff in Twisted itself, as a bonus.) Automatically call startRunning() as necessary if another loop is in charge. Fix the subprocess integration: As a simple first step, for UNIX, at least participate in the asyncio get_child_watcher() / set_child_watcher() protocol, so that at least someone trying to coordinate a Twisted loop and an asyncio loop can intentionally select which one gets child process termination notifications, and possibly even multiplex this. Fix subprocesses along with any platform-specific socket quirks, by doing the next step... Actually use the asyncio APIs in the "asyncio side down" integration, i.e. AsyncioSelectorReactor. Presently we implement everything in terms of the add_reader and add_writer APIs, which is both very low-level and also fairly UNIX-specific. We should instead be using loop.create_connection, loop.create_server, loop.subprocess_exec, loop.getaddrinfo, etc, and translating between asyncio protocol/transport APIs and our own. Implement the "twisted side down" integration with asyncio; i.e. instead of implementing the twisted APIs in terms of asyncio's interfaces, implement the asyncio APIs in terms of Twisted's interfaces, so we can use existing custom reactors, GUI loop integration, etc. This is all quite a bit of work but I think it would massively improve the experience of a novice trying to adopt Twisted in a modern Python stack. In particular, I think that in addition to being a good example of the general problem domain, Jupyter is quite specifically incredibly strategic, and having the ability to just grab Treq and start doing massively parallel I/O to ingest data, then just 'await' on it, would be a very powerful demonstration of Twisted's capabilities. Let me know what you all think! -glyph [View Less]

2 2

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com May 19, 2019

May 19, 2019

1 0