Mailman 3 February 2021 - Twisted

[Twisted-Python] Buildbot downtime
by Tom Prince 03 Mar '22

03 Mar '22

I am plannig to upgrade twisted's buildbot in the near future. In preperation for that, I am going to take down the production buildbot on Tuesday, June 26, around 1600 UTC[1]. During that time, the result of any builds done will be lost. Thus, I'd ask that people avoid committing to trunk during that time. I will send a reminder before I take down the buildbot both here, and on #twisted and #twisted-dev. Tom [1] http://timeanddate.com/worldclock/meetingtime.html?iso=20120626&p1=80&p2=22…

2 8

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com 27 Oct '21

27 Oct '21

5 5

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz 05 Aug '21

05 Aug '21

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |_____| |_____ | | | | @ t w i s t e d m a t r i x . c o m http://www.twistedmatrix.com/~glyph/

4 5

[Twisted-Python] reactor for Linux io_uring
by Ian Haywood 13 Mar '21

13 Mar '21

In investigating async file I/O I came across this. In a nutshell it's the new epoll() It's marginally more efficient although this is only apparent at very high loads. What's more interesting is that io_uring accepts files as well as network/pipe handles: avoiding the need for threads. Here's a good intro: https://unixism.net/loti/index.html If people think an IoUringReactor is worthwhile I'll open a ticket and make a start. However it will need a reviewer... :-) Ian

9 20

[Twisted-Python] code contribution/participation policy
by Boris Epstein 10 Mar '21

10 Mar '21

Hi all, I have started working with Twisted and found it to be a very powerful package. That said, some modules are not documented very thoroughly (big surprise in the world of software, right?) and I also found some questionable code, too. If I were to contribute fixes/improvements, what is the submission procedure? Thanks. Boris.

4 8

[Twisted-Python] Post Release updates
by Adi Roiban 07 Mar '21

07 Mar '21

Hi, Happy to see a new version of Twisted released. Thanks to anyone for making it happen. --------- I think that https://github.com/twisted/twisted/pull/1514 should be merged to finalize the release process. ------ And we have not yet decided if the trunk should be using `.dev` or .post` :( https://twistedmatrix.com/trac/ticket/9542 I am +1 for .post1 ... as it has the semantic of a post release version. while .dev0 is a pre-release. ---------- The https://twistedmatrix.com/documents/current/ documentation was not updated. But that can be solved after the release. I will see if I can update it tonight... and I will check over IRC to see if someone else has fixed it. First, I am looking at the Read the docs release issues... it looks like things are not as automated as we though :D ------------- I have no idea why the latest tag is not visible on Read the docs https://readthedocs.org/projects/twisted/versions/ I have manually activated it based on the f1daeeee tag. I went to https://readthedocs.org/projects/twisted/versions/?version_filter=twisted-2… and then clicked "Activate" Then I went to https://readthedocs.org/dashboard/twisted/advanced/ and select it as "Default" version and then click "Save" Then I went to https://readthedocs.org/projects/twisted/builds/ to check the status of the new build. I see that we now have - https://docs.twistedmatrix.com/en/twisted-21.2.0/ But https://docs.twistedmatrix.com/en/stable/ is still an older build :( I have no idea why... looks like stable is not active and what is origin/8690 [image: image.png] Maybe Read The Docs is confused by `twisted-21.2.0` as it doesn't look like a semantic version . ---------- Stable was building for https://github.com/twisted/twisted/commit/99137f53a8a6bd1d8bffa520237323616… See RTD stable build https://readthedocs.org/projects/twisted/builds/13125823/ So I have wiped the stable version and now it gets 404. I (or someone else from the team) will have check with Read The Docs team to see why we have this issue with the stable version. ---------- And there are a lot of versions as we have many branches on Twisted. I guess that at least the branches that were merged, could be removed from the main repo. I don't see the value for keeping them alive, That is all for now. -- Adi Roiban

7 16

[Twisted-Python] Developer docs should be updated on wiki when steps changed in code?
by Craig Rodrigues 04 Mar '21

04 Mar '21

In this PR: https://github.com/twisted/twisted/pull/1461 some changes were made to the Twisted development process for running the various linters before committing code. I noticed that the changes in PR 1461 were not reflected in docs on the wiki, specifically here: https://twistedmatrix.com/trac/wiki/TwistedDevelopment which mentions tox environments that have been deleted in PR 1461. I noticed this, when I recently tried to work on a branch from recent trunk, and when I tried to run some of the commands on that wiki page they didn't work, because they were deleted. In this post-review comment: https://github.com/twisted/twisted/pull/1461#issuecomment-753695414 I asked Thomas if he could modify the wiki to reflect the changes he made in trunk, but this hasn't been done yet. My impression in the comments in PR 1461 is that Thomas and Adi want to move all this documentation into the source tree, and delete the stuff on the wiki? Is this the long term plan? Until this is fully completed, what is the correct thing to do when there is a mismatch between docs on the wiki, and docs in the tree? I still refer to a lot of docs on the wiki, especially for process related things, so I think it would be nice if the wiki docs were kept up to date, until the day that they are fully deleted. -- Craig

3 4

[Twisted-Python] Twisted 21.2.0 Release Announcement
by Craig Rodrigues 04 Mar '21

04 Mar '21

On behalf of Twisted Matrix Laboratories, I am honored to announce the release of Twisted 21.2.0! There are two major announcements for this release: - *Python 2.7 support has been dropped*. Twisted 21.2.0 supports Python 3.5.3 and higher only - *This will be the last Twisted release to support Python 3.5*. Twisted 21.2.0 brings the following: - twist dns --pyzone now works on Python 3 - twisted.web.twcgi now works on Python 3 - all tests pass on all platforms on Python 3.8, including asyncio tests on Windows - tests pass on Python 3.9 (thanks to Michał Górny) - type hints, as specified in PEP 484, are now used in functions throughout the codebase - mypy (static type checker) is now run over the codebase during CI to help detect problems, and help improve the use of types - code in is now formatted with Black (thanks to Tom Most) - many CI and automation improvements (thanks to Adi Roiban and Thomas Grainger) - many more fixes (225 tickets closed!) You can install by running this command: python -m pip install Twisted==21.2.0 The full tarball is available at: https://pypi.org/project/Twisted/21.2.0/#files The full NEWS file with all changes is at: https://github.com/twisted/twisted/blob/twisted-21.2.0/NEWS.rst

5 6

Re: [Twisted-Python] Release blocker: Use latest pydoctor release ?
by Craig Rodrigues 04 Mar '21

04 Mar '21

Thanks for the clarification. You have provided a lot of useful details. There are a lot of interconnected pieces, with multiple people working on different things. For now, I am going to proceed to finish the release as-is. The documentation may not be automatically deployed as part of the release, but I think that can be done as a follow-on task. -- Craig On Sat, Feb 27, 2021 at 4:53 PM Adi Roiban <adiroiban(a)gmail.com> wrote: > Hi, > > Sorry for the delay. > > We did the automation and Read The Docs hosting. > > In parallel there was also the work required to host the pydoctor API docs > on Read The Docs. > > ---------- > > Note that https://docs.twistedmatrix.com/en/twisted-20.3.0/api 404 > > That should host the files from > https://twistedmatrix.com/documents/current/api/ > > --------- > > For `trunk` we have https://docs.twistedmatrix.com/en/latest/api/ > > That was the hard work done by Maarten to improve pydoctor and Twisted API > docs. > > ------------- > > There was a plan to do a new pydoctor release over the end of the year > break... but that never happened. > > The current PR that is "breaking" API links from narrative docs to API > docs on Read The Docs version of Twisted docs is > https://github.com/twisted/twisted/pull/1496 > > But even before that PR the API docs on Read the Docs were broken, as we > had too many HTML pages and the build process on RTD > was interrupted. > > This is why I have approved the PR in the first place. > > So https://github.com/twisted/twisted/pull/1466 should also be reverted > > ------------ > > So, if for this release the "official" Twisted documentation is to be > hosted at https://twistedmatrix.com/documents/current/api/ > then https://twistedmatrix.com/trac/ticket/10068 is not a blocker. > > If the plan is to host the full and "official" Twisted documentation on > Read The Docs, the https://twistedmatrix.com/trac/ticket/10068 is a > blocker. > > And the easiest solution is to do a new pydoctor release. > > ---------- > > I will try to follow up with Maarten over IRC to see if we can get a new > pydoctor release. > > In theory, the pydoctor release process is automated and any other Twisted > developer from https://github.com/orgs/twisted/teams/twisted-contributors > could do a release. > > Maarten did the release work in the recent past but if he is busy, in > theory anyone could step in and help with a new pydoctor release. > > Regards > > On Sat, 20 Feb 2021 at 17:47, Craig Rodrigues <rodrigc(a)crodrigues.org> > wrote: > >> Hi, >> >> I am confused. I thought that you and Thomas Graingert had completed all >> the automation and had changed the Twisted release scripts to host the >> documentation on readthedocs and that was all in place right now. >> >> Is that not the case? >> >> How much more work is necessary to completely host the next Twisted >> release's docs on readthedocs? >> >> -- >> Craig >> >> On Saturday, February 20, 2021, Adi Roiban <adiroiban(a)gmail.com> wrote: >> >>> Hi, >>> >>> Sorry for the delay. >>> >>> This was added as a blocker due to the changes from >>> https://github.com/twisted/twisted/pull/1496 and the plan to use Read >>> The Docs to >>> host the official docs. >>> >>> This is not a blocker if the official documentation for this release >>> will continue to be hosted on the Twisted own server at >>> https://twistedmatrix.com/documents/current/ >>> >>> It's a blocker only if the official documentation is to be hosted on >>> Read The Docs at docs.twistedmatrix.com >>> >>> I have updated the ticket to no longer block the release. >>> >>> Cheers >>> >>> >>> On Sat, 20 Feb 2021 at 02:08, Craig Rodrigues <rodrigc(a)crodrigues.org> >>> wrote: >>> >>>> Adi, >>>> >>>> Is there anything to be done here, or is this still a release blocker? >>>> >>>> -- >>>> Craig >>>> >>>> >>>> On Sun, Feb 14, 2021 at 4:15 PM Craig Rodrigues <rodrigc(a)crodrigues.org> >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> This ticket: Use latest pydoctor release, >>>>> https://twistedmatrix.com/trac/ticket/10068 >>>>> >>>>> is marked as a release blocker. >>>>> >>>>> Has that been resolved or is there more work that needs to be done to >>>>> fix that? >>>>> >>>>> -- >>>>> Craig >>>>> >>>> >>> >>> -- >>> Adi Roiban >>> >> > > -- > Adi Roiban >

2 7

[Twisted-Python] Twisted 21.2.0rc1 Release Candidate Announcement
by Craig Rodrigues 28 Feb '21

28 Feb '21

It's time for another Twisted release! There are two major announcements for this release: - *Python 2.7 support has been dropped*. Twisted 21.2.0 supports Python 3.5 and higher only - *This will be the last Twisted release to support Python 3.5*. Twisted 21.2.0rc1 brings the following: - twist dns --pyzone now works on Python 3 - twisted.web.twcgi now works on Python 3 - all tests pass on all platforms on Python 3.8, including asyncio tests on Windows - tests pass on Python 3.9 (thanks to Michał Górny) - type hints, as specified in PEP 484, are now used in functions throughout the codebase - mypy (static type checker) is now run over the codebase during CI to help detect problems, and help improve the use of types - code in is now formatted with Black (thanks to Tom Most) - many CI and automation improvements (thanks to Adi Roiban and Thomas Grainger) - many more fixes (225 tickets closed!) You can install by running this command: python -m pip install Twisted==21.2.0rc1 The full tarball is available at: https://pypi.org/project/Twisted/21.2.0rc1/#files The full NEWS file with all changes is at: https://github.com/twisted/twisted/blob/twisted-21.2.0rc1/NEWS.rst Please test it, and let me know how your applications fare, good or bad! If nothing comes up, 21.2 will release very soon. -- Craig

4 11

Twisted February 2021