Mailman 3 August 2016 - Twisted

[Twisted-Python] Twisted 16.4.0 Prerelease 1 Announcement
by Amber "Hawkie" Brown Aug. 15, 2016

Aug. 15, 2016

In a rare Twisted release double feature right after 16.3.1, I bring you the first prerelease of Twisted 16.4.0. This is a big release, the first after the Git migration has really kicked in! And so, here's what it brings us: - twist, a new command line tool for running Twisted plugins, similar to twistd but with a simpler, cleaner interface. - A new interface for Protocols, IHandshakeListener, which tells Twisted to tell the Protocol when the TLS handshake has been completed. - async/await … [View More]

6 7

[Twisted-Python] txtorcon 0.15.0
by meejah Aug. 11, 2016

Aug. 11, 2016

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I'm happy to announce txtorcon 0.15.0: * added support for NULL control-port-authentication which is often appropriate when used with a UNIX domain socket * switched to https://docs.python.org/3/library/ipaddress.html instead of Google's ipaddr; the API should be the same from a user perspective but **packagers and tutorials** will want to change their instructions slightly (``pip install ipaddress`` or ``apt-get install python-… [View More]ipaddress`` are the new ways). * support the new ADD_ONION and DEL_ONION "ephemeral hidden services" commands in TorConfig * a first stealth-authentication implementation (for "normal" hidden services, not ephemeral) * bug-fix from https://github.com/david415 to raise ConnectionRefusedError instead of StopIteration when running out of SOCKS ports. * new feature from https://github.com/david415 adding a ``build_timeout_circuit`` method which provides a Deferred that callbacks only when the circuit is completely built and errbacks if the provided timeout expires. This is useful because :doc:`TorState.build_circuit` callbacks as soon as a Circuit instance can be provided (and then you'd use :doc:`Circuit.when_built` to find out when it's done building). * new feature from https://github.com/coffeemakr falling back to password authentication if cookie authentication isn't available (or fails, e.g. because the file isn't readable). * both TorState and TorConfig now have a ``.from_protocol`` class-method. * spec-compliant string-un-escaping from https://github.com/coffeemakr * fix https://github.com/meejah/txtorcon/issues/176 You can download the release from PyPI or GitHub (or of course "pip install txtorcon"): https://pypi.python.org/pypi/txtorcon/0.15.0 https://github.com/meejah/txtorcon/releases/tag/v0.15.0 Releases are also available from the hidden service: http://timaq4ygg2iegci7.onion/txtorcon-0.15.0.tar.gz http://timaq4ygg2iegci7.onion/txtorcon-0.15.0.tar.gz.asc You can verify the sha256sum of both by running the following 4 lines in a shell wherever you have the files downloaded: cat <<EOF | sha256sum --check f2e8cdb130aa48d63c39603c2404d9496c669fa8b4c724497ca6bfa7752a9475 dist/txtorcon-0.15.0.tar.gz a359fb5e560263499400018262494378b3d347cd04a361adb08939df95ecedf6 dist/txtorcon-0.15.0-py2-none-any.whl EOF thanks, meejah -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJXl/KEAAoJEMJgKAMSgGmn76gH/1du7i9dmkMpr2PJrexVeXSo 9mSaeX/7KKaW71pEMmaCXfvhDJ6dMZDQpZ7saTM31zJZTp+MXjtHf0DZI2QTwgDw NYEBH+LO8PINN1ezPomgeZE6E4eJYlaDCyO6c7j3cOsEmohST+GPpvvdWdft+Sw2 hWvVf2+I4BV7vcIx6WQx4jKBS2gmlHbxuUv3LAnjj/Tn6oSYpft1IUK39pM66DX4 FzdYeBTloC6nzyH4sRTxnax+l9MfQJ2ZR+5alJi8uEvGlk580ciFASQNCVLaBY9r 4YALoipEg2Fm4BFA7qLsH0aFoLgx0lv7ng8lmpaP7XlPjUCuA7OcDp5jSqhGt2A= =hWml -----END PGP SIGNATURE----- [View Less]

2 2

[Twisted-Python] clientfactory cleanup slow-down (after many http requests)
by Randomcoder Aug. 11, 2016

Aug. 11, 2016

Hello, I've been working on a small Twisted program. The program makes HTTP requests to a large number of feeds. Twisted is used to speed up the entire process. After the feeds are fetched, they're parsed. Finally they should be written to a database (to simplify the code, that part is left out). Feeds are fetched in parallel using gatherResults, and a batch is built. Then all batches are again gathered into a set of batches, a DeferredList is built out of those. A semaphore controls both the … [View More]

3 2

Re: [Twisted-Python] [Twisted] #7598: Port twisted.spread.pb to Python3
by Wolfgang Rohdewald Aug. 11, 2016

Aug. 11, 2016

Am Donnerstag, 28. Juli 2016, 11:27:15 CEST schrieb Twisted: > #7598: Port twisted.spread.pb to Python3 did you test with client on Python2 and server on Python3 and vice versa? Not a bug report, but anyway ... This was client with Python3, server with Python2 The same works with my old port to Python3: git clone https://github.com/wrohdewald/twisted.git git checkout spread-py3-7598 My version uses helpers in remoteMessageReceived: kw = nativeStringDict(broker.unserialize(kw)) … [View More]

2 5

[Twisted-Python] twisted.internet.protocol.Protocol.connected flag purpose
by Adi Roiban Aug. 11, 2016

Aug. 11, 2016

Hi, Looking at the code in trunk [1] I can see that t.internet.protocol.Protocol will update the 'connected' attribute upon makeConnection but will not update it on connectionLost Is this the intended design? Is this design documented somewhere ? I have check the narrative docs [2] and api-docs[3] but this attribute is not documented. What is the purpose of t.internet.protocol.Protocol.connected ? Thanks! [1] https://github.com/twisted/twisted/blob/trunk/twisted/internet/protocol.py#… [2]… [View More]

2 1

[Twisted-Python] close to the finish line on hosted windows testing
by Glyph Lefkowitz Aug. 9, 2016

Aug. 9, 2016

Thanks to Craig and Adi's work, we now have tests sort of working on appveyor. However, they aren't actually reporting their pass/fail status right now as github statuses, I am assuming because of the persistent failures that were causing noise on unrelated tickets. However, it's very close to being a useful builder; there are really only 2 remaining issues, not counting turning on the reporting itself. I've made an umbrella ticket here: https://twistedmatrix.com/trac/ticket/8664 <https://… [View More]

3 2

[Twisted-Python] INCOMPATIBLE CHANGE: twisted.python.dist renamed to twisted.python._setup
by Adi Roiban Aug. 8, 2016

Aug. 8, 2016

Hi, I would like to remove twisted.python.dist as a public API without following the 1 year deprecation processes. The module has a comment which informs people not to use it outside of Twisted, but I think it should be private module instead. The ticket is here https://twistedmatrix.com/trac/ticket/8622 The PR is here https://github.com/twisted/twisted/pull/467 The branch is here https://github.com/twisted/twisted/tree/8622-setup-coverage This is part of the setup.py cleanup effort for … [View More]

8 11

[Twisted-Python] twisted.python.dist as a public API
by Adi Roiban Aug. 7, 2016

Aug. 7, 2016

Hi, Why is twisted.python.dist3.py a public module? Are there any external projects which need to get the list of the modules ported to Python3? ------------------ Why is twisted.python.dist a public module? The docstring starts with `Don't use this outside of Twisted.' but why not named it twisted.python._dist or twisted.python._setup to make it clear that it is private ? ------- I am trying to clean up the setup.py code as I feel that having the setup() definition split between setup.… [View More]

2 3

[Twisted-Python] RFC: IPv6 multicast join/ticket 6597
by Jason Litzinger Aug. 6, 2016

Aug. 6, 2016

Hello, I'm looking at making the changes to support IPv6 multicast groups as described in ticket 6597 but wanted to get some feedback (and get a feel whether this is even desirable) before formally submitting any patches. Specifically: 1. I've read [1] and it alludes to udp hopefully disappearing, is that something in the works? Is there a new approach to solving this problem I should look at? A branch in the works where this (conceptual) change belongs? Note: The … [View More]addressFamily attribute referenced already exists and is set properly for IPv6. 2. The attached change has the side effect that calls to ReactorBase.resolve() with IPv6 literals will now likely succeed where they may have failed in the past. That means clients counting on resolve raising an exception for an IPv6 literal will break. Not sure whether this is considered a compatibility issue, but I wanted to raise it. 3. One alternative to the above would be a complete API separation, via something like joinIPv6Group(), and a new resolve. Is that more appealing in this case? Caveats: 1. I have not finished all of the documentation related to developers, I will do so prior to formal submission. 2. I know I need tests and docs and will submit them with the final changes. On to the patches. With these changes, I can use the joinGroup API to add myself to an IPv6 multicast group on Linux (verified via /proc/net/igmp6). Additionally, trial reports the same two failures before and after these changes (twisted.python.test.test_release.APIBuilderTests.test_build and test_buildWithPolicy). These changes struck me as the obvious approach, but given the changes to resolve, not necessarily the best. diff --git a/twisted/internet/base.py b/twisted/internet/base.py index 4f2c862..e813741 100644 --- a/twisted/internet/base.py +++ b/twisted/internet/base.py @@ -567,6 +567,8 @@ class ReactorBase(object): return defer.succeed('0.0.0.0') if abstract.isIPAddress(name): return defer.succeed(name) + elif abstract.isIPv6Address(name): + return defer.succeed(name) return self.resolver.getHostByName(name, timeout) # Installation. diff --git a/twisted/internet/udp.py b/twisted/internet/udp.py index b5a5322..210b079 100644 --- a/twisted/internet/udp.py +++ b/twisted/internet/udp.py @@ -485,7 +485,10 @@ class MulticastMixin: def _joinAddr1(self, addr, interface, join): - return self.reactor.resolve(interface).addCallback(self._joinAddr2, addr, join) + if self.addressFamily == socket.AF_INET: + return self.reactor.resolve(interface).addCallback(self._joinAddr2, addr, join) + else: + return self.reactor.resolve(interface).addCallback(self._joinAddrIPv6, addr, join) def _joinAddr2(self, interface, addr, join): @@ -500,6 +503,18 @@ class MulticastMixin: except socket.error as e: return failure.Failure(error.MulticastJoinError(addr, interface, *e.args)) + def _joinAddrIPv6(self, interface, addr, join): + addr = socket.inet_pton(socket.AF_INET6, addr) + interface = socket.inet_pton(socket.AF_INET6, interface) + if join: + cmd = socket.IPV6_JOIN_GROUP + else: + cmd = socket.IPV6_LEAVE_GROUP + try: + self.socket.setsockopt(socket.IPPROTO_IPV6, cmd, addr + interface) + except socket.error as e: + return failure.Failure(error.MulticastJoinError(addr, interface, *e.args)) + def leaveGroup(self, addr, interface=""): """Leave multicast group, return Deferred of success.""" This does require the client specify the interface argument when calling joinGroup, e.g. self.transport.joinGroup("ff02::1", interface="::"). Thanks in advance for any feedback! -Jason Litzinger [1] http://twistedmatrix.com/pipermail/twisted-python/2016-March/030188.html [View Less]

4 12