Mailman 3 July 2017 - Twisted

[Twisted-Python] Failure of twisted.test.test_plugin.DeveloperSetupTests.test_freshPyReplacesStalePyc under pypy2
by Daniel Sutcliffe 14 Jul '17

14 Jul '17

I'm getting this report under pypy2 5.8.0 running Twisted trunk from github: =============================================================================== [FAIL] Traceback (most recent call last): File "/opt/twisted/src/twisted/test/test_plugin.py", line 566, in test_freshPyReplacesStalePyc self.assertIn('one', self.getAllPlugins()) File "/opt/twisted/src/twisted/trial/_synctest.py", line 492, in assertIn % (containee, container)) twisted.trial.unittest.FailTest: 'one' not in ['dev', 'app'] twisted.test.test_plugin.DeveloperSetupTests.test_freshPyReplacesStalePyc =============================================================================== [ERROR] Traceback (most recent call last): File "/opt/twisted/src/twisted/plugin.py", line 171, in getCache provider = pluginModule.load() File "/opt/twisted/src/twisted/python/modules.py", line 392, in load return self.pathEntry.pythonPath.moduleLoader(self.name) File "/opt/twisted/src/twisted/python/reflect.py", line 312, in namedAny obj = getattr(obj, n) exceptions.AttributeError: 'module' object has no attribute 'stale' twisted.test.test_plugin.DeveloperSetupTests.test_freshPyReplacesStalePyc ------------------------------------------------------------------------------- I'm not sure yet if it works under pypy3. My initial tracings seem to suggest this is somehow due to __import__ under pypy not finding the stale.pyc where no stale.py exists ... but I have to admit that at this point if this is actually expected, all I know is the test passes under python 2.7.13 and if I comment out the mypath.remove() on line 562... Willing to do more work to get to the bottom of this, just thought I'd put this out there to see if I could get any clues from the more experienced before I dive in. There seem to be some old tickets that could vaguely relate... Am I correct in the fact that Twisted doesn't have Travis-CI builds on PyPy? Maybe there's a reason for this I'm missing... Thanks in advance for any info or clues, /dan -- Daniel Sutcliffe <dansut(a)gmail.com>

3 8

[Twisted-Python] [ANN] txAWS 0.4.0
by Jean-Paul Calderone 13 Jul '17

13 Jul '17

Hello all, I'm pleased to announce the release of txAWS 0.4.0. txAWS is a library for interacting with Amazon Web Services (AWS) using Twisted. You can download the release from PyPI <https://pypi.python.org/pypi/txAWS>. txAWS development uses GitHub for issues and source control <https://github.com/twisted/txaws>. Since the last release, the following enhancements have been made: Bugfixes -------- - txaws now correctly signs requests with paths that require urlencoding. (#20) Features -------- - The Route53 client now recognizes all of the basic resource record types. (#50) - txaws now supports reading the AWS_SHARED_CREDENTIALS_FILE and environment variable. (#52) - txAWS now raises a CredentialsNotFoundError when it cannot locate credentials. Catching the previously-raised ValueError is now deprecated. (#53) - txaws.credentials.AWSCredentials now supports loading different sets of credentials via AWS_PROFILE. (#54) Thanks to everyone who contributed and to Least Authority Enterprises <https://leastauthority.com/> for sponsoring my work on this release. Jean-Paul Calderone

4 6

[Twisted-Python] Need help with SSHUserAuthClient keyfile and passphrase
by Stephen McRoberts 12 Jul '17

12 Jul '17

My auth code works for a public keyfile on my local servers but I can't get it to work with a private key. ***Here's an ssh debug list when I login at the console (not twisted): debug1: Authentications that can continue: publickey,password debug1: Next authentication method: publickey debug1: Trying private key: /home/sten/.ssh/mcroberts.org-rsa debug1: key_load_private_type: incorrect passphrase supplied to decrypt private key Enter passphrase for key '/home/sten/.ssh/myserver.com-rsa': debug1: Authentication succeeded (publickey). ***Here's my twisted log: 2017-07-11 12:47:03-0500 [] can continue with: ['publickey', 'password'] 2017-07-11 12:47:03-0500 [] trying to auth with publickey 2017-07-11 12:47:03-0500 [] KeyFileAuth.getPublicKey 2017-07-11 12:47:03-0500 [] pubkeyfile=None 2017-07-11 12:47:03-0500 [] KeyFileAuth.getPrivateKey 2017-07-11 12:47:03-0500 [] /home/steve/.ssh/mcroberts.org-rsa is encrypted - looking for passphrase 2017-07-11 12:47:03-0500 [] trying to auth with password Note that they both only ask for ['publickey', 'password']. My following code attempts the same but fails. Here's my source code. This is called from the SSHConnection class before starting service. The verify host is already done. class KeyFileAuth(userauth.SSHUserAuthClient): #https://twistedmatrix.com/documents/current/api/twisted.conch.ssh.userauth.SSHUserAuthClient.html #http://twistedmatrix.com/documents/current/api/twisted.conch.ssh.keys.Key.html def __init__(self, config, user, instance): self.config = config self.user = user log.msg("KeyFileAuth - requesting auth for user %s @ %s" % (user,config.get('host')), level=logging.DEBUG) userauth.SSHUserAuthClient.__init__(self,user,instance) #-------------------------- def getPublicKey(self): log.msg("KeyFileAuth.getPublicKey", level=logging.DEBUG) kf = self.config.get('pubkeyfile') log.msg(" pubkeyfile=%s" % (kf), level=logging.DEBUG) if kf is not None: try: if kf.startswith('~'): kf = os.path.expanduser(kf) if not os.path.exists(kf): msg = " No such pubkeyfile=%s" % (kf) return defer.fail(msg) except Exception as e: log.err(" provided pubkeyfile=%s raised %s" % (kf,e)) return defer.fail(msg) # # no apparent public keyfile in config # private keyfile - this is the way ssh -v shows it done as in: # debug1: Authentications that can continue: publickey,password # debug1: Next authentication method: publickey # debug1: Trying private key: /home/steve/.ssh/awebsite.com-rsa # elif self.config.get('keyfile') is not None: return self.getPrivateKey() return defer.fail("KeyFileAuth.getPublicKey out of options") #-------------------------- def getPrivateKey(self): log.msg("KeyFileAuth.getPrivateKey", level=logging.DEBUG) kf = self.config.get('keyfile') if kf is not None: try: if kf.startswith('~'): kf = os.path.expanduser(kf) if not os.path.exists(kf): msg = " No such keyfile=%s" % (kf) return defer.fail(msg) except Exception as e: msg = " provided keyfile=%s raised %s" % (kf,e) return defer.fail(msg) try: return defer.succeed(keys.Key.fromFile(kf)) except keys.EncryptedKeyError: log.msg(" %s is encrypted - looking for passphrase" % (kf), level=logging.INFO) if self.config.get('passphrase'): passphrase = self.config.get('passphrase') return defer.succeed(keys.Key.fromFile(kf, passphrase)) else: msg = " No passphrase found for keyfile=%s" % (kf) return defer.fail(msg) except Exception as e: msg = " keyfile=%s raised %s" % (kf,e) return defer.fail(msg) return defer.fail("KeyFileAuth.getPrivateKey out of options")

1 1

[Twisted-Python] Buildbot Updates: Addition of Debian 9, Removal of Ubuntu 12.04
by Amber Hawkie Brown 10 Jul '17

10 Jul '17

Hello everyone, I've just updated the Twisted buildbots to add the newest Debian release (with Python 2.7 and 3.5 as supported Python versions), and removed the now-EOL Ubuntu 12.04 buildbots, which ran Python 2.7. The next version of Twisted will now correspondingly support Debian 9, and not support Ubuntu 12.04. - Amber

2 1

[Twisted-Python] Newer Pypy on buildbot?
by Craig Rodrigues 10 Jul '17

10 Jul '17

Hi, This builder: https://buildbot.twistedmatrix.com/builders/ubuntu16.04-pypy5/builds/86/ste… seems to now be failing with: cryptography 1.9 is not compatible with PyPy < 5.3. Please upgrade PyPy to use this library. Can someone upgrade pypy on this builder? Thanks. -- Craig

3 3

[Twisted-Python] WebSockets and QUIC for Twisted
by Barry Scott 10 Jul '17

10 Jul '17

I am interested in using Twisted with a couple of technologies: WebSockets and QUIC. I'm researching what is already available. I found the autobahn-python for WebSockets, are there other projects that provide WebSockets that I have missed? I could not find references to any projects supporting the QUIC protocol for python. I did find the libquic project. Do you know of any work going on for this protocol for Twisted? Barry

5 10

[Twisted-Python] Weekly Bug Summary
by trac＠twistedmatrix.com 09 Jul '17

09 Jul '17

1 0

[Twisted-Python] KeyError in SSHConnection.ssh_CHANNEL_OPEN_CONFIRMATION
by Stephen McRoberts 08 Jul '17

08 Jul '17

I'm looking for suggestions why the channel key would be missing after it was just opened. I use persistent connections with a timeout but the timer is reset every call so it stays open. Here's some of my logs: 2017-07-05 15:26:45-0500 [-] opening channel 4 with 65536 32768 2017-07-05 15:36:45-0500 [SSHService 'ssh-connection' on ClientTransport,client] Unhandled Error --- (snipped traceback for clarity) --- File "/usr/local/lib/python2.7/dist-packages/twisted/conch/ssh/connection.py", line 180, in ssh_CHANNEL_OPEN_CONFIRMATION channel = self.channels[localChannel] exceptions.KeyError: 4 The same connection instance will work later on the next channel so it seems the connection is fine. Any suggestions on what would cause this behavior? Is this behavior typical?

3 8

[Twisted-Python] buildbot/osx10.10-py2.7 and required builders for merge
by Adi Roiban 06 Jul '17

06 Jul '17

Hi, I did not had to much time to follow twisted-infra activity lately, sorry if the following question is obvious for all the others. Why the OSX build was removed from Travis and forced on buildbot? I think that for contributor without write access to the main repo, this is a big handicap as they can't get a good coverage report ... and merging such branches needs extra work as you need to create a new branch, push it wait for results...(maybe create a new PR)... etc --------- Is the list of builders marked in GitHub as "required" the official list of tests which need to be green in order to merge? I am reading this page, but is not clear which tests need to be green: https://twistedmatrix.com/trac/wiki/ReviewProcess#Authors:Howtomergethechan… Thanks! -- Adi Roiban

3 2

[Twisted-Python] 'ok to merge' label in github?
by Glyph 03 Jul '17

03 Jul '17

Unfortunately, our CI runs can be quite lengthy. When doing a quick code review, it can often be quite demoralizing to see an hour or two worth of appveyor backlog that needs to run before a ticket can be merged. I have been thinking about adding a specific "OK to merge" label to PRs that indicates that they've been submitted to pr_as_branch, they've been reviewed, and if the CI results or positive they should be merged, so that someone other than the reviewer might come along and do the actual merge later. Does anyone else think this would be a good idea? (I know that there are ways that bots can facilitate this, and if someone else would like to set that up, that would be great.) -g

2 3