Mailman 3 February 2011 - Twisted

[Twisted-Python] are you a bad enough dude to rescue Twisted?
by Glyph Lefkowitz 14 Feb '11

14 Feb '11

In the hopes of motivating some more contributions to Twisted, we've whipped up a little hack to incentivize more people to contribute patches, and especially, to do reviews: <http://twistedmatrix.com/highscores/> Scoring begins on the first of each month. The scoring algorithm isn't completely finalized so you may see your scores shift around a little bit, but this shouldn't affect rankings too much. At some point, we plan to give out some kind of prizes based on points; but the main motivation is just getting your name to the top of that list. Good luck everybody! Now: go take down exarkun! (Nota bene: since hackers like trying to find weaknesses in systems like this, let me say right up front that the scoreboard isn't particularly resilient to gaming. It operates on a presumption of good faith; we assume that all contributions are as good as they can be. If you violate this presumption and waste our time by generating bogus trac traffic, I can guarantee you won't like the results.)

2 2

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 13 Feb '11

13 Feb '11

1 0

[Twisted-Python] twisted site should link to tx site ...
by Stephen Waterbury 11 Feb '11

11 Feb '11

This url should really be linked either from Twisted's main page or at the very least on the "Twisted Community" page: https://launchpad.net/tx Lots of tx stuff that's not in PyPI, etc ... sheesh! Also, if you do a search on "tx" in the twisted site "search" it says "search query too short", and the string "tx" is not found on either the main page or the community page at all. To be fair, googling on "twisted tx" gets the launchpad site as the second hit, but what if someone doesn't know about the "tx" thing? Steve

4 5

Re: [Twisted-Python] OT: Languages (was Re: twisted can't find internet module)
by Stefano Debenedetti 10 Feb '11

10 Feb '11

Yaroslav Fedevych <jaroslaw.fedewicz(a)gmail.com> wrote: > Therefore, it's essential that everyone on the list sticks to its ligua franca if at all possible... yeah! Except that I would call it "Koine" rather than "lingua franca" but other than that.... http://en.wikipedia.org/wiki/Koine_Greek ;) ciao ste p.s. "...it's all greek to me..."

1 0

[Twisted-Python] twisted can't find internet module
by 唐东军 10 Feb '11

10 Feb '11

I use xp,python 2.5.5,twisted 10.2.0 for py2.5 code: from twisted.internet import reactor reactor.run() I save the code named 1.py.while I run 1.py,give me the error: ImportError: No module named internet who can give me a help?

4 3

Re: [Twisted-Python] twisted can't find internet module
by 杨振宇 10 Feb '11

10 Feb '11

既然用中文了。你是以哪一种方式安装twisted的？具体的环境是？>_< 头太晕 <torrycn(a)gmail.com>编写： >你这报错是路径问题。把你的环境搞清晰一些，马就能找到问题原因。 > >2011/2/10 唐东军 <ttkk1024(a)163.com> > >> I use xp,python 2.5.5,twisted 10.2.0 for py2.5 >> code: >> from twisted.internet import reactor >> reactor.run() >> >> I save the code named 1.py.while I run 1.py,give me the error: >> ImportError: No module named internet >> >> who can give me a help? >> >> >> >> _______________________________________________ >> Twisted-Python mailing list >> Twisted-Python(a)twistedmatrix.com >> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python >> >> > >_______________________________________________ >Twisted-Python mailing list >Twisted-Python(a)twistedmatrix.com >http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

5 6

[Twisted-Python] Announcing txMySQL - native async Twisted MySQL protocol
by Luke Marsden 09 Feb '11

09 Feb '11

Hi everyone, I'm pleased to announce the release of txMySQL, a native Twisted MySQL protocol implementation at https://github.com/hybridlogic/txMySQL The bulk of this code is courtesy of _habnabit (thank you!), I just added authentication support and fixed a couple of bugs which were stopping the MySQL protocol parser working. As we will be using this in production at Hybrid Logic I am happy to take over maintenance of it. As you can tell from the TODO list in the README, this is still a fairly rough draft, but it works well enough to .fetchall() basic results sets and .query() any other MySQL statements you care to run. See example.py. The incentive to produce this was due to a critical bug in MySQLdb with threading under load (on FreeBSD) which was causing Python to lock up. I decided that a native client protocol implementation would be less work than tracking down that bug, and besides it's something I've wanted to do for a while ;-) It might be interesting to see how adbapi could be modified to use a DeferredSemaphore to implement a completely threadless pool of MySQL connections with this...? Feel free to fork, tweak, fix, use, report issues, etc. -- Best Regards, Luke Marsden CTO, Hybrid Logic Ltd. Web: http://www.hybrid-cluster.com/ Hybrid Web Cluster - cloud web hosting Phone: +441172232002 / +16179496062

2 1

[Twisted-Python] Store an instance of a connection - twisted.web
by Manu 09 Feb '11

09 Feb '11

How I store an instance of a connection in twisted.web? I have seen request.getSession() but I searched and there are very few examples of how it is stored and retrieved later. I want to store the ldap connection in a session for retrieve later. Thanks. def render_POST(self, request): command = request.path[1:] session = request.getSession() if command == "authentication": Connect = LdapConnection(request.args['host'][0],request.args['user'][0],request.args['password'][0]) session.addComponent(LdapConnection, Connect) if command == "users": Connect = session.getComponent(LdapConnection) u = Users(Connect, request.args['name'][0],request.args['employeeNumber']) return

2 1

[Twisted-Python] Conch SFTP client help
by Brad Milne 09 Feb '11

09 Feb '11

Hi all I've looked around for SFTP client doco, but it's come up pretty thin on the ground. I've seen http://twistedmatrix.com/trac/wiki/TwistedConch and everything under it. With it I've been able to connect via SSH to a server and run a command (*a la* the 'cat' example from tutorial page and from sshsimpleclient.py<http://twistedmatrix.com/documents/current/conch/examples/sshsimpleclient.py> ). On the other hand, plenty of posts recommend checking out cftp.py in scripts/. That uses the FileTransferClient, and appears to be more along the lines of what is needed for a persistent SFTP connection and file transfers. What seems to be happening with the below is that the connection is being created OK, but I haven't been able to utilise the _remoteGlob method (taken from cftp.py). It simply hangs. My sandbox code is below. Any help greatly appreciated. Brad <code> import os from twisted.python import failure from twisted.internet import reactor, protocol, defer from twisted.conch.ssh import transport, connection, userauth, channel, common, filetransfer import logging from twisted.python import log import sys class SimpleTransport(transport.SSHClientTransport): def verifyHostKey(self, hostKey, fingerprint): print 'host key fingerprint: %s' % fingerprint return defer.succeed(1) def connectionSecure(self): ''' called when the encryption is set up and other services can be run ''' self.requestService(SimpleUserAuth(USERNAME,SimpleConnection())) class SimpleConnection(connection.SSHConnection): def serviceStarted(self): self.openChannel(SSHSession()) class SimpleUserAuth(userauth.SSHUserAuthClient): def getPassword(self): return defer.succeed(PASS) class SSHSession(channel.SSHChannel): ''' Things to do within the active SSH session. ''' name = 'session' def __init__(self, interface_handler=None, *args, **kwargs): channel.SSHChannel.__init__(self, *args, **kwargs) self.interface_handler = interface_handler or SftpClient(self) def channelOpen(self, ignoredData): self.data = '' # Create an sftp connection (stays open) d = self.conn.sendRequest(self, 'subsystem', common.NS('sftp'), wantReply=1) d.addCallback(self._cbSubsystem) def _cbSubsystem(self, result): self.interface_handler.getDirectoryContents('/tmp') def closeReceived(self): logging.info('remote side closed %s' % self) self.conn.sendClose(self) reactor.stop() class SftpClient(object): def __init__(self, transport, *args, **kwargs): super(SftpClient, self).__init__(*args, **kwargs) self.transport = transport self._client = filetransfer.FileTransferClient() @property def client(self): if not self._client.connected: self._client.makeConnection(self.transport) logging.debug("Made 'connection' with transport class") return self._client def getDirectoryContents(self, path): d = self._remoteGlob(path) def gotit(files): print "Got %s: %s" % (type(files), files) d.addCallback(gotit) return d # Accessory methods. # These are stolen from twisted.conch.scripts.cftp.py. We can't # import that module as it contains unix-dependent imports. def _remoteGlob(self, fullPath): logging.debug('looking up %s' % fullPath) head, tail = os.path.split(fullPath) if '*' in tail or '?' in tail: glob = 1 else: glob = 0 if tail and not glob: # could be file or directory # try directory first logging.debug("Opening dir") d = self.client.openDirectory(fullPath) d.addCallback(self._cbOpenList, '') d.addErrback(self._ebNotADirectory, head, tail) else: d = self.client.openDirectory(head) d.addCallback(self._cbOpenList, tail) return d def _cbOpenList(self, directory, glob): logging.debug("Got dir") files = [] d = directory.read() d.addBoth(self._cbReadFile, files, directory, glob) return d def _ebNotADirectory(self, reason, path, glob): logging.debug("Not a dir") d = self.client.openDirectory(path) d.addCallback(self._cbOpenList, glob) return d def _cbReadFile(self, files, l, directory, glob): logging.debug("Reading file") if not isinstance(files, failure.Failure): if glob: raise NotImplementedError("don't have fnmatch available to use on Windows so have commented this bit out") # l.extend([f for f in files if fnmatch.fnmatch(f[0], glob)]) else: l.extend(files) d = directory.read() d.addBoth(self._cbReadFile, l, directory, glob) return d else: reason = files reason.trap(EOFError) directory.close() return l if __name__=='__main__': protocol.ClientCreator(reactor, SimpleTransport).connectTCP(HOST, 22) log.startLogging(sys.stdout, setStdout=0) reactor.run() </code>

1 1

[Twisted-Python] Adbapi docs
by tonthon 08 Feb '11

08 Feb '11

I all, I heard there was some work on the twisted documentation and I'd like to suggest some enhancement in the "twisted.enterprise.adbapi: Twisted RDBMS support" doc (http://twistedmatrix.com/documents/current/core/howto/rdbms.html). Please add some note about the ConnectionPool.stop method. When I first tried this module, I wrote a first class and associated tests and I quickly faced problems like "can't start new thread" and had to search a lot before understanding I had to call the stop method. Then I tought I had also to call the start one ... The good thing was that I red the source code, and it's always usefull to have a look at it :-). Thanks, * Gaston TJEBBES * http://tonthon.blogspot.com

1 0

Twisted February 2011