Mailman 3 April 2003 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz 05 Aug '21

05 Aug '21

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |_____| |_____ | | | | @ t w i s t e d m a t r i x . c o m http://www.twistedmatrix.com/~glyph/

4 5

[Twisted-Python] Resource.render() returning NOT_DONE_YET
by Clark C. Evans 10 May '03

10 May '03

I was just giving a quick Twisted tutorial to someone using twisted and as we were breaking page construction into more than one chunk... an unexpected stumbling block occurred -- returning NOT_DONE_YET form the resource's render() function. I was thinking about two other options: 1. Perhaps NOT_DONE_YET could just be None, this way, it can be the default return value. As I'm browsing through my code this is the most common return... why not make it the default. 2. Alternatively, allow a Deferred to be a return value. Then the underlying caller can add result.finish() to the deferred chain. This has the advantage of not requiring finish() to really be managed. Either the return value is a string, a Deferred, (or for backwards compatibiliy NOT_DONE_YET). In either of the primary cases, result.finish() always gets called... thus making it easier on newbies. Ideally, both of the above options could be used... Best, Clark

5 10

[Twisted-Python] twisted web, documentation
by VAN DER HEIJDEN Maarten 10 May '03

10 May '03

Hello, Being new to twisted, I didn't find in the documentation an example (in DOM Template, widgets, woven or resource templates ), for implementing a form. Someone has a link? Maarten This message and any attachments (the "message") is intended solely for the addressees and is confidential. If you receive this message in error, please delete it and immediately notify the sender. Any use not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval. Neither FININFO (nor any of its subsidiaries or affiliates) shall be liable for the message if modified, altered, falsified, edited or diffused without authorization.

10 15

[Twisted-Python] adbapi question
by Jon Dyte 02 May '03

02 May '03

Hi Below is a small script. My question is what is the correct way to exit after using the adbapi stuff. The script as it stands just hangs the terminal until I Ctrl-Z and kill it. sample run jon> python simpledb.py jon jon jon Done 0 finished {1026: <connection object at 0x8228048>} 0 [<_MainThread(MainThread, started)>, <Thread(PoolThread-136416140-1, started)>] Jon import sys import threading import pprint from twisted.enterprise import adbapi from twisted.internet import reactor dbname,user,passwd = sys.argv[1:4] class SomeTable(adbapi.Augmentation): def getSomeData(self): self.done = 1 qry = "select * from SomeTable" return self.runQuery(qry).addCallbacks(self.operationDone,self.operationError) def operationDone(self, done): print "Done" self.done =0 def operationError(self,err): print err dbpool = adbapi.ConnectionPool("psycopg","dbname=%s user=%s" % (dbname,user)) db1=SomeTable(dbpool) db1.getSomeData() while 1 == db1.done: reactor.iterate() print db1.done print "finished" reactor.crash() reactor.stop() dbpool.close() print dbpool.connections print reactor.running print threading.enumerate()

3 8

[Twisted-Python] NNTP/SMTP authentication
by Abe Fettig 02 May '03

02 May '03

Hi folks, In order to really get NNTP and SMTP (securely) integrated with Hep I need to get authentication working. Both of these protocols support authentication, although it's not required by the core RFCs. But as far as I can tell neither of the modules in twisted/protocols supports authentication at the moment. Is anyone working on this already? If not, I'd like to do it myself, and I'd appreciate some help in understanding the 'right' way to implement authentication in Twisted. I've been looking at J.P.'s IMAP4 work in CVS, and I can see he's using identities and perspectives (although I don't have a complete understanding of how these work). Is the use of twisted.cred preferred? Other drivers, such as POP3, don't seem to use it... Thanks, Abe

3 4

[Twisted-Python] Twisted 1.0.4 - Typo in code
by Francois Pinard 02 May '03

02 May '03

Hi, a mini-tiny nit. In Twisted-1.0.4/twisted/persisted/styles.py, the doc-string writes "peristed" instead of "persisted". P.S. - Is there an email address I could use for such nits, instead of bothering the whole list? -- François Pinard http://www.iro.umontreal.ca/~pinard

2 2

[Twisted-Python] WovenQuotes Howto Problem
by steve＠shrogers.com 30 Apr '03

30 Apr '03

I'm playing with Twisted 1.0.4. After making it through the first couple of TwistedQuotes examples, I get the following failure with the TwistedQuotes example. 2003/04/28 10:05 [HTTPChannel,0,127.0.0.1] exceptions.TypeError: getData() takes exactly 1 argument (2 given)

2 1

[Twisted-Python] twisted 30% slower than asyncore?
by Anthony Baxter 30 Apr '03

30 Apr '03

I kinda suspected that twisted might be slower than asyncore for the straight go-hell-for-leather usage in pythondirector, but I'd not got around to actually testing it. It seems like it's nearly 30% slower than the equivalent asyncore code! This seems a bit higher than I'd expect -- but given all the extra overhead of object creation I guess it's not all that surprising. Current CVS python, Twisted 1.0.4. Has anyone else done similar benchmarking and found different results? I'm not planning on switching the default back to asyncore - the asyncore code is just too brittle for my tastes. (FWIW, the two equivalent modules are http://cvs.sourceforge.net/cgi-bin/viewcvs.cgi/pythondirector/pythondirecto… and http://cvs.sourceforge.net/cgi-bin/viewcvs.cgi/pythondirector/pythondirecto… ) Anthony -- Anthony Baxter <anthony(a)interlink.com.au> It's never too late to have a happy childhood.

3 5

[Twisted-Python] Patch: row / reflectors / util
by Justin Ryan 30 Apr '03

30 Apr '03

Attached is a patch to twisted.enterprise.row, the sqlreflector, and util.py to allow mixed-case table/row names (and to double-quote them in databases that require it, such as postgres). I sent this a while back with a detailed explanation, but have now developed some docs on the web at http://gnubia.net/Docs/Twisted.Gnubia/ detailing some of my changes.. Oh yeh and.. erm.. Itamar told me to re-send on irc a few min ago.. This stuff may need to be cleaned up, and I've considered separating some of it out into a PGRow or somesuch, the way that I (and someone else on the list) am using a PGSQLReflector to do some postgres-specific stuff. suggestions / criticism / flames welcome -j

2 1

[Twisted-Python] mktap dns is broken if you switch subnets
by Tommi Virtanen 30 Apr '03

30 Apr '03

Hi. Lately, I've been playing with using "mktap dns" as a resolver for my laptop. Except, it's making me angry. It doesn't reload resolv.conf. My resolv.conf nameserver list is changed by DHCP about twice per day, atleast. In fact, it even loads the resolv.conf only in __init__, so the list gets stored in the tap file. I need to mktap, tap2deb and dpkg -i whenever I switch subnets! Here's a quick-and-stupid patch that makes it reload resolv.conf regularly, currently made to reread it every minute. This is "close enough". Actually, I want to make it get a notification from somewhere.. I definitely want this implemented. Please tell what direction should I go with the patch, and what do you think is missing from "production quality"? Index: twisted/names/client.py =================================================================== RCS file: /cvs/Twisted/twisted/names/client.py,v retrieving revision 1.31 diff -u -r1.31 client.py --- twisted/names/client.py 29 Mar 2003 18:10:14 -0000 1.31 +++ twisted/names/client.py 30 Apr 2003 15:56:00 -0000 @@ -30,6 +30,8 @@ import socket import os +import errno +import time # Twisted imports from twisted.python.runtime import platform @@ -52,6 +54,10 @@ protocol = None connections = None + resolv = None + resolv_last_read = 0 + resolv_read_interval = 60 + def __init__(self, resolv = None, servers = None, timeout = (1, 3, 11, 45)): """ @type servers: C{list} of C{(str, int)} or C{None} @@ -78,10 +84,9 @@ else: self.servers = servers - if resolv and os.path.exists(resolv): - self.parseConfig(resolv) + self.resolv = resolv - if not len(self.servers): + if not len(self.servers) and not resolv: raise ValueError, "No nameservers specified" self.factory = DNSClientFactory(self, timeout) @@ -99,20 +104,36 @@ d['connections'] = [] return d + def maybeParseConfig(self): + if self.resolv_last_read + self.resolv_read_interval < time.time(): + self.parseConfig() - def parseConfig(self, conf): - lines = open(conf).readlines() + def parseConfig(self): + try: + file = open(self.resolv) + except IOError, e: + if e.errno == errno.ENOENT: + return + else: + raise + + lines = file.readlines() + self.resolv_last_read = os.fstat(file.fileno()).st_mtime + file.close() + servers = [] for l in lines: l = l.strip() if l.startswith('nameserver'): - self.servers.append((l.split()[1], dns.PORT)) - log.msg("Resolver added %r to server list" % (self.servers[-1],)) + resolver = (l.split()[1], dns.PORT) + servers.append(resolver) + log.msg("Resolver added %r to server list" % (resolver,)) elif l.startswith('domain'): self.domain = l.split()[1] self.search = None elif l.startswith('search'): self.search = l.split()[1:] self.domain = None + self.dynamicServers = servers def pickServer(self): @@ -122,8 +143,15 @@ TODO: Weight servers for response time so faster ones can be preferred. """ - self.index = (self.index + 1) % len(self.servers) - return self.servers[self.index] + self.parseConfig() + if not self.servers and not self.dynamicServers: + return None + self.index = ((self.index + 1) + % (len(self.servers) + len(self.dynamicServers))) + if self.index < len(self.servers): + return self.servers[self.index] + else: + return self.dynamicServers[self.index - len(self.servers)] def connectionMade(self, protocol): @@ -155,7 +183,10 @@ if timeout is None: timeout = self.timeout address = self.pickServer() - d = self.protocol.query(address, queries, timeout[0]) + if address is not None: + d = self.protocol.query(address, queries, timeout[0]) + else: + d = defer.fail() d.addErrback(self._reissue, address, queries, timeout[1:]) return d @@ -186,7 +217,10 @@ @rtype: C{Deferred} """ if not len(self.connections): - host, port = self.pickServer() + address = self.pickServer() + if address is None: + return defer.fail() + host, port = address from twisted.internet import reactor reactor.connectTCP(host, port, self.factory) self.pending.append((defer.Deferred(), queries, timeout)) -- :(){ :|:&};:

3 3