Mailman 3 December 2004 - Twisted

[Twisted-Python] M2Crypto+Twisted, part 2
by Heikki Toivonen 08 Dec '04

08 Dec '04

A while back I integrated M2Crypto into Twisted, but the architecture was not deemed good then (it was adding more of the SSL cruft in tcp.py etc.). James Knight pointed me to TLS Lite, which had achieved similar functionality by using ProtocolWrapper and WrappingFactory and all the code was outside of Twisted. (Thanks James!) I've now got an implementation of M2Crypto + Twisted integration using the TLS Lite approach - no changes in Twisted required. (Client only for now and not yet fully cleaned up, but all the important pieces should be there.) However, I've run into some problems and I am not sure if they are bugs in Twisted or if I am using these interfaces wrong. Maybe you can help. The most interesting piece of the code is my TLSProtocolWrapper that inherits from ProtocolWrapper. See http://lxr.osafoundation.org/source/internal/m2crypto/M2Crypto/SSL/TwistedP… Now, this seems to works perfectly with the echoclient samples when the SSL connection has no errors. When there is an error in the SSL connection, and I call connectionLost(), I end up with a traceback that feels like it might be a Twisted bug. Or if I am not allowed to call that, how do I signal that I want to break the connection? Here's the traceback: Traceback (most recent call last): File "twisted_ssl/real.py", line 71, in main reactor.run() File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\intern et\default.py", line 123, in run self.mainLoop() File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\intern et\default.py", line 134, in mainLoop self.doIteration(t) File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\intern et\default.py", line 529, in doSelect _logrun(selectable, _drdw, selectable, method, dict) --- <exception caught here> --- File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\python \log.py", line 65, in callWithLogger return callWithContext({"system": lp}, func, *args, **kw) File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\python \log.py", line 52, in callWithContext return context.call({ILogContext: newCtx}, func, *args, **kw) File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\python \context.py", line 43, in callWithContext return func(*args,**kw) File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\intern et\default.py", line 552, in _doReadOrWrite selectable.connectionLost(f) File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\intern et\tcp.py", line 452, in connectionLost Connection.connectionLost(self, reason) File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\intern et\tcp.py", line 295, in connectionLost protocol.connectionLost(reason) File "c:\builds\chandler\chandler\release\bin\lib\site-packages\M2Crypto\SSL\T wistedProtocolWrapper.py", line 207, in connectionLost ProtocolWrapper.connectionLost(self, reason) File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\protoc ols\policies.py", line 88, in connectionLost self.factory.unregisterProtocol(self) File "c:\builds\chandler\chandler\release\bin\lib\site-packages\twisted\protoc ols\policies.py", line 127, in unregisterProtocol del self.protocols[p] exceptions.KeyError: <twisted.internet.tcp.Client to ('www.verisign.com', 443) a t 10fa800> When I try to hook this up into an IMAP4 client, it seems like my wrapper is getting bypassed somewhere. With debug on, I see: MyProtocolWrapper.__init__ MyProtocolWrapper.makeConnection MyProtocolWrapper.connectionMade then nothing, until the connection finally times out. I haven't looked much into this one yet. Any guesses as to where I should be looking at? Or is it not possible to use the ProtocolWrapper here? I can upload full source packages as well if anyone needs them. -- Heikki Toivonen

3 4

[Twisted-Python] Questions about class KeyFactory.
by Thomas Kristensen 08 Dec '04

08 Dec '04

Hi, I my a bit afraid im asking a stupid question here, I'll do it anyways :) (from twisted/enterprise/row.py) class KeyFactory: ... warnings.warn("This is deprecated. Use the underlying database to generate keys, or just roll your own.", DeprecationWarning) ... As the warnings says this class is deprecated. Use the underlying database. I was wondering if anybody have some example code for this. Im using a PgDB. Here's my rowObject: class DummyRow(row.RowObject): rowColumns = [ ("testId", "int"), ("testName","varchar"), ("testData","varchar") ] rowKeyColumns = [("testId","int")] rowTableName = "dummytable" And my sql code: CREATE TABLE dummytable ( testId SERIAL PRIMARY KEY, testName varchar(64), testData varchar ); So when using a sequencer to generate an unique key for testId, I dont need to supply testId in my insert sql statement. But twisted complains if i dont use the assignKeyAttr function, PG complains if I use it with a value thats already used (ofcourse). My insert code b = DummyRow() b.assignKeyAttr("testId", 3) b.testName = "myTestName" b.testData = "My test data string" manager.insertRow(b).addCallback(onInsert) Again if was wondering if somebody had some sample code to help me solve my problem or a point in the right direction. Thanks in advance, --Thomas

3 3

[Twisted-Python] Updating from Ancient Twisted to Current Twisted
by Bruce Mitchener 08 Dec '04

08 Dec '04

Hello everyone, I've got an app that runs on Twisted 1.0.7rc1 and I'd like to get it running on something more current. Should I be looking at 1.3.0 or is the trunk getting close to a 2.0 release? How stable is the trunk? One of the main fixes that I'm interested in is some of the performance improvements to the data buffering as a result of some issues that I had last year. Also, what is the recommended reactor these days for a system that receives a good bit of load, both from the external world and from within a cluster of Twisted-using systems that communicate over PB? (We use Linux.) Have there been any major API changes that would break code, especially stuff that used PB? (Does cBanana still work? It apparently isn't automatically used any longer...) Long ago, I had some woven-using code, but then that was deprecated in favor of nevow. What's the current recommendation in this area? On the other hand, it looks like there are lots of cool additions to Twisted, like the waitForDeferred stuff, that would greatly simplify some of our code. I didn't see any obvious place to look for most of this info and the changelog isn't really the right level of granularity, so any help would be much appreciated. - Bruce

10 9

[Twisted-Python] Using Windows active directory for Single Sign-on
by Michael Schneider 08 Dec '04

08 Dec '04

Hello All, I am trying to leverage Windows Active Directory (Kerberos based) on a client, for a single sign on. Then running a proccess as that users on a twisted daemon. Is there some example code for - obtaining initial certificate - verifying certificate on twisted - executing process as user under twisted Thank you very much, Mike

2 1

[Twisted-Python] An apology to the community (outstanding trial bugs)
by Jonathan Simms 08 Dec '04

08 Dec '04

Hi everyone, I know that there are several trial issues outstanding and that they're holding up the 2.0 release. I recently got a job working in Manhattan, and am still adjusting to the commute and the tasks that are assigned to me, so I haven't had the attention or energy to devote to twisted. On a lighter note (and adding to the distraction) I also got engaged this weekend. :-) I'm not quite sure when I'll have time to clear these issues up. I will try to work on them during the week and hopefully have them resolved by next week sometime. I am terribly sorry to have put everyone in this position. -Jonathan

2 1

[Twisted-Python] concurrent terminals and telnet
by Tony Pryor 08 Dec '04

08 Dec '04

hello, has anyone tried using twisted python to spawn multiple concurrent telnet client consoles? i've played around with spawning concurrent telnet consoles in perl and feel like i'm getting snared by idiosyncracy. otoh i may just be doing something stupid. tony

1 0

[Twisted-Python] Twisted's roundup instance
by Christopher Armstrong 07 Dec '04

07 Dec '04

I just upgraded it to 0.7.9 from 0.6.6 (!), changed it from the bsddb backend to the sqlite backend, and made it run a persistent server that's proxied through twistedmatrix.com's twisted.web. All this at the advice I got from Richard Jones (roundup author) at OSDC.com.au. The official URL for the Twisted roundup is now "http://twistedmatrix.com/bugs/". This URL has always existed as a convenience, but the old canonical URL (http://twistedmatrix.com/users/roundup.twistd/) is now just a redirect to the nice new terse one. Note that "http://twistedmatrix.com/bugs" (i.e., the same URL without a trailing slash) is a bit off at the moment -- I'll try to figure out a way to get that to not blow up soon. I also got rid of "Critical" -- now the highest issue type is "Urgent", which was all that was documented. I was sick of people marking their pet bugs as "Critical" when it didn't actually mean anything. Hopefully I'll be getting around to fixing up some other issues we've had with our tracker, later on. In the meantime, I'll be going actually _using_ roundup and trying to mark some of those Urgent bugs as resolved. :-) Thanks, Richard, for chatting with me about Roundup at OSDC. Now everyone should be a little happier ;-) -- Twisted | Christopher Armstrong: International Man of Twistery Radix | Release Manager, Twisted Project ---------+ http://radix.twistedmatrix.com

1 0

[Twisted-Python] Installation problems
by Steve Atkins 06 Dec '04

06 Dec '04

I've hit some problems installing twisted 1.3.0 on OS X / python 2.4. The biggie is that I can't find any trace of installation instructions (pre-requisites, installation instructions) anywhere. The tarball README refers to INSTALL, and INSTALL doesn't exist. I attempted a simple "python setup.py build" and the build bombs out after a while with: running build_scripts error: file 'bin/manhole' does not exist So... help a newbie out. What am I doing wrong? Cheers, Steve

3 4

[Twisted-Python] Newbie Alert ! Installation problems.
by Chris Lyon 05 Dec '04

05 Dec '04

I've written an app using medusa but know feel the wind is blowing in a twisted way. But I'm having trouble with installation. Windows .... everything downloads and runs nicely. However the finger demo finger06.py & finger07.py don't find the user name in the dict because the username is returned with /W appended on the front. Is this some strange characteristic of the windows finger client or something I havn't discovered yet? Linux:= neither the gz or the bz2 uncompress successfully. both failing with a complaint from Ark . .. a not very helpful .. an error occured whilst extracting the file. Other files have worked successfully. Things are extracted but upon running python setup.py install I getthe rather cryptic error: file 'bin/manhole' does not exist So I'm a little bit stumped. Anyone any idea about which aspect of my personnal inabilities I'm demonstrating this time?

1 0

[Twisted-Python] Weekly Bug Summary
by James Y Knight 03 Dec '04

03 Dec '04

Bug summary ______________________ Since 2004-11-29 18:01:56.910000: Bugs opened: 2 Bugs closed: 3 Total open bugs: 314 (-1) Critical: 1 (+0) Urgent: 15 (-2) Bug: 120 (+0) Feature: 116 (+1) Wish: 62 (+0) New / Reopened Bugs ______________________ ==== Urgent ==== Catch and log errors in half-close protocol callback codepaths (yesterday) http://www.twistedmatrix.com/bugs/issue807 opened by itamarst ==== Feature ==== [MAIL] Proposed patch to allow smtp.sendmail() to send mail to non-standard ports (2 days ago) http://www.twistedmatrix.com/bugs/issue806 opened by bostik Bugs Closed ______________________ ==== Urgent ==== [CORE] IOCP reactor leaks memory (4 months ago) http://www.twistedmatrix.com/bugs/issue655 opened by naz, closed by PenguinOfDoom [CONCH] Conch client possibly not working (2 weeks ago) http://www.twistedmatrix.com/bugs/issue786 opened by jknight, closed by jknight [TRIAL] trial inconsistently reporting ERROR's (5 days ago) http://www.twistedmatrix.com/bugs/issue796 opened by teratorn, closed by jknight

1 0