Mailman 3 March 2004 - Twisted

[Twisted-Python] Copyable.getStateToCopyFor 'perspective' argument is None
by Ralf Schmitt 22 Mar '04

22 Mar '04

Hi, the following program uses Copyable's getStateToCopyFor method but only get's passed a 'None perspective'. Am I doing something wrong or is this a bug? - Ralf #! /usr/bin/env python from twisted.spread import pb, flavors from twisted.internet import reactor class Foo(flavors.Copyable, flavors.RemoteCopy): def getStateToCopyFor(self, perspective): print "PERSPECTIVE:", perspective return self.__dict__ pb.setUnjellyableForClass(Foo, Foo) class Echoer(pb.Root): def remote_echo(self, st): print 'echoing:', st #return st factory = pb.PBClientFactory() reactor.connectTCP("localhost", 8789, factory) d = factory.getRootObject() d.addCallback(lambda object: object.callRemote("echo", Foo())) reactor.listenTCP(8789, pb.PBServerFactory(Echoer())) reactor.run() -- brainbot technologies ag boppstrasse 64 . 55118 mainz . germany fon +49 6131 211639-1 . fax +49 6131 211639-2 http://brainbot.com/ mailto:ralf@brainbot.com

1 0

[Twisted-Python] TOC and filetranser
by achin 21 Mar '04

21 Mar '04

hi, I'm writing an AIM bot using twisted's TOC implementation. i was wondering if this module supports file transfers (namely sending from the TOC client). and if so, could i get either some sample code, or a more detailed documentation than the one at twistedmatrix.com my first question regarding the SendFileTransfer class is what exactly is the "cookie" parameter in the __init__ method? (i don't see it documented anywhere) as a side note, i was wondering if a TOC2 python module exists, as i think TOC2 would be preferable over TOC thanks, -andrew

4 5

[Twisted-Python] Somebody please point me in the right direction...
by John C. Reddersen 20 Mar '04

20 Mar '04

Hi all, I'm a fairly new Python programmer, and really new to Twisted, so accept my apologies now if this is a clueless newbie question... I'm developing a wxPython application that needs to talk to another app via a very simple sockets based interface. I managed to mangle together some code using twisted to connect to the socket and send an initial starting message to the server and receive it's response. However, I'm unsure how to proceed from here to allow my GUI to send and receive commands over the socket using the protocol created by the factory. All the examples I could find just send canned messages, nothing with user input... Thanks! -John Reddersen --- LSI Logic RapidChip Integration Engineering 3425 40th Ave NW Suite 200 Rochester, MN 55901 (507) 535-3851

2 1

[Twisted-Python] tap2ntsvc (sandbox) and py2exe 0.5.0
by Norm Petterson 18 Mar '04

18 Mar '04

Hi all, Back in November, Cory Dodt mentioned on this list that a preliminary version of tap2ntsvc was available to try out. Has anybody managed to get it to work with py2exe 0.5.0? Using a tap file that works fine when run with twistd (Twisted 1.2.0), and using Python 2.3.3 and py2exe 0.5.0 on Windows 2000, py2exe generates: error: error in setup.cfg: command 'py2exe' has no such option 'service' If I'm not overlooking something obvious, I will look into it further with the samples supplied with this version of py2exe. Comments appreciated ;-) Regards, Norm Petterson

3 2

[Twisted-Python] Question on creating NT service
by Michael Schneider 18 Mar '04

18 Mar '04

Hello All, I am getting back to working on the twisted tap as ntserver, I have created the service, and ran the installer. I run net start gridnoded (name of service is gridnoded) The application event log shows that import __service__ failed I can't seem to find __service__ package, do I need to download and install this from somewhere. I am using py2exe 0.4.2 Thanks for any insights, Mike _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python End of Twisted-Python Digest

2 1

RE: [Twisted-Python] IOCP Reactor (Was: win32 buildbot)
by Schneider, Michael 17 Mar '04

17 Mar '04

If I can allocate a resource for this that is an experienced developer (15 years C guy), but with little python or twisted experience, would someone be able to guide him when he hits a tough spot? I could answer basic twisted/python questions, but I don't know the guts of windows or reactors. We are using twisted in a windows environment and would be willing to contribute the work back to twisted. Thanks Mike ---------------------------------------------------------------- Michael Schneider Senior Software Engineering Consultant UGS PLM Solutions - an EDS Company "The Greatest Performance Improvement Is the transitioning from a non-working state to the working state" > -----Original Message----- > From: twisted-python-admin(a)twistedmatrix.com > [mailto:twisted-python-admin@twistedmatrix.com]On Behalf Of Justin > Johnson > Sent: Tuesday, March 16, 2004 3:37 PM > To: Twisted-Python > Subject: Re: [Twisted-Python] IOCP Reactor (Was: win32 buildbot) > > > I would love to see a more stable version of the windows reactor. :-) > > Occasionally where the win32eventreactor starts spinning wildly out of > control when I do too many things at once. I assume this is the 63 > kernel events limitation or some such thing... > > -Justin > > On Sun, 14 Mar 2004 19:36:10 +0000, "Paul Moore" > <pf_moore(a)yahoo.co.uk> > said: > > Itamar Shtull-Trauring <itamar(a)itamarst.org> writes: > > > > > Fixes to win32event reactor or a finished IOCP reactor so we can > > > abandon it are welcome ;) > > > > I was interested to see this, as I've been aware of the > limitations of > > the standard select reactor on Win32 (no process stuff, for > example), > > but given the comments in the documentation for the win32event > > reactor, I wasn't sure that was the way to go either. > > > > One neat feature in later versions of Win32 (Windows 2000+, > I believe) > > is a kernel-level thread pool, which handles async I/O very cleanly, > > as well as a lot of other stuff, such as waiting on more than 63 > > kernel events, asynchronous function calls, etc, etc. Looking at the > > IOCP reactor, it doesn't seem to use this. > > > > Some questions: > > > > 1. Would a reactor based on Win32 thread pools be worth having? > > 2. Is lack of NT support a problem (Win9x is already disallowed by > > using IO completion ports)? > > 3. Does anyone want to pick this up (the author of the IOCP reactor, > > or the existing win32event reactor, for example)? > > 4. If no-one else wants to pick it up, where would I find > pointers on > > writing a reactor? Assuming there isn't a useful "what > is a reactor > > supposed to do" document (I couldn't find one) what code > would be a > > good starting point? [Note: If this is what ends up happening, > > expect completion in something like 2038, given my copious > > quantities of free time, and the likelihood of me > managing to stick > > with a substantial programming project :-(] > > > > Paul. > > -- > > This signature intentionally left blank > > > > > > _______________________________________________ > > Twisted-Python mailing list > > Twisted-Python(a)twistedmatrix.com > > http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python > > _______________________________________________ > Twisted-Python mailing list > Twisted-Python(a)twistedmatrix.com > http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python >

3 2

[Twisted-Python] threads
by Andrew MacIntyre 17 Mar '04

17 Mar '04

I'm trying to get Twisted 1.2.0 up on the OS/2 EMX port of Python I maintain. Most of it appears to be no great drama, but when I run the test suite, and it hits a threads related test things get awfully out of shape - the process goes into a runaway state that is unkillable, using all available CPU, although the system remains generally usable. A reboot is required to restore order. When I started the testing, I had an OS/2 port of SQLite+PySQLite installed, and the SQLite test triggered the above behaviour. On the assumption that my SQLite port could be implicated, I deinstalled SQLite etc and tried again. This uncovered a typo in twisted/flow/threads.py: *** threads.py.orig Sun Aug 10 13:00:48 2003 --- threads.py Mon Mar 15 17:12:16 2004 *************** *** 122,128 **** except StopIteration: reactor.callFromThread(self._stopping) except: ! self.failure = Faliure() reactor.callFromThread(self._cooperate) self._cooperate.immediate = True --- 122,128 ---- except StopIteration: reactor.callFromThread(self._stopping) except: ! self.failure = Failure() reactor.callFromThread(self._cooperate) self._cooperate.immediate = True With that fixed, I'm now back to the original behaviour. The test log contains the following: ... 2004/03/15 17:13 est [-] --> twisted.test.test_flow.FlowTest.testProtocolLocalhost <-- 2004/03/15 17:13 est [-] twisted.internet.protocol.ServerFactory starting on 0 2004/03/15 17:13 est [-] Starting factory <twisted.internet.protocol.ServerFactory instance at 0x2de70c> 2004/03/15 17:13 est [-] Starting factory <twisted.internet.protocol.ClientFactory instance at 0xb4780c> 2004/03/15 17:13 est [_Protocol,client] Stopping factory <twisted.internet.protocol.ClientFactory instance at 0xb4780c> 2004/03/15 17:13 est [-] --> twisted.test.test_flow.FlowTest.testQueryIterator <-- 2004/03/15 17:13 est [-] --> twisted.test.test_flow.FlowTest.testThreaded <-- 2004/03/15 17:13 est [-] Traceback (most recent call last): File "Lib/threading.py", line 436, in __bootstrap self.run() File "Lib/threading.py", line 416, in run self.__target(*self.__args, **self.__kwargs) --- <exception caught here> --- File "F:/dev/Twisted-1.2.0/twisted/python/threadpool.py", line 157, in _worker context.call(ctx, function, *args, **kwargs) File "F:/dev/Twisted-1.2.0/twisted/python/context.py", line 53, in callWithContext return self.currentContext().callWithContext(ctx, func, *args, **kw) File "F:/dev/Twisted-1.2.0/twisted/python/context.py", line 32, in callWithContext return func(*args,**kw) File "F:/dev/Twisted-1.2.0/twisted/flow/threads.py", line 126, in _process reactor.callFromThread(self._cooperate) File "F:/dev/Twisted-1.2.0/twisted/internet/base.py", line 200, in callFromThread self.threadCallQueue.append((f, args, kw)) exceptions.AttributeError: 'NoneType' object has no attribute 'append' 2004/03/15 17:13 est [twisted.internet.protocol.Factory] (Port 0 Closed) 2004/03/15 17:13 est [twisted.internet.protocol.Factory] Stopping factory <twisted.internet.protocol.Factory instance at 0xaad8cc> 2004/03/15 17:13 est [twisted.internet.protocol.ServerFactory] (Port 0 Closed) 2004/03/15 17:13 est [twisted.internet.protocol.ServerFactory] Stopping factory <twisted.internet.protocol.ServerFactory instance at 0x2de70c> 2004/03/15 17:13 est [Foo,client] Stopping factory <twisted.internet.protocol.ClientFactory instance at 0xabc0ac> 2004/03/15 17:13 est [twisted.internet.protocol.ServerFactory] (Port 0 Closed) 2004/03/15 17:13 est [twisted.internet.protocol.ServerFactory] Stopping factory <twisted.internet.protocol.ServerFactory instance at 0xabc26c> 2004/03/15 17:13 est [Foo,client] Stopping factory <twisted.internet.protocol.ClientFactory instance at 0xabcb0c> 2004/03/15 17:13 est [Foo,client] Stopping factory <twisted.internet.protocol.ClientFactory instance at 0xabcd0c> 2004/03/15 17:13 est [twisted.internet.protocol.ServerFactory] (Port 0 Closed) 2004/03/15 17:13 est [twisted.internet.protocol.ServerFactory] Stopping factory <twisted.internet.protocol.ServerFactory instance at 0xabc14c> <<<log ends>>> The traceback is identical to that in the log after the SQLite test failure. While the threads support in the EMX port of Python passes the Python test suite, and people are successfully running Zope on OS/2 with this Python port, I don't know of any other widespread usage which might have exercised it. So I won't be surprised if it has problems. Can anyone give me any hints about what might be missing or working incorrectly to trigger the above? I should note that I've never tried to use Twisted before. The above is with Python 2.3.3. I don't have permanent internet connectivity, and the test was being run without an internet connection. Regards, Andrew. -- Andrew I MacIntyre "These thoughts are mine alone..." E-mail: andymac(a)bullseye.apana.org.au (pref) | Snail: PO Box 370 andymac(a)pcug.org.au (alt) | Belconnen ACT 2616 Web: http://www.andymac.org/ | Australia

2 1

[Twisted-Python] win32 buildbot
by Itamar Shtull-Trauring 16 Mar '04

16 Mar '04

Thanks to the efforts of Cory and Norfolk, we now have a working win32 buildbot. So, it's time to get all tests passing. Everyone please take a moment to look at what's failing and see if it's code you're responsible for. Fixes to win32event reactor or a finished IOCP reactor so we can abandon it are welcome ;) -- Itamar Shtull-Trauring http://itamarst.org Looking for a job: http://itamarst.org/resume.html

4 3

[Twisted-Python] XML-RPC questions
by Cillian Sharkey 16 Mar '04

16 Mar '04

Hi folks, Couple of questions.. (sorry for the long mail) Q1. Has anyone coded HTML API generation a la DocXMLRPCServer (in Python 2.3) for Twisted's XML-RPC? I have a basic implementation that for any GET request spits out an ugly HTML list by using the XML-RPC introspection calls. If someone has done something similar (well, *better*) I'd be interested in hearing. Q2. To implement this I'm doing: class Test(xmlrpc.XMLRPC): def render(self, request): if HTTP Basic AUTH ok: # Let resource delegate request based on the method type return resource.Resource.render(self, request) else: return 401 HTML page def render_POST(self, request): # All POST requests are XML-RPC calls. return xmlrpc.XMLRPC.render(self, request) def render_GET(self, request): # All GET requests get the HTML API. return HTML for API This works, but I'm curious if this is the 'right' way to do this? Q3. HTTP is a stateless protocol, but I'll be using persistent HTTP/1.1 connections (with practically no timeouts) and would like to link such a connection to a state/session object for each client connection. I can use cookies for this, but given that the connection is kept open, is there a better way to do this? I realise HTTP as a transport for my setup probably isn't the most elegant solution, but it's easy to use. Thanks for any help, -- Cillian

1 0

Re: [Twisted-Python] Twisted + tlslite
by Trevor Perrin 15 Mar '04

15 Mar '04

At 05:40 AM 3/7/2004 +0000, exarkun(a)divmod.com wrote: >On Fri, 05 Mar 2004 22:33:48 -0800, Trevor Perrin <trevp(a)trevp.net> wrote: > > [...] > > I recently wrote an SSL library in python [1] and got it working with > > asyncore. I'd like to make it useable with Twisted too.[...] >[...] > One tip: don't try to integrate with the existing SSL code. The > implementation is very much a result of the API limitations of > PyOpenSSL. Preferably, a new implementation will provide SSL support as > a protocol instead of a transport. For examples of how this can be done, > see twisted.protocols.policies. Hi JP, thanks for the tip! I've got a first-draft done and it seems to work pretty well. One thing I'm not sure about is exception handling. When TLS Lite throws an exception, is there anywhere I can plug-in a handler or something? The code is at http://trevp.net/tlslite/, if anyone's curious. Below is an example of using it. Echo1 does a TLS handshake when the client connects, and Echo2 does a handshake when the client sends "STARTTLS". class Echo(LineReceiver): def connectionMade(self): self.transport.write("Welcome to the echo server!\r\n") def lineReceived(self, line): self.transport.write(line + "\r\n") class Echo1(Echo): def connectionMade(self): if not self.transport.tlsStarted: self.transport.setServerHandshakeOp(certChain=certChain, privateKey=privateKey) else: Echo.connectionMade(self) class Echo2(Echo): def lineReceived(self, data): if data == "STARTTLS": self.transport.setServerHandshakeOp(certChain=certChain, privateKey=privateKey) else: Echo.lineReceived(self, data) factory = Factory() factory.protocol = Echo1 #factory.protocol = Echo2 wrappingFactory = WrappingFactory(factory) wrappingFactory.protocol = tlslite.TLSTwistedProtocolWrapper Trevor

2 3