Mailman 3 September 2009 - Twisted

[Twisted-Python] An XMPP client with SSL support
by Pedro Sanchez 19 Sep '09

19 Sep '09

Hello, I have a sample XMPP client with the following structure: from twisted.words.protocols.jabber import client, jid from twisted.internet import reactor ... factory = client.basicClientFactory(myJid, myPasswd) reactor.connectTCP(host,5222,factory) reactor.run() It works well, I can connect to the XMPP server. But I would appreciate if some one could give me some hints on what's required to get the client to connect using a secure SSL link. Thanks, -- Pedro

3 3

[Twisted-Python] hang when using twisted
by gx1986＠mail.ustc.edu.cn 19 Sep '09

19 Sep '09

I met some problem when writing twisted. The code is 1 #! /usr/bin/python 2 # fileName remoteCopyFile 3 from twisted.internet import protocol , reactor 4 import os 5 import updateCurrentIPList 6 import time 7 8 PORT = 7777 9 10 class TSClientProtocol(protocol.Protocol): 11 def sendData(self): 12 path = '/usr/local/'+self.factory.filename 13 if os.path.isfile(path): 14 f = open(path,'rb') 15 data = f.read() 16 f.close() 17 self.transport.write("filename="+self.factory.filename+'=') 18 self.transport.write(data) 19 self.transport.write('EOF') 20 else: 21 self.transport.loseConnection() 22 23 def connectionMade(self): 24 self.sendData() 25 26 27 def dataReceived(self,data): 28 if data == 'EOF': 29 print 'finished' 30 self.transport.loseConnection() 31 32 33 class TSClientFactory(protocol.ClientFactory): 34 def __init__(self,filename): 35 self.filename = filename 36 protocol = TSClientProtocol 37 clientConnectionLost = clientConnectionFailed = lambda self,connector,reason:reactor.stop() 38 39 def remoteCopyFile(HOST,filename = '4'): 40 reactor.connectTCP(HOST,PORT,TSClientFactory(filename)) 41 reactor.run(installSignalHandlers=0) 42 updateCurrentIPList.updateCurrentIPList(HOST) 43 reactor.connectTCP(HOST,PORT,TSClientFactory('currentIP')) 44 reactor.run(installSignalHandlers=0) 45 46 47 if __name__ == '__main__': 48 remoteCopyFile('127.0.0.1') The program print two "finished",then hang. If i delete the line 40 and 41 or delete the line 43 and 44 ,the program become good. whether can't we use two "reactor.run()" in one function? why? Thank you!

2 1

[Twisted-Python] Twisted FTP server fails on PASV
by Slava Yanson 18 Sep '09

18 Sep '09

It just doesn't want to go past PASV. Spent past 3 hours trying to figure this one out. Any help is appreciated. Log: 2009-09-17 16:26:56-0700 [-] Log opened. 2009-09-17 16:26:56-0700 [-] twisted.protocols.ftp.FTPFactory starting on ***** 2009-09-17 16:26:56-0700 [-] Starting factory <twisted.protocols.ftp.FTPFactory instance at 0x2b3a031037a0> 2009-09-17 16:26:59-0700 [twisted.protocols.ftp.FTPFactory] client connected 2009-09-17 16:26:59-0700 [twisted.protocols.ftp.FTPFactory] --> 220 Twisted 8.2.0 FTP Server 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] <-- USER fnet 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] --> 331 Password required for fnet. 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] <-- PASS ***** 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] --> 230 User logged in, proceed 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] <-- TYPE A 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] --> 200 Type set to A. 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] <-- SYST 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] --> 215 UNIX Type: L8 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] <-- PWD 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] --> 257 "/" 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] <-- PASV 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] DTPFactory.setTimeout set to 10 seconds 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] twisted.protocols.ftp.DTPFactory starting on 38637 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] Starting factory <twisted.protocols.ftp.DTPFactory instance at 0x2b3a0544a170> 2009-09-17 16:27:00-0700 [ProtocolWrapper,0,24.43.31.21] --> 227 Entering Passive Mode (65,61,232,130,150,237). 2009-09-17 16:27:10-0700 [-] timed out waiting for DTP connection 2009-09-17 16:27:10-0700 [-] Unexpected FTP error 2009-09-17 16:27:10-0700 [-] Unhandled Error Traceback (most recent call last): Failure: twisted.internet.defer.TimeoutError: 2009-09-17 16:27:10-0700 [-] --> 550 Requested action not taken: internal server error 2009-09-17 16:27:10-0700 [-] dtpFactory.stopFactory Code: from twisted.protocols.ftp import FTPFactory, FTPRealm, FTP from twisted.cred.portal import Portal from twisted.cred.checkers import FilePasswordDB from twisted.internet import reactor from twisted.python import log import sys log.startLogging(sys.stdout) class bcFTPProtocol(FTP): def connectionMade(self): log.msg("client connected") FTP.connectionMade(self) def lineReceived(self, line): log.msg("<-- " + line) FTP.lineReceived(self, line) def sendLine(self, msg): log.msg("--> " + msg) FTP.sendLine(self, msg) ftp_portal = Portal(FTPRealm('data/'), [FilePasswordDB("ftp.users")]) ftp_factory = FTPFactory(ftp_portal) ftp_factory.protocol = bcFTPProtocol reactor.listenTCP(*****, ftp_factory) reactor.run() Thank you, Slava Yanson Positive Blue, LLC web: www.positiveblue.com tel: (323) 963-4787 aim/yahoo/skype: urbansoot http://www.LinuxDecals.com/

3 3

[Twisted-Python] run queries in deffered, but not in transaction
by Pet 18 Sep '09

18 Sep '09

Hi, I'd like to run several queries in background, some of them may fail. Currently, I do runInteraction for each query. Is there a way to run them all in one deferred, so that if one of them fails, other are not aborted? Thanks in advance! Pet

5 9

Re: [Twisted-Python] Using reactor with multiple processes
by David Yoakley 17 Sep '09

17 Sep '09

Dimitri Vorona wrote: > Hi, > > i'd like to be able to start additional instances of my server using > multiprocess module. To do it i just start a new Process with > mutiprocessing and then create a new instance of my Application there. > Everything works fine, but i can't figure out a way to > stop such a process. If I run reactor.stop() in the child process I > get an infinite loop of errors looking like this: > This is a very timely discussion for us. We are trying to launch multiple independent twistedized children with python multiprocess and yes (as Phil noted) we are getting very strange results. We were aware the multiprocess module does a fork to spawn children but we hoping that this would not be an issue for us because our parent process does NOT start a reactor before spawning the children. In fact even if our parent process never starts its reactor, as soon as we spawn the 2nd twistedized child, bad things start happening in the children. The parent does import the child modules in order to start them and since each child module also imports twisted, we are thinking that some twisted state gets established just on the import of the twisted reactor into the parent and then the fork clones that state into the children. Thanks Phil for the reference to ampoule. We will look at that next. We are still hoping to get the parent set up in such a way that whatever the forking :-) shared state is, it does not get established until after the children are spawed. I'll post back later with what we find. Phil your thoughts on this would also be appreciated. Cheers, David

3 2

[Twisted-Python] network server on multiprocessor hardware
by Bokhan Artem 17 Sep '09

17 Sep '09

Hello. Is there right (standard) way to write twisted network server (tcp/web/mail/etc) which could use several cpu cores? For example, master+workers model, where every worker doing the same job. If so, may somebody help to wrap the sample code below? May be some well-known twisted based software can do that? from twisted.application import service,internet from twisted.web import server,resource class Simple(resource.Resource): isLeaf = True def render_GET(self, request): return "Hello world." application = service.Application("http") ServerFactory = server.Site(Simple()) ServerService = internet.TCPServer(8081, ServerFactory) ServerService.setServiceParent(application)

5 6

[Twisted-Python] Twisted Trial (unittest) and Ant
by Valeriy Pogrebitskiy 17 Sep '09

17 Sep '09

I am trying to implement Ant build.xml script that would include testing Python code using twisted.trial.unittest. When using available pyAntTasks (<py-test> target), I am getting all sorts of errors - even though test scripts complete successfully using Python directly, or using Eclipse's' Run As --> Python unit-test' option. Some errors come from twisted.python.log module, others - I do not even know where from. For example, I am seeing following error: [py-test] import pkg_resources [py-test] Traceback (most recent call last): [py-test] File "<stdin>", line 3, in <module> [py-test] TypeError: __init__() takes at least 2 arguments (1 given) I wonder if anyone has Ant (build.xml) code samples of executing Twisted's unittest scripts. Any help would be appreciated. Kind regards, Val.

1 0

[Twisted-Python] Using reactor with multiple processes
by Dimitri Vorona 16 Sep '09

16 Sep '09

Hi, i'd like to be able to start additional instances of my server using multiprocess module. To do it i just start a new Process with mutiprocessing and then create a new instance of my Application there. Everything works fine, but i can't figure out a way to stop such a process. If I run reactor.stop() in the child process I get an infinite loop of errors looking like this: --- <exception caught here> --- File "/usr/share/exe/twisted/internet/tcp.py", line 755, in doRead skt, addr = self.socket.accept() File "/usr/lib/python2.6/socket.py", line 195, in accept sock, addr = self._sock.accept() <class 'socket.error'>: [Errno 22] Invalid argument I couldn't not find much information on using reactor from different processes, so i'm asking for help here. Dimitri

2 1

[Twisted-Python] memory leak on 8.2.0/2.6 versus 2.5/2.4
by Alec Matusis 16 Sep '09

16 Sep '09

I am running identical twisted servers under high load, one on 2.5.0 (patched for epoll bug) on python 2.4.4 and second one on 8.2.0 on python 2.6.2. The 8.2/2.6 one leaks memory compared to 2.5/2.4.4 to the point that I am about to roll back to older Twisted and then to older Python. Any insight on this?

3 3

[Twisted-Python] Perspective Broker for plugins
by tim wylie 16 Sep '09

16 Sep '09

Hello, I'm just now undergoing my first real twisted application. There is a main server which users authenticate with, and the main server also has different plugins for chat/whatever features. The client side also has a handler for each of these plugins and then a GTK gui associate with them. I've been reading the documentation, tutorials, etc, and I'm a little confused about what the best approach would be. Would you all suggest using Perspective Broker? Each plugin has it's own set of communication that needs to happen with the plugin handler server side as well. Would this be easier some other way? Another question has to do with a GTK handler. I saw that twisted has a reactor built in for that. I do have events that need to be triggered from the server. Should I use twisted for that as well, or just send requests to a callback within the GTK application? Really there is just so much information out there about twisted and everyone does it differently that it's confusing to get started. Any help would be appreciated. Thanks. Tim _________________________________________________________________ Hotmail: Free, trusted and rich email service. http://clk.atdmt.com/GBL/go/171222984/direct/01/

1 0