Mailman 3 July 2005 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz Aug. 5, 2021

Aug. 5, 2021

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |_____| |_____ | | | | @ t w i s t e d m a t r i x . c o m http://www.twistedmatrix.com/~glyph/

4 5

[Twisted-Python] Get IP of connecting client in XMLRPC server
by Remy C. Cool April 28, 2013

April 28, 2013

Hello, On 18 May 2004, the following message was posted to this mailinglist: Jp Calderone exarkun at divmod.com wrote: >Daniel Newton wrote: > > I have a simple XML-PRC server similar to the example below: > > from twisted.web import xmlrpc, server > > class Example(xmlrpc.XMLRPC): > """An example object to be published.""" > > def xmlrpc_add(self, a, b): > """Return sum of arguments.""" > return a + b def xmlrpc_whatIsMyAddress(self): return self.transport.getPeer().host > > if __name__ == '__main__': > from twisted.internet import reactor > r = Example() > reactor.listenTCP(7080, server.Site(r)) > reactor.run() > > I want to be able to get the address of the client that calls the xmlrpc > method can anyone help me with this? This solution didn't work because 'transport' isn't a property of the Example class. I'm currently in the process of changing from a customized SimpleXMLRPCServer to a twisted XMLRPC server solution and I need to insert the client IP into the attributes passed to the called xmlrpc method. Anyone who knows the answer and is willing to share the info? Regards, Remy

3 3

[Twisted-Python] Problem: spawnProcess() never ending when installSignalHandlers=False
by Matt Feifarek Feb. 3, 2007

Feb. 3, 2007

Hello. I'm using Twisted 1.3.0 on python2.4 on an Ubuntu-Hoary x86 Linux box. I'm using twisted and spawnProcess() with a Queue structure to chain processes that need to be called (specifically, imagemagick commands). I use the "processEnded" event/method of t.i.p.ProcessProtocol to go from one task to the next. Twisted shares a python process with a multi-threaded web-app-kit (Webware) so it has to be run in a thread. This worked well on other older versions of twisted and older versions of python; also on linux. I've tracked down the problem to be twisted itself (or my incorrect use of it) rather than my code. This example illustrates it: ------------------------------------------------- from twisted.internet import reactor from twisted.internet.protocol import ProcessProtocol class MyProt( ProcessProtocol ): def processEnded(self, reason): print "ended.", reason executable = '/bin/touch' args = ( '/tmp/foo.txt', ) args = (executable,) + tuple(args) reactor.spawnProcess( MyProt(), executable, args ) reactor.callLater( 5, reactor.stop ) #reactor.run() reactor.run(installSignalHandlers=False) ------------------------------------------------- As is, this code never runs the "processEnded()" method of MyProt(). If I change the reactor.run() parameter to leave the signal handlers on, it works. Note that I need to leave the signal handlers turned off because I can't run the reactor in the main thread; Webware needs that. I also know that the subprocess is giving up its file descriptors; I can see that if I put more print statements into MyProt(). And I know that the subprocess is working; /tmp/foo.txt is there. It seems that somehow the reactor is using signals to notice when a process has ended; this makes a certain ammount of sense intuitively, though I don't understand the nitty-gritty of processes and signals at all. And more importantly, this has worked before on other combinations of twisted/python. Is this a bug? If so, has it been fixed? If not, what should I do to detect when a spawned process is finished? Thanks very much. Twisted rocks.

6 14

[Twisted-Python] Traceback from pb-Server
by Stephan Popp Sept. 6, 2005

Sept. 6, 2005

Hi, Please excuse my bad english, I hope you will understand what I mean, otherwise feel free to ask. I'm trying to get error messages from my server. I'm using twisted 2.0.0 with python 2.4. The server looks like this: from twisted.spread import pb from twisted.internet import reactor, threads class ServerObject(pb.Root): #...some other methods, which aren't involved... def remote_fitness(self, task, taskDescription, serverID): return threads.deferToThread(self.calc, task, serverID, taskDescription) def calc(self, task, serverID, taskDescription): exec('from %s import %s as func' % (taskDescription.fileName,taskDescription.functionName)) #problem: file specified in fileName needn't to be in working directory of server func(task) #calulates something return task if __name__ == '__main__': factory = pb.PBServerFactory(ServerObject()) reactor.listenTCP(8800, factory) reactor.run() The client calls, after connection is made. def1 = root.call_remote("fitness", task, taskDescription, serverID) def1.addCallback(self.serverCB) def1.addErrback(self.serverErrorCB) def serverErrorCB(self, reason): print reason If the pythonscript named taskDescription.fileName isn't there self.serverErrorCB is called - thats ok. But it prints: reason [Failure instance: Traceback from remote host -- Traceback unavailable] But I need to know why the call failed. Can anyone please help me to get the traceback or the exception message that the server prints (exceptions.ImportError: No module named fitfunc2).

6 6

[Twisted-Python] Errors after upgrading to 2.0.1
by snacktime July 31, 2005

July 31, 2005

I'm testing out an application I wrote in 1.3. In 2.0.1 I get a warning and an exception. The UserWarning about SSL I looked up on the list and I understand why it's there, although I think it's a bad idea. The warning is about a bug in pyopenssl that hasn't been fixed in pyopenssl. In addition there is no reason to think it will ever be fixed after being ignored for this long. Maybe someone could find a better solution for this warning other then leaving it to end user to find the patch on the mailing list, which for all I know might not even work at this point. Maybe put up a patched copy of pyopenssl on twistedmatrix.com? Seems better than having an unmaintained dependancy in twisted. The exception I really have no clue about, maybe someone could point out where the problem is? Code: ---------------------------------------- #!/usr/local/bin/python from OpenSSL import SSL import sys import time from twisted.internet.protocol import ClientFactory from twisted.protocols.basic import LineReceiver from twisted.internet import ssl, reactor from curses.ascii import STX,ETX,FS STX = chr(STX) ETX = chr(ETX) FS = chr(FS) class EchoClient(LineReceiver): end="GoodBye" def connectionMade(self): transaction = self.factory.trans self.sendLine("%s" % transaction) def connectionLost(self, reason): #print 'connection lost (protocol)' reactor.stop() def lineReceived(self, line): print "receive:", line self.transport.loseConnection() class EchoClientFactory(ClientFactory): protocol = EchoClient def clientConnectionFailed(self, connector, reason): print 'connection failed:', reason.getErrorMessage() reactor.stop() def clientConnectionLost(self, connector, reason): #print 'connection lost:', reason.getErrorMessage() reactor.stop() def SetTransaction(self,id,a,b,c,d,e,f,g,h,i,j,k,l): self.trans = STX + id + FS + a + FS + b + FS + c + FS + d + FS + e + FS + f + FS + g + FS + h + FS + i + FS + j + FS + k + FS + l + ETX def GetTransaction(self): return self.trans def main(): factory = EchoClientFactory() factory.SetTransaction('id1','vital','VERIFY','poi2','4111111111111111','05','12','100','123 abc street','98034','','','id1') reactor.connectSSL('localhost', 8000, factory, ssl.ClientContextFactory()) reactor.run() if __name__ == '__main__': main() ----------------------------------------------------------- Output: ------------------------------------------------- receive: id1:APPROVED::TRANSACTION PRESENT:::0000123456789 /usr/local/lib/python2.4/site-packages/twisted/internet/tcp.py:216: UserWarning: SSL connection shutdown possibly unreliable, please upgrade to ver 0.XX "please upgrade to ver 0.XX", category=UserWarning) Traceback (most recent call last): File "./error", line 55, in ? main() File "./error", line 51, in main reactor.run() File "/usr/local/lib/python2.4/site-packages/twisted/internet/posixbase.py", line 199, in run self.mainLoop() File "/usr/local/lib/python2.4/site-packages/twisted/internet/posixbase.py", line 207, in mainLoop self.runUntilCurrent() --- <exception caught here> --- File "/usr/local/lib/python2.4/site-packages/twisted/internet/base.py", line 533, in runUntilCurrent call.func(*call.args, **call.kw) File "/usr/local/lib/python2.4/site-packages/twisted/internet/base.py", line 389, in _continueSystemEvent for callList in sysEvtTriggers[1], sysEvtTriggers[2]: exceptions.TypeError: unsubscriptable object

2 2

[Twisted-Python] why insecureJelly
by Stephan Popp July 29, 2005

July 29, 2005

Hi, I want to send objects accross the network and all I get is insecure Jelly. My application looks like this: -folder structure: -dispyte --common --GACrysVUn --baseclasses in common is the declaration of the object which should be send: from dispyte.baseclasses import Task #thats the abstract baseclass from twisted.spread import pb class SimpleTask(Task.Task, pb.Copyable, pb.RemoteCopy): def __init__(self): ... pb.setUnjellyableForClass(SimpleTask, SimpleTask) these objects are created by a instance of a class located in GACrysVUn: from dispyte.baseclasses import Producer from dispyte.common import SimpleTask class GACrysVUnProducer(Producer.Producer): def foo(): #just as examlpe of the structure task = SimpleTask.SimpleTask() the task-object is given to another class instance lockated in common: here the task object is send: ... factory = pb.PBClientFactory() reactor.connectTCP(parameters[0], parameters[1], factory) def0 = factory.getRootObject() ... def2 = self.root.callRemote("fitness", task, self.taskDescription, self.ID) def2.addCallback(self.callback) def2.addErrback(self.errback, task, self) the server looks like: from twisted.spread import pb from twisted.internet import reactor,threads from dispyte.common import SimpleTask from dispyte.common import ScriptedTaskDescription import sys class ServerObject(pb.Root): ... def remote_fitness(self, task, taskDescription, serverID): """ calls calc in seperate thread and return a deferred """ self.ID = serverID print "ServerObject::remote_fitness ..." return threads.deferToThread(self.calc,task,serverID, taskDescription) ... if __name__ == '__main__': factory = pb.PBServerFactory(ServerObject(sys.argv[1])) reactor.listenTCP(eval(sys.argv[1]), factory) reactor.run() I can't figure out, why insecureJelly is raised here. Can anyone help me? And: Is there a possibility to turn off this feature, so that a server takes objects no matter what class? Thanks in advance. Stephan

1 1

[Twisted-Python] PB checkers bug?
by Steve Freitas July 28, 2005

July 28, 2005

Hi all, I didn't get a reply to my earlier post about inventing mad crazy checkers, so I decided to just use the IUsernamePassword interface, but I'm stuck, because it appears PB won't allow me to use only that interface. If I try, it dies like this: Traceback (most recent call last): Failure: twisted.cred.error.UnhandledCredentials: No checker for twisted.cred.credentials.IUsernameHashedPassword, twisted.spread.pb.IUsernameMD5Password, twisted.spread.interfaces.IJellyable To reproduce the error, all you have to do is tweak InMemoryUsernamePasswordDatabaseDontUse to only implement IUsernamePassword. I've prepared the code below for a client and a server to demonstrate the issue. Am I just missing something? If not, should the inability to use IUsernamePassword alone be filed as a bug? Anybody? Thanks, Steve ----------------- This is the server: #!/usr/bin/python from twisted.cred import checkers, credentials, portal from twisted.internet import reactor from twisted.spread import pb from zope import interface class MyRealm: __implements__ = portal.IRealm def requestAvatar(self, avatarId, mind, *interfaces): print "Success! We'll never get here. :-(" return pb.IPerspective, pb.Avatar(), lambda: reactor.stop() # So we use a simple checker... the_checker = \ checkers.InMemoryUsernamePasswordDatabaseDontUse(client1='abc') # ...and now let's perform the problematic modification: the_checker.credentialInterfaces = (credentials.IUsernamePassword,) the_realm = MyRealm() the_portal = portal.Portal(the_realm) the_portal.registerChecker(the_checker) the_factory = pb.PBServerFactory(the_portal) reactor.listenTCP(8800, the_factory) reactor.run() ----------------- This is the client: #!/usr/bin/python from twisted.spread import pb from twisted.internet import reactor from twisted.python import log from twisted.cred import credentials import sys log.startLogging(sys.stdout, 0) the_factory = pb.PBClientFactory() reactor.connectTCP('localhost', 8800, the_factory) d = the_factory.login(credentials.UsernamePassword('client1', 'abc')) d.addCallback(lambda x: log.msg('Success! Won\'t happen.')) d.addErrback(lambda x: log.msg('We died:', x)) reactor.run() -- Steve Freitas <sflist(a)ihonk.com>

2 2

[Twisted-Python] CPU intensive threads
by Nathaniel Haggard July 27, 2005

July 27, 2005

Is there anything twisted can do about CPU intensive threads? When I run a CPU intensive method via threads.deferToThread it takes all the CPU away and renders the twisted process unresponsive. The perspective broker for example will not make any connections until the CPU intensive methods finish. Is there a way to set the priority of the main part of twisted so that it can run CPU intensive threads and still service connections. Thanks, Nate

5 6

[Twisted-Python] Weekly Bug Summary
by James Y Knight July 27, 2005

July 27, 2005

Bug summary ______________________ Since 2005-07-21 20:48:42.470000: Bugs opened: 7 Bugs closed: 2 Total open bugs: 417 (+5) Urgent: 9 (+0) Bug: 181 (+2) Feature: 150 (+3) Wish: 77 (+0) New / Reopened Bugs ______________________ ==== Bug ==== [WEB] web2 file upload and unit test problems (3 days ago) http://twistedmatrix.com/bugs/issue1127 opened by exarkun win32reactor spawnProcess incorrectly escapes cmd line (4 days ago) CLOSED http://twistedmatrix.com/bugs/issue1123 opened by justinj pop3client needs to handle servers which do not implement CAPA (4 days ago) http://twistedmatrix.com/bugs/issue1125 opened by bkirsch getHost and getPeer not needed for IProcessTransport (4 days ago) http://twistedmatrix.com/bugs/issue1124 opened by justinj ==== Feature ==== Package Twisted using Eggs/EasyInstall (3 days ago) http://twistedmatrix.com/bugs/issue1126 opened by glyph Twisted fork of pyOpenSSL (pyTLS ?) (5 days ago) http://twistedmatrix.com/bugs/issue1121 opened by landonf fix for gtk2reacton warnings (5 days ago) http://twistedmatrix.com/bugs/issue1122 opened by libber Bugs Closed ______________________ ==== Bug ==== [FTP] IFTPShell needs to be completely restructured (3 months ago) http://twistedmatrix.com/bugs/issue983 opened by srichter, closed by itamarst win32reactor spawnProcess incorrectly escapes cmd line (4 days ago) http://twistedmatrix.com/bugs/issue1123 opened by justinj, closed by itamarst

1 0

[Twisted-Python] Getting peer IP address from Perspective Broker
by J French July 26, 2005

July 26, 2005

Is there an accessible method to retrieve a peer's ip address from within pb? I just want to log it. I read the Faq and see how to do it when subclassing protocol i.e.: class MyProtocol(protocol.Protocol): def connectionMade(self): print "connection from", self.transport.getPeer() I'd appreciate it if someone can point me in the right direction. TIA

2 1