Mailman 3 November 2007 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz 05 Aug '21

05 Aug '21

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |_____| |_____ | | | | @ t w i s t e d m a t r i x . c o m http://www.twistedmatrix.com/~glyph/

4 5

[Twisted-Python] Get IP of connecting client in XMLRPC server
by Remy C. Cool 28 Apr '13

28 Apr '13

Hello, On 18 May 2004, the following message was posted to this mailinglist: Jp Calderone exarkun at divmod.com wrote: >Daniel Newton wrote: > > I have a simple XML-PRC server similar to the example below: > > from twisted.web import xmlrpc, server > > class Example(xmlrpc.XMLRPC): > """An example object to be published.""" > > def xmlrpc_add(self, a, b): > """Return sum of arguments.""" > return a + b def xmlrpc_whatIsMyAddress(self): return self.transport.getPeer().host > > if __name__ == '__main__': > from twisted.internet import reactor > r = Example() > reactor.listenTCP(7080, server.Site(r)) > reactor.run() > > I want to be able to get the address of the client that calls the xmlrpc > method can anyone help me with this? This solution didn't work because 'transport' isn't a property of the Example class. I'm currently in the process of changing from a customized SimpleXMLRPCServer to a twisted XMLRPC server solution and I need to insert the client IP into the attributes passed to the called xmlrpc method. Anyone who knows the answer and is willing to share the info? Regards, Remy

3 3

[Twisted-Python] Advise for heavy concurrency
by Atilla 03 Dec '07

03 Dec '07

I'm interested in how well Twisted would perform in situations where there is a very high number of concurrent connections. The problem: I'm working on a feature that would require me to distribute small amounts, both in occurrence and size, of packets to a very large number of connected clients. Think in the terms of a Jabber or IRC server, but with a lot less traffic. What we're trying to do is to maximize the number of simultaneous connections a server can run, to an absolute maximum. It'll be a dedicated system so crippling any system-wide setting is not going to interfere with other applications. So far experimenting with the epoll reactor has shown really nice scalability as numbers grow. Thousands of connections per machine are no problem at all, but we need to scale out heavily. At a certain point the memory requirements for keeping open all those connections in the system grow higher, but those can be minimized by adjusting system buffer sizes, tcp window sizes and certain other settings. Furthermore - more than one instance of the service could be ran per server, dedicating two or three processes on a 4-core CPU system, until exhausting the rest of the limits, in case CPU oevrhead becomes large. I'm also considering advantages that might come through different I/O and/or process schedulers. Is there anything that would be beneficial to my situation, considering the server will be a dedicated machine with little to nothing else to run on it that might suffer performance degradation? Does anyone have any experience with scaling twisted to a very large number of parallel connections? Are there any limitations that I might be missing? We'll start experimenting with a sample service soon to try to identify any specific limitations that will need to be worked on. Any tips are wellcome. Cheers,

7 25

[Twisted-Python] StdioOnnaStick instance has no attribute 'isatty'
by Marcin Kasperski 03 Dec '07

03 Dec '07

I just tried to run some trial tests on ubuntu gutsy (twisted 2.5.0), just to get the error as in the title (full traceback below). Does anybody know what is wrong here? Traceback (most recent call last): File "/usr/bin/trial", line 24, in <module> run() File "/usr/lib/python2.5/site-packages/twisted/scripts/trial.py", line 345, in run test_result = trialRunner.run(suite) File "/usr/lib/python2.5/site-packages/twisted/trial/runner.py", line 772, in run result = self._makeResult() File "/usr/lib/python2.5/site-packages/twisted/trial/runner.py", line 712, in _makeResult return self.reporterFactory(self.stream, self.tbformat, self.rterrors) File "/usr/lib/python2.5/site-packages/twisted/trial/reporter.py", line 555, in __init__ if colorizer.supported(): File "/usr/lib/python2.5/site-packages/twisted/trial/reporter.py", line 446, in supported if not sys.stderr.isatty(): AttributeError: StdioOnnaStick instance has no attribute 'isatty' -- ---------------------------------------------------------------------- | Marcin Kasperski | For waterfall, milestones are commitments. | http://mekk.waw.pl | For iterative development, they are decision | | points. (Martin) ----------------------------------------------------------------------

2 3

[Twisted-Python] implementing a timeout
by J Davis 01 Dec '07

01 Dec '07

Greetings, I'm a newcomer to twisted and am struggling a little with the learning curve. I have an idea for an app that I believe is ideally suited for twisted though I could use some help finding the right way to approach it. It performs a status check by getting a page from a web server. It calculates the time it took to download the page and also can check that the content matches a predefined string. That part of it is working fine but I'd like to take it a step further. I need a way to impose a limit on how long it waits to receive a response so that I can detect unresponsive hosts. I must say that I'm at a loss as to how to add such a timeout to my code. Any pointers or examples would be greatly appreciated. Here is a simplified version of the function that I'm working with. --------------------------------------- from twisted.internet import task, reactor from twisted.web import client import time class HTCheck: def handleResponse(self, data, start_time): response_time = time.time() - start_time if data == "It lives!\n": Status = "OK" else: Status = "Test page content mismatch" def check(self): start_time = time.time() d = client.getPage("http://localhost/test.html") d.addCallback(self.handleResponse, start_time) return d l = task.LoopingCall(HTCheck().check) l.start(10.0) reactor.run()

2 2

[Twisted-Python] OpenSSL problem
by Andrew Francis 30 Nov '07

30 Nov '07

Hello Folks: I am using client.getPage with a URL that uses the https protocol. I get the error from OpenSSL import SSL ImportError: No module named OpenSSL I downloaded the Win32 binary for OpenSSL and pyOpenSSL. I get the error - error - Python was build with Visual Studio 7.1 and extensions need to be built with same version of compiler, but it isn't installed. I don't have Visual Studio 7.1. And I used a pre-compiled Stackless Python binary. Is there an easy way to get around this without say, recompiling Stackless (and compiling OpenSSL) with cygwin gcc? Cheers, Andrew ____________________________________________________________________________________ Never miss a thing. Make Yahoo your home page. http://www.yahoo.com/r/hs

2 1

[Twisted-Python] abstract filedescriptor
by Francisco Herrero 30 Nov '07

30 Nov '07

Hello. At first excuse me for my poor English. I've making a python library for handle the pcican board, using the canlib library. It works fine. Now, I have to integrate to a twisted application that I made, for package encapsulation over tcp/ip. This works fine in serialport using abstract.filedescriptor and pyserial, but in the canlib case I have no file descriptor for this. What can I do for encapsulate like serial protocol, but with canlib methods? I have to re factorize the pycanlib library to build a file descriptor that represents, or is a way to readapt the abstract.filedescriptor for that? The methods that I have is: Channel.readWait() <- this is persistent Channel.read() <-this is not persistent. If buffer is empty returns. Channel.write(<can package attributes>) More details: This is the file descriptor I wrote... ---------------- # twisted imports from twisted.internet import abstract, fdesc, main import canlib from canlib import canOPEN_EXCLUSIVE, canWANT_EXTENDED, BAUD_1M, canDRIVER_NORMAL class CANConnector(abstract.FileDescriptor): """ Conector para el dispositivo pcican usando pycanlib """ connected = 1 def __init__(self, protocol, conf, reactor): abstract.FileDescriptor.__init__(self, reactor) self._channel = canlib.Channel(0) self._channel.open(canOPEN_EXCLUSIVE | canWANT_EXTENDED) self._channel.setBusOff() self._channel.setBusParams(BAUD_1M, 4, 3, 1, 1) self._channel.setBusOutputControl(canDRIVER_NORMAL) self._channel.setBusOn() self.reactor = reactor self.protocol = protocol self.protocol.makeConnection(self) self.startReading() def writeSomeData(self, data): return self._channel.write(1000, data, 10, 0) def doRead(self): pack = self._channel.readWait() # returns the message of package return pack['msg'] def connectionLost(self, reason=None): abstract.FileDescriptor.connectionLost(self, reason) self._channel.close() ------------ in the main tac service this is how I use the connector: --------------- (...) class ServiceChannel(protocol.Protocol): def connectionMade(self): print 'Canal conectado' def dataReceived(self, data): print "datorecibido" s.writeOnPort(data) def connectionLost(self): print 'Canal desconectado' class SimulatorService(service.Service): (...) def startChannel(self): (...) c = ServiceChannel() (...) self.channel = CANConnector(c, self.conf.channel, reactor) (...) def writeOnPort(self, data): self.factory.instance.transport.write(data) -------- This application pipes the can comunications whith a tcp ip port. Then ,when I run: $ twistd -ny main.tac 2007/11/30 10:52 -0300 [-] Log opened. 2007/11/30 10:52 -0300 [-] twistd 2.5.0 (/usr/bin/python 2.5.1) starting up 2007/11/30 10:52 -0300 [-] reactor class: <class ' twisted.internet.selectreactor.SelectReactor'> 2007/11/30 10:52 -0300 [-] Loading main.tac... 2007/11/30 10:52 -0300 [-] /usr/bin/twistd: option -n not recognized 2007/11/30 10:52 -0300 [-] /usr/bin/twistd: Try --help for usage details. 2007/11/30 10:52 -0300 [-] Loaded. 2007/11/30 10:52 -0300 [-] __builtin__.ServiceFactory starting on 5000 2007/11/30 10:52 -0300 [-] Starting factory <__builtin__.ServiceFactory instance at 0x84069cc> 2007/11/30 10:52 -0300 [__builtin__.ServiceFactory] {'protocol': 'can', 'number': '0', 'channel': '1'} 2007/11/30 10:52 -0300 [__builtin__.ServiceFactory] Canal conectado 2007/11/30 10:52 -0300 [__builtin__.ServiceFactory] channel started................. 2007/11/30 10:52 -0300 [__builtin__.ServiceFactory] se generan los archivos de registro <... (Connect to 5000 port ) ..> 2007/11/30 10:52 -0300 [__builtin__.ServiceFactory] Conexion establecida desde IPv4Address(TCP, '192.168.6.38', 5000) 2007/11/30 10:52 -0300 [-] Unhandled Error Traceback (most recent call last): File "/usr/lib/python2.5/site-packages/twisted/scripts/_twistd_unix.py", line 214, in postApplication app.runReactorWithLogging(self.config, self.oldstdout, self.oldstderr) File "/usr/lib/python2.5/site-packages/twisted/application/app.py", line 113, in runReactorWithLogging reactor.run() File "/usr/lib/python2.5/site-packages/twisted/internet/posixbase.py", line 220, in run self.mainLoop() File "/usr/lib/python2.5/site-packages/twisted/internet/posixbase.py", line 231, in mainLoop self.doIteration(t) --- <exception caught here> --- File "/usr/lib/python2.5/site-packages/twisted/internet/selectreactor.py", line 97, in doSelect [], timeout) exceptions.ValueError: file descriptor cannot be a negative integer (-1) 2007/11/30 10:52 -0300 [-] Malformed file descriptor found. Preening lists. 2007/11/30 10:52 -0300 [-] bad descriptor <can.CANConnector object at 0x83e94ec> Thanks for your attention. Fran PD: If anybody is interested in this pycanlib library I pass the source for liberation. -- "El hombre se descubre cuando se mide con un obstáculo" (Saint Exupéry)

1 0

[Twisted-Python] how can I Scheduling a command?
by Don Smith 29 Nov '07

29 Nov '07

Stephane, I saw a post from you about a year and a half ago that you had built a scheduler in twisted. I wonder if you would share your source code with me? http://twistedmatrix.com/pipermail/twisted-python/2006-July/013615.html Thanks, Don

3 3

[Twisted-Python] Transfering a file through ActionScript xml sockets
by Raj kumar 28 Nov '07

28 Nov '07

Sorry for not giving clear information in my previous mail. I am using action script xml sockets. Now anyone can help me in transferring a file to client using action script xml sockets. Thank you in advance. Raj.. On Tue, 27 Nov 2007 10:50:35 +0530 (IST), Raj kumar <k_r_a_j_kumar(a)yahoo.co.in> wrote: >Hi, >I have a server-client application(by using twisted),communicating through xml sockets. >can any one help me in transferring a file from server to client through xml sockets? At lest some references to how to use xml sockets in transferring data/files. _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python Get the freedom to save as many mails as you wish. To know how, go to http://help.yahoo.com/l/in/yahoo/mail/yahoomail/tools/tools-08.html

3 2

[Twisted-Python] Two main loops, revisited
by Bernie Roehl 28 Nov '07

28 Nov '07

Hi everyone So, I've been trying the suggestion that was put forward when I asked my earlier question about having two main loops in my game (one for the rendering engine, one for Twisted). Basically, what I'm doing is this: def renderFrame(): ogreLock.acquire() ogre.WindowEventUtilities.messagePump() root.renderOneFrame() ogreLock.release() renderTask = task.LoopingCall(renderFrame) renderTask.start(0.01, False) reactor.run() I'm using the Python implementation of the Project Darkstar client, which is built around Twisted. Unfortunately, I'm running into two problems. The first is that I appear to be losing messages, which makes me wonder if Twisted isn't getting enough cycles and is somehow missing incoming data. The second is that my application hangs randomly. When I call renderFrame() in a simple loop (no Twisted), everything is rock-solid. Has anyone done anything like this before (realitime 3D application with Twisted), or am I breaking new ground here? Any suggestions would be much appreciated... -- Bernie Roehl Mail: broehl(a)gmail.com

3 2