Mailman 3 June 2007 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz Aug. 5, 2021

Aug. 5, 2021

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |… [View More]

4 5

[Twisted-Python] Get IP of connecting client in XMLRPC server
by Remy C. Cool April 28, 2013

April 28, 2013

Hello, On 18 May 2004, the following message was posted to this mailinglist: Jp Calderone exarkun at divmod.com wrote: >Daniel Newton wrote: > > I have a simple XML-PRC server similar to the example below: > > from twisted.web import xmlrpc, server > > class Example(xmlrpc.XMLRPC): > """An example object to be published.""" > > def xmlrpc_add(self, a, b): > """Return sum of arguments.""" > return a + b def … [View More]

3 3

[Twisted-Python] Reconnecting PB Client
by Don Smith Sept. 12, 2007

Sept. 12, 2007

Does anyone have some example code for building a reconnecting PB client? This is what I have now: from twisted.spread import pb from twisted.internet import reactor from twisted.python import util events = pb.PBClientFactory() reactor.connectTCP("localhost", 8789, events) queue = events.getRootObject()

3 2

[Twisted-Python] Win32 IOCPReactor?
by Trent Nelson Sept. 5, 2007

Sept. 5, 2007

I'm new to Twisted. Perusing the documentation, I came across IOCPReactor. It's marked as 'extremely experimental', and it appears it only provides support for TCP events. It seems the last check in to anything IOCPReactor-related was back in 2005. Is it dead? Is anyone using it? Is anyone planning to pick development back up? Were there specific issues with IOCP that impeded development, or just a general lack of people with time, inclination, or Win32-fu? Assuming the IOCPReactor's … [View More]

19 31

[Twisted-Python] Media Resource Control Protocol (MRCP)
by Ivan Uemlianin Sept. 4, 2007

Sept. 4, 2007

Dear All I am interested in writing an MRCP (Media Resource Control Protocol [1]) server. In particular I want to write an MRCP speech recognition resource server as part of my trefnydd [2] project. I am posting here to ask for advice about the network programming part. I shall also be writing an MRCP client (if only to test the server). All the code will be GPL'd. As far as I understand it, an overview of the networking would go like this: An MRCP session between client and server is … [View More]

6 10

[Twisted-Python] Testing with trial, adbapi questions
by Brendon Colby July 24, 2007

July 24, 2007

Greetings, I've begun moving an application I wrote from asynchat to twisted. I've got basic functionality, I've converted my DB stuff to adbapi and have begun writing unit tests. I have a few questions that I haven't been able to get answered through the API docs, twisted.words protocol code, mailing list posts etc. I'd be very grateful for some assistance! 1. Right now I'm defining my dbPool in my factory init, and running a method to load some data from the DB. I've copied the IRC … [View More]BasicServerFunctionalityTestCase and modified it for my use: class BasicServerFunctionalityTestCase(unittest.TestCase): def setUp(self): self.f = StringIOWithoutClosing() self.t = FileWrapperThatWorks(self.f) # I need this to return an IPv4Address! self.p = sserverd.SServerProtocol() self.p.factory = sserverd.SServerFactory(self.p) self.p.makeConnection(self.t) self.p.factory.dbPool.start() def tearDown(self): self.p.factory.dbPool.close() def check(self, s): self.assertEquals(self.f.getvalue(), s) def testSendDeveloperID(self): self.p.lineReceived('{%s:"PG"}\0' % sserverson.base10toN(104)) self.check("test\0") I've gotten past the database threads hanging open by running start() and close() manually. Now, my database callbacks that load necessary data appear to be getting called AFTER my test runs. I know they're getting called, but when the above test runs, the required data structure is empty. What am I missing here? 2. I'm having a bit of trouble wrapping my head around adbapi. Prior to it, one thing I would do is gather data and return a row, as in, the method "developerExists()" would check the DB and return row[0][0] or something (a bool). Now it seems as though I have to preload this data and check against that. Can I replicate this behavior with adbapi? Is there a better way than having to preload ALL my data up front? How can I get any data from the DB like this: data = getSomethingFromDB() I'm suspicious that I need to adopt a new paradigm here, but am having difficulty seeing past the old way of doing things! 3. I have some methods (as I pointed out in #1) that load data. With adbapi, it appears that I have to do this: def _loadDevelopers(self,results): for result in results: developerID = result[2] ... self.addDeveloper(Developer(authHost,authUrl,developerID,self,rc4key, postHost,postUrl)) def loadDevelopers(self): self.dbPool.runQuery("select * from developers where active=1").addCallback( self._loadDevelopers).addErrback(printError) # Before, I would just load my data here! Is this correct? i.e. a DB method that gets called, each having a corresponding callback method that does the real work? (This seems sort of a pain to me...) I feel as though I'm close to "getting it" (twisted in general, adbapi) but feel that I have yet to connect some key pieces of information. 4. I was digging through the adbapi code, and it appears that the only type of result set I can get is a tuple (because only cursors are used...). Is there a way I can get a dictionary returned, keys are column names? i.e. a MySqlDB.fetch_row(how=1). I'm just not seeing how I can do this with adbapi or, rather, how I can pass through to the MySqlDB module to get this type of result set. 5. I've always run my application using DJB's daemontools (http://cr.yp.to/daemontools.html). Is there an incredibly compelling reason to switch to using twistd? It seems to have some pretty neat features, but I'm just not 100% sure I want to give up daemontools yet. Thanks! Brendon Colby [View Less]

7 16

[Twisted-Python] How to receive a big stream data?
by steven wang July 20, 2007

July 20, 2007

Dear all, I'm using the Twisted to write a socket server. I has a problem in the socket server. I could not receive a big size data when the data size is bigger then the connection buffersize. The protocol description: First, Client send data head to Server. Head Format: ABC,123456,XXX,XXX,XXX^ Second, Client send big data to Server, the big data is stream data. After Server received the big data and then save it to database. My problem source code : ========================================… [View More]

5 8

[Twisted-Python] Flash AMF and Twisted
by Arnar Birgisson July 16, 2007

July 16, 2007

Hi all, Re. this message: http://twistedmatrix.com/pipermail/twisted-python/2007-May/015373.html Has any work been done here? I'm facing a project that requires two-way communication between a Flex/Apollo app and a Twisted server. In my initial tests I used http and comet-like techniques but I'm not sure they are the most efficient way. I'm willing to help with the project - I've already dabbled a little in the DjangoAMF stuff. Arnar

9 12

[Twisted-Python] profiling twisted
by Markus Schiltknecht July 4, 2007

July 4, 2007

Hi, first of all, thank you very much for this great peace of software, I'm using twisted for many different projects and really enjoy it's clean and simple design. Now, I'm wondering if there's a profiling tool, which can quickly tell me what events are blocking my server. I have even deferred the file I/O to separate threads, as I've suspected them to make the server behave poorly when under load. But there still seems to be something blocking... What do you use to find the callbacks … [View More]

5 10

[Twisted-Python] Open Source Twisted Email Server
by Ram Peters July 2, 2007

July 2, 2007

Is there a Open Source Twisted Email Server that have been implemented? thnx.

2 2

[Twisted-Python] web2 DAV client
by Oleg Deribas June 30, 2007

June 30, 2007

Hello, Is it possible to use current web2 dav implementation as webdav client with support for digest auth? -- Oleg

1 0

[Twisted-Python] [Conch] anyone using twisted.conch.ssh.session.SSHSession directly?
by Paul Swartz June 29, 2007

June 29, 2007

I'm working on tests for t.c.s.session.SSHSession, and it's difficult because of the terrible API SSHSession currently has. I've tried a rewrite in branches/session-2710, but I wanted to know if anyone was actually using that class directly? The typical use case is writing an Avatar->ISession adapter, and if you're doing it that way nothing should change for you even with this update. In short, let me know if you're using twisted.conch.ssh.session.SSHSession directly and I need to keep it … [View More]

3 3

[Twisted-Python] What does soap.Proxy.callRemote() do that simple client.getPage() doesn't ?
by Roland Hedberg June 29, 2007

June 29, 2007

Hi! I have two similar implementation of senders, one using HTTP "PUT" and the other SOAP (and a put operation). The core of the soap sender are the lines: proxy = soap.Proxy(recv) return proxy.callRemote('put',data) While the HTTP one uses: return client.getPage(recv, method="PUT", postdata=data, headers=headers) Basically soap.Proxy.callRemote() uses client.getPage() though with the method POST instead of PUT. So there are some clear similarities here. Now, I also have a dispatcher … [View More]

1 0

[Twisted-Python] Implementing streaming (broadcast) TCP servers
by Adam Atlas June 29, 2007

June 29, 2007

I'm working on a server that will be streaming the same data from a source to many clients. It has to be invoked from an HTTP server, so I'm using twisted.web2 (not twisted.web because it also needs to host a WSGI application). In other words, calling GET on a certain path results in the stream as the response, at which point I don't really need any more HTTP functionality. I have it working... currently, the basic process is: I have a class implementing IByteStream, an instance … [View More]

3 5

[Twisted-Python] take my tickets, please
by glyph＠divmod.com June 29, 2007

June 29, 2007

According to the Twisted tracker, I currently have 142 tickets. Many of these are simply because I'm the default assignee of the default "core" component, so almost all new tickets end up in my list. It's getting to the point where I don't even have time to triage all the tickets assigned to me, let alone work on them. If anyone is looking for stuff to do to help out Twisted, triaging all of the 'normal', 'core' tickets assigned to me would be a big help. Not only would it circulate … [View More]

3 4

[Twisted-Python] Google used Twisted...
by Nicola Larosa June 28, 2007

June 28, 2007

...but nobody should know: ;-) http://twistedmatrix.com/trac/wiki/WikiStart?action=diff&version=42&old_ver… (And apparently they still use it: ) http://www.oreillynet.com/onlamp/blog/2007/06/python_web_application_framew… oubiwann: what's up? -- Nicola Larosa - http://www.tekNico.net/ Q: Aside from Dojo, what is your favorite Ajax framework? A: MochiKit. YUI is great code too, but MochiKit has it beat for clarity of vision and implementation quality. Bob Ippolito gets the … [View More]

2 1

[Twisted-Python] Server/Client
by Delgado, Edgardo CIV NAVAIR 4.1.4.3 June 28, 2007

June 28, 2007

I would like to build a server that when it gets a message on a specific port it will "forward" that message to another port. I.e. "Server1" listens on port 10000. When it gets data on port 10000 it will forward the data to "Server2" listening on port 15000. Edgar

5 9

[Twisted-Python] How work ldaptor and twisted
by Julien Peeters June 27, 2007

June 27, 2007

Hi everybody, I'm new to ldaptor and twisted. I don't really understand how twisted work and how can I build a little application with them. I would like to make a mini app which offers me the possibility to administrate very simply my ldap server. Then, the app have to wait for orders, and when it receive one, treat it by sending the appropriate request via ldaptor. My problem is with twisted, and more precisely with the "reactor". I don't really understand how I can manipulate it and what … [View More]

2 2

[Twisted-Python] twisted.conch.telnet example?
by Stephen Hansen June 26, 2007

June 26, 2007

Hello all. :) I'm trying to learn Twisted, and to replace irritating telnetlib code for a simple telnet client application to do so. The problem is I'm slightly lost as to where to start with the twisted.conch.telnet library, so was wondering if anyone could point me to a simple example. So far, I understand the whole client factory thing-- but where I start getting lost is where we get to the "protocol" point (I know I know-- so early to get confused!). Specifically, in the buildProtocol … [View More]

2 2

[Twisted-Python] Pydoc and Zope Interfaces
by Matthew Glubb June 26, 2007

June 26, 2007

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi All, Sorry if this is slightly off-topic but Zope doesn't use pydoc so its not an issue for their users. Has anyone found an easy to apply patch for pydoc that will list the documentation for classes that use implements(). At the moment, it throws an AttributeError and reverts to what looks like __repr__. I found a patch here: <http://simpleparse.sourceforge.net/pydoc/pydoc2.py> Which purports to be able to cope with implements(… [View More]

2 2

[Twisted-Python] Thank You Twisted!
by Matthew Glubb June 26, 2007

June 26, 2007

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi All, I just wanted to say thanks for all of the good work with twisted. I have just finished testing my server application on a 1GB box for 1 hour with 10,000 simultaneous connections and it ran like a dream :) Granted, trying anything other than the epoll reactor brought the server to its knees very quickly. By the way, for any of you using memcache, don't be tempted by cmemcache if you are deferring those operations to a thread. … [View More]

1 0

Re: [Twisted-Python] Beginner question: integrating with CORBA
by Chris Laws June 25, 2007

June 25, 2007

> > ---------- Forwarded message ---------- > From: "Dave Kirby" <D.Kirby(a)tideway.com> > To: <twisted-python(a)twistedmatrix.com> > Date: Mon, 25 Jun 2007 12:03:46 +0100 > Subject: [Twisted-Python] Beginner question: integrating with CORBA > > I have just started looking at Twisted, and it looks really cool and > useful. I have read through much of the docs and the O'Reilly book, but I > still have a head full of questions. > > > > First … [View More]some background. I am considering using Twisted to replace a > component in a network management suite. All the components communicate > through CORBA (omniORB). The component I want to replace gets CORBA calls > that requests data from servers on the network, and the component retrieves > the data using ssh. Currently it spawns /usr/bin/ssh and uses pexpect to > control the interaction. Typically we will have 20-40 simultaneous calls in > progress to different IP addresses, each on a separate thread and each > spawning a separate ssh client. > > > > I want to replace this with a component that uses Twisted instead. From > what I have read Twisted should be ideal for this – I can use the conch > library to do the ssh calls and eliminate the need for spawning dozens of > separate processes (something that has been a major cause of bugs). > > > > The first problem I have is how to integrate the omniORB event loop with > the reactor event loop. My initial thoughts are to have the omniORB event > loop in one thread and run the reactor loop in another thread. When a CORBA > call comes in it will use callFromThread() to post a request to the Twisted > thread that will create the connection and handle the ssh session. Is this > feasible? Any gotchas to watch out for? > > > > However I have also seen reference to using threadedselectreactor for > mixing Twisted and foreign even loops ( > http://bob.pythonmac.org/archives/2005/04/17/twisted-and-foreign-event-loop…), > but I have no idea how to use this with omniORB. Is this worth > investigating further, or should I stick with my original idea? > > > > Replacing CORBA with the Twisted PerspectiveBroker is not an option, since > it would require extensively rewriting a dozen or so components. > > > > I have plenty of other questions, but will save them for another time. > > > > Dave Kirby > > I just got back into a similar thing today after about a month of inactivity on the issue. I posted about it here a while back but got no responses. I'm trying to convert a simple Python/Omniorb CORBA Event Channel client script so that it can robustly handle a separate federated Name Service disappearing. I'm planning on running it using twisted for various reasons (common code, available functionality, etc). So I need to work out if I can use Twisted and CORBA (Omniorb to be specific) together, ideally within the same thread. Currently the simple script has a Tkinter UI which also registers a callback method with the Event Channel client wrapper to handle Event Messages. A self-rescheduling callback is also configured to drive the Orb, at some variable rate, and then the script is handled by the Tkiner mainloop. At regular intervals the Orb is run then rescheduled and then control is returned back to the Tk mainloop. I'm at home and can't remember the exact code but something along the lines of: def runOrb(self): if self.orb.work_pending(): self.orb.perform_work() This all seems to work well. However the script is fairly simple in that it's only monitoring and reacting to Event Channel messages, so slightly different from your use. However, I think that it demonstrates that the orb can be run from within another event processing loop within the same single thread - in this case the Tk mainloop. Now the Tk event processing can be handled by the tksupport package so I thought why not use that model for a CORBA support package? I've totally copied the tksupport file (it's very small) and converted it to perform the running and re-scheduling of the CORBA orb. Sorry I can't provide you more info but as mentioned above I only got back into this today (no testing yet) plus I finish work at that company in a few days. If I get anywhere I'll post back some info. Hopefully it gives you something to look into. Regards, Chris Laws [View Less]

1 0

[Twisted-Python] Call to ffmpeg using getProcessOutput
by Daniel de la Cuesta June 25, 2007

June 25, 2007

2 2

[Twisted-Python] Beginner question: integrating with CORBA
by Dave Kirby June 25, 2007

June 25, 2007

I have just started looking at Twisted, and it looks really cool and useful. I have read through much of the docs and the O'Reilly book, but I still have a head full of questions. First some background. I am considering using Twisted to replace a component in a network management suite. All the components communicate through CORBA (omniORB). The component I want to replace gets CORBA calls that requests data from servers on the network, and the component retrieves the data using ssh. … [View More]Currently it spawns /usr/bin/ssh and uses pexpect to control the interaction. Typically we will have 20-40 simultaneous calls in progress to different IP addresses, each on a separate thread and each spawning a separate ssh client. I want to replace this with a component that uses Twisted instead. From what I have read Twisted should be ideal for this - I can use the conch library to do the ssh calls and eliminate the need for spawning dozens of separate processes (something that has been a major cause of bugs). The first problem I have is how to integrate the omniORB event loop with the reactor event loop. My initial thoughts are to have the omniORB event loop in one thread and run the reactor loop in another thread. When a CORBA call comes in it will use callFromThread() to post a request to the Twisted thread that will create the connection and handle the ssh session. Is this feasible? Any gotchas to watch out for? However I have also seen reference to using threadedselectreactor for mixing Twisted and foreign even loops (http://bob.pythonmac.org/archives/2005/04/17/twisted-and-foreign-event- loops/), but I have no idea how to use this with omniORB. Is this worth investigating further, or should I stick with my original idea? Replacing CORBA with the Twisted PerspectiveBroker is not an option, since it would require extensively rewriting a dozen or so components. I have plenty of other questions, but will save them for another time. Dave Kirby This email and any attachment may contain confidential, privileged information for the sole use of the intended recipient. If you are not the intended recipient, do not disclose, reproduce, disseminate or otherwise use this communication. If you received this communication in error, please immediately notify the sender via email and delete the communication from your system. Company information : Tideway Systems Ltd, Registered Office: Anchor House, 15-19 Britten Street, London, SW3 3TY. Registered in England & Wales Reg. Reg. No: 4598072 VAT No: 805 5153 50 [View Less]

2 1

[Twisted-Python] Utility program to hex-dump network traffic
by Andrew E June 25, 2007

June 25, 2007

Dear Twisted Experts, About 2 years ago I needed a simple way to hexdump network traffic. I threw together a Twisted application, and have improved it little by little whenever I needed to. I didn't want to use an existing network sniffer tool. Instead, I borrowed the idea of a tunnel from ssh: Normally application A connects directly to application B; instead, A connects to the tunnel which connets to B. I posted the program to the ASPN site: http://aspn.activestate.com/ASPN/Cookbook/… [View More]

2 2