Mailman 3 January 2007 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz Aug. 5, 2021

Aug. 5, 2021

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |… [View More]

4 5

[Twisted-Python] Get IP of connecting client in XMLRPC server
by Remy C. Cool April 28, 2013

April 28, 2013

Hello, On 18 May 2004, the following message was posted to this mailinglist: Jp Calderone exarkun at divmod.com wrote: >Daniel Newton wrote: > > I have a simple XML-PRC server similar to the example below: > > from twisted.web import xmlrpc, server > > class Example(xmlrpc.XMLRPC): > """An example object to be published.""" > > def xmlrpc_add(self, a, b): > """Return sum of arguments.""" > return a + b def … [View More]

3 3

[Twisted-Python] Reconnecting PB Client
by Don Smith Sept. 12, 2007

Sept. 12, 2007

Does anyone have some example code for building a reconnecting PB client? This is what I have now: from twisted.spread import pb from twisted.internet import reactor from twisted.python import util events = pb.PBClientFactory() reactor.connectTCP("localhost", 8789, events) queue = events.getRootObject()

3 2

[Twisted-Python] Producers / Consumers and more examples tutorials?
by jarrod roberson March 13, 2007

March 13, 2007

Are there any more concrete examples or tutorials of using Producers and Consumers?

3 5

[Twisted-Python] How to set host/IP Address for reactor.listenTcp()
by jian wu Feb. 16, 2007

Feb. 16, 2007

Hi, I'm new to Twisted, I only had a limited experience using python and its asyncore/asynchat. I went through Twisted Howto doc. I just realized that reactor.listenTcp() will only take "listening port" as its parameter. If I want to run a Twisted Program on a machine with multiple network cards(NICs) associated with different IP addresses and I only want my program listening on a specific IP address or NIC, is there a way I can pass listening IP address to reactor.listenTcp() so it'll only … [View More]

8 10

[Twisted-Python] Support for ICMP ping?
by Nicolas D. Cesar Feb. 8, 2007

Feb. 8, 2007

I've been googling if there is any 'ICMP ping' support in Twisted. I've encounter ancient replies: http://twistedmatrix.com/pipermail/twisted-python/2003-August/005542.html I wonder if today is any ICMP support. I've tried to search the source tree[1], and doesn't seem. My actual needs is creating a DeferredList with "ping-testers" for different IPs, just to check if there up or not. I know I can end up using twisted.internet.utils.getProcessOutput and calling ping, as I would normally … [View More]

5 7

[Twisted-Python] Problem: spawnProcess() never ending when installSignalHandlers=False
by Matt Feifarek Feb. 3, 2007

Feb. 3, 2007

Hello. I'm using Twisted 1.3.0 on python2.4 on an Ubuntu-Hoary x86 Linux box. I'm using twisted and spawnProcess() with a Queue structure to chain processes that need to be called (specifically, imagemagick commands). I use the "processEnded" event/method of t.i.p.ProcessProtocol to go from one task to the next. Twisted shares a python process with a multi-threaded web-app-kit (Webware) so it has to be run in a thread. This worked well on other older versions of twisted and older versions of … [View More]

6 14

[Twisted-Python] Re: Passing extra arguments to twistd?
by gary jefferson Jan. 30, 2007

Jan. 30, 2007

On 1/29/07, Christopher Armstrong <radix at twistedmatrix.com> wrote: > See the following: > > http://twistedmatrix.com/projects/core/documentation/howto/tap.html > > And *maybe* the following > > http://twistedmatrix.com/trac/ticket/1490 Very cool, I like the idea of the run plugin. Until that's ready, I think I'll settle on the next easiest thing, which is just using ENV variables to "pass in" args to each twistd process (which is easily scripted). Gary

2 1

[Twisted-Python] Re: Passing extra arguments to twistd?
by gary jefferson Jan. 29, 2007

Jan. 29, 2007

It's been a while since this was discussed on the list, but I also have a use-case where extra args to twistd would be far more useful than any other option. I'm doing a little p2p thing (which I'm sure is not all that uncommon), and of course I want to test aggregate behavior of many instances, so I instantiate 100 or so on my own box. Not being able to pass in extra args to twistd makes this obviously painful, as it adds the extra step of creating a bunch of configuration or a hoard of … [View More]

2 1

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com Jan. 28, 2007

Jan. 28, 2007

1 0

[Twisted-Python] xml
by Lee Connell Jan. 28, 2007

Jan. 28, 2007

Hey everyone, I have been looking all night and I can’t find any examples of using simple xml to write my own xml protocol for a chat server I intend to build. All I want to do is generate XML from commands and send it across the socket and receive it on the other end and unpack it. Any recommendations on what to use and any tutorials or examples on how to do it. I don’t know a whole lot about XML programming, just it’s basic structure. Thanks! -- No virus found in this outgoing … [View More]

5 9

[Twisted-Python] Foolscap-0.0.7 (aka newpb) released
by Brian Warner Jan. 27, 2007

Jan. 27, 2007

I've made a new release of Foolscap, 0.0.7, which fixes two irritating bugs: in previous versions you could not connect to the same PBURL multiple times, nor could you connect to yourself. The former would return None where it was supposed to return a RemoteReference, the latter could cause a negotiation timeout and failure. Both are fixed now. There are no incompatible protocol changes in this release: 0.0.6 clients will speak to 0.0.7 clients. There likely to be incompatible changes in the … [View More]

2 2

[Twisted-Python] task.LoopingCall: a problem if change the system time
by Roberto Gomez Jan. 26, 2007

Jan. 26, 2007

Hi everyone, I wrote a simple test trying to find why my app freeze when change the system time: ################# from twisted.internet import reactor, task import time def callback(): print time.ctime(time.time()) t = task.LoopingCall(callback) t.start(2.0) reactor.run() ################# If run this and change the system time, let's say a day forward, everything work fine, but if change the system time backward, the program freeze until you change forward again. This is specially … [View More]

2 2

[Twisted-Python] Losing Deferreds : Re: More Questions about Custom Reactors
by Andrew Francis Jan. 25, 2007

Jan. 25, 2007

Message: 3 Date: Mon, 22 Jan 2007 00:32:16 +0000 From: Phil Mayers <p.mayers(a)imperial.ac.uk> Subject: Re: [Twisted-Python] More Questions about Custom Reactors To: Twisted general discussion <twisted-python(a)twistedmatrix.com> Message-ID: <45B40610.7020607(a)imperial.ac.uk> Content-Type: text/plain; charset=ISO-8859-1; format=flowed I am sorry that I am tardy in responding. I was trying out your suggestions. Right now, my main question is under which conditions do deferred … [View More]fail to fire? How do I know that the reactor is still running? Would Manhole help? (Unfortunately I haven't been able to get gtk to work Manhole with Twisted 2.4) >Perhaps you could explain what you're actually trying >to achieve, rather than the solution you have decided >on? An indeed, why you want to use stackless at all - >Twisted is predicated around the assumption of a >stackful i.e. single-threaded Python. I understand your questioning. The main reason I am using Stackless Python is for its process execution state pickling abilities. A second reason is that I find Stackless's communication model very handy for modeling the type of thread synchronisation I wish to do. I know that Twisted assumes a stackful Python and it is an uphill battle. However the gains from getting Twisted to work with Stackless are so great, I think it is worthwhile. For the most part, I have succeeded in having Stackless Python work with Twisted. If you read the Stackless mailing list, I have posted examples. Soon, I will post on the Wiki. My problems stem from situations where I have two or more concurrent tasklets (Stackless threads) that do the following) tasklet[0] - waiting for a Twisted Request Handler tasklet[1] - making a client.getPage call tasklet[2] - making a client.getPage call tasklet[3] - some other operation tasklet[n] - some other operation under these conditions, if tasklet[0] is executed first, the other tasklets will block indefinitely. My problems occur from trying to get around this. Originally I tried taskLoop calling stackless.schedule() to give other tasklets a chance to execute but this would cause reactor problems. Hence the current approach of looking at getting Twisted to run in its own thread. >Alternatively you might be wanting long-running jobs >to be interleaved with other code transparently but >without using real threads? I am not sure how to do this. >If you're proposing using queues to communicate >between a Twisted thread running the reactor and a >stackless thread running your micro-threads, >I don't see why you need to modify Twisted at all. I am a newbie to Twisted. Based on what I am reading, I current assumption is that I would need to >You can just run the stackless microthreads from one >"real" thread (started via callInThread), pass jobs >from Twisted to the "real" thread and probably >a stackless uthread, and pass the replies back to the >twisted thread with a callFromThread. >So, can you not just do this?: Philip, first the good news : thanks a million! This is the exactly the type of example I wanted. It works. The bad news - under certain conditions I am losing deferreds. I think there are deadlock issues but that is not Twisted's fault per se. Unfortunately debuggers work poorly with Stackless so it is difficult for me to know what is happening. I tried telneting but my server is not responding - so I guess that implies that Twisted is still listening but the reactor is not working. Again, any suggestions would be more than welcome. Cheers, Andrew ____________________________________________________________________________________ Bored stiff? Loosen up... Download and play hundreds of games for free on Yahoo! Games. http://games.yahoo.com/games/front [View Less]

1 0

[Twisted-Python] Pycon Twisted Sprint
by Eric Mangold Jan. 25, 2007

Jan. 25, 2007

Does anyone have any ideas for a Twisted Sprint? I will probably be staying at least through Monday. Special-rate-registration ends in one week on February 1st. So if there is going to be any kind of organized activity we ought to figure it out in the next few days. Please raise your hand if you want to hack on stuff after the 'con and, assuming enough peer interest, indicate how many days you would like to stay. Personally if there was enough interest I would stay through Tuesday. … [View More]

2 1

[Twisted-Python] Is it a good/recommended practice to pass Instance Method into reactor.callFromThread()/callInThread()?
by jian wu Jan. 24, 2007

Jan. 24, 2007

Hi Twisted Guru, I'm new to Twisted, I am just experimenting Twisted 2.5 with Python 2.5. It seems that I can pass either a python function or a python object instance method to reactor.callInThread() for blocking operation and reactor.callFromThread() in main event loop. I just want to see whether it is a good/recommended practice to pass Instance Method into reactor.callFromThread()/callInThread(), which implies that the application level context information stored in the python object … [View More]

2 2

Re: [Twisted-Python] Hanging Deferreds in PB Paging code
by Ed Suominen Jan. 24, 2007

Jan. 24, 2007

From: "Brian Granger" <ellisonbg.net(a)gmail.com> > Thanks for the code snippet. I had thought about trying to implement > my own, less complicated solution for this issue but hadn't done > anything yet. I will have a look at your code to see if I can adapt > it. I am not dealing with files, but most of the ideas are the same. > > Also, the task queue stuff looks interesting. It is actually pretty > similar to what we have implemented in IPython: > > http:/… [View More]

2 1

[Twisted-Python] Could anyone send me a copy?
by Arbow Jan. 24, 2007

Jan. 24, 2007

Hi anyone: I could't download the v2.5 release for the bad network condition (1k~2k, always disconnected), could anyone send me a copy to my mailbox? I need these follows: Twisted 2.5.0 tarball Twisted 2.5 Win32 installer for Python 2.4 Twisted 2.5 Win32 installer for Python 2.5 Thanks Arbow

2 2

Re: [Twisted-Python] Twisted server is 5 times SLOWER on Solaris than Linux?
by glyph＠divmod.com Jan. 22, 2007

Jan. 22, 2007

On 01:59 am, jarrod(a)vertigrated.com wrote: >We have LOTS and LOTS of test harness code and profiling code to pinpoint >where bottlenecks are. We are going to have process a couple of terabytes a >day thru this system. Latency thru the system is a high priority because of >what kind of system it is. If you do manage to keep Twisted in the loop on this project, please share what strategy you used. It is unfortunately rare that Twisted is itself a really performance-critical … [View More]

7 11

[Twisted-Python] More Questions about Custom Reactors
by Andrew Francis Jan. 22, 2007

Jan. 22, 2007

Hello Colleagues : I am trying to write a reactor for Stackless Python. I posted previously here and in the Stackless mailing list but I am still stuck. My problems are in the following areas : 1. How does the custom reactor drive Twisted? 2. How does self.interleave() work? 3. How to use deferreds if Twisted is running in a seperate thread. Is callFromThread() used? 4. Some custom reactor implementations inherit and some reactors simply install say threadedselectorreactor? Which technique … [View More]is recommended? For now, I am operating under the assumption that Stackless Python and Twisted ought to be executed in seperate threads. This is because if Twisted blocks then Stackless blocks. Since I am taking this approach, I am assuming I will have to use threadedselectorreactor. I want my Stackless Python application to do two things : 1. Process HTTP based SOAP server requests 2. From the Stackless thread, make client.getPage() calls and use a deferred to process the result. To promote decoupling, I want Twisted and Stackless to communicate via queues. So my code looks as follows - def processResponse(self, httpServer): reply = self.myQueue.get() httpServer.write(reply.toxml().encode("utf-8")) httpServer.finish() return example 2. postRequest = client.getPage(self.address, method = 'POST', headers = self.headers, postdata = self.body)postRequest.addCallback(self.__handleResponse__).addErrback(self.__handleError__) def __handleResponse__(self, pageData): self.queue.put(pageData) I have looked at the reactors included in the twisted.internet. I also looked at Blockingdemo.py. I find BlockingDemo.py confusing (i.e., where is poll() called? It does not seem to do anything.) Question about interleave(): """ Taken from threadedselectorreactor In order for Twisted to do its work in the main thread (the thread that interleave is called from), a waker function is necessary. The waker function will be called from a "background" thread with one argument: func. The waker function's purpose is to call func() from the main thread. Many GUI toolkits ship with appropriate waker functions. """ Using wxReactor as a basis, if the following is my custom Stackless reactor's run method def run(self): self.startRunning(...) self.interleave(some_waker_function) self.stacklessApplication.Loop() 1. How does this drive Twisted (in wxReactor there seems to be a second loop that sleeps every millisecond)? . 2. What should the "some_waker_function" be doing? Is the interleave() method always necessary? 3. What is the background thread? Twisted? A workerThread in threadedselectorreactor? 4. To use client.getPage() and callbacks from Stackless to a Twisted reactor running in a thread, must I use callFromThread? Will the Stackless thread block? Once again, any advice would be appreciated. I will happily summarise on the Stackless Wiki. Sorry for the long message. Thank you, Andrew ____________________________________________________________________________________ Do you Yahoo!? Everyone is raving about the all-new Yahoo! Mail beta. http://new.mail.yahoo.com [View Less]

2 1

[Twisted-Python] Watching a File Descriptor
by Justin Mazzola Paluska Jan. 21, 2007

Jan. 21, 2007

Hi, I’m playing with the inotify(7) interface on Linux. When I call inotify_init(), I get back a file descriptor that I’m supposed read from when there are file system events. What’s the best way to integrate the inotify file descriptor into the Twisted reactor? My question has two subparts: 1. How do I tell Twisted to check my fd for readability? (Is reactor.addReader() all I need? 2. How do I register a callback to my own code when my fd is readable? All in all, it seems what … [View More]

2 1

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com Jan. 21, 2007

Jan. 21, 2007

1 0

[Twisted-Python] Serial port problem
by Matthias Urlichs Jan. 20, 2007

Jan. 20, 2007

Hello, I'm writing to a serial port. That may of course stall. But what if a delayed write results in an error? I didn't see any obvious way to catch that. As an aside, the error whioch prompts me to write this message was EINTR, caused by a child process dying at the right moment. Shouldn't that be retried, like EAGAIN? And shouldn't serial ports be set to be non-blocking? (Linux, Twisted 2.4) -- Matthias Urlichs | {M:U} IT Design @ m-u-it.de | smurf(a)smurf.noris.de Disclaimer: … [View More]

1 0

[Twisted-Python] Re: Hanging Deferreds in PB Paging code
by Ed Suominen Jan. 20, 2007

Jan. 20, 2007

From: "Brian Granger" <ellisonbg.net(a)gmail.com> > We are using PB as an initial protocol for some IPython related > stuff. Overall, PB is working well, but we need to be able to send > larger things around so we have been trying to implement things using > the pb.util.Pager stuff. I have spent a fair amount of time > understanding how the Paging works. I looked at the PB paging stuff and decided to write my own simple solution for it, borrowing the original code as … [View More]needed. At the server, just pass one of these to your PB client: > class Receiver(pb.Referenceable): > """ > Give a PB client a remote reference to an instance of me and it will > have a way to upload a file in chunks of whatever size it likes. > """ > def __init__(self, destPath): > self.file = open(destPath, 'w') > > def remote_chunk(self, data): > self.file.write(data) > return True > > def remote_done(self, ok): > self.file.close() At the client side, use the source path for the file and the reference to the Receiver object to construct an Uploader object: > from twisted.internet import defer, interfaces > from twisted.python.filepath import FilePath > > class Uploader(object): > """ > I upload the file at the specified I{sourcePath} to the I{referenced} PB > referenceable object, both of which are supplied to my constructor. > > @ivar d: A deferred that fires when the file has been completely uploaded. > > """ > implements(interfaces.IConsumer) > > def __init__(self, sourcePath, referenced): > self.ref = referenced > # The source file > fp = FilePath(sourcePath) > if not fp.isfile(): > raise OSError("'%s' is not a valid file path" % result) > self.basename = fp.basename() > self.bytes = [0, fp.getsize()] > self.fh = fp.open() > # Pull producer for reading the file locally > self.producer = FileSender() > # Set up the deferred that fires when the upload is done > d = self.d = defer.Deferred() > d.addCallback(lambda ok: self.ref.callRemote('done', ok)) > # Start the transfer at the file producer > self.producer.beginProducing(self.fh, self) > > def cancel(self): > if not self.d.called: > self.d.callback(False) > self.producer.stopProducing() > > #--- IConsumer API -------------------------------------------------------- > > def registerProducer(self, producer, streaming): > self.producer = producer > if not streaming: > self.producer.resumeProducing() > > def unregisterProducer(self): > if not self.d.called: > self.d.callback(True) > > def write(self, data): > """ > Writes the supplied chunk of file I{data}, no larger than > L{FileSender.CHUNK_SIZE} bytes, to the server using the referenceable > I've been given. > """ > def oops(failure): > failure.printTraceback() > self.cancel() > > def update(sent): > sent = self.bytes[0] + sent > self.p.setValue(sent) > self.bytes[0] = sent > > d = self.ref.callRemote('chunk', data) > d.addCallback(lambda _: update(len(data))) > d.addCallback(lambda _: self.producer.resumeProducing()) > d.addErrback(oops) I excerpted this from code that queues up the remote calls via my asynchronous task queue, and I'm not sure whether it will work well without it. The taskqueue subpackage is part of Twisted-Goodies, see http://foss.eepatents.com/Twisted-Goodies. Anyhow, given how much it borrows from Twisted's own code, I hereby license this code snippet for use under the same MIT-like license that Twisted itself uses. Best regards, Ed [View Less]

2 1

[Twisted-Python] Authentication with multiple handshakes
by Alvin Wang Jan. 19, 2007

Jan. 19, 2007

http://twistedmatrix.com/projects/core/documentation/howto/pb-cred.html The documentation above says that credentials should be able to do authentication with multiple passes. However, I have not been able to find any examples of it. As an alternative, I was going to implement a user object with state that determined what it was able to do. I could force the client to conduct multiple challenge responses to achieve the logged in state. I figured it would be better to ask the mail list for … [View More]

5 8