Mailman 3 October 2004 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz Aug. 5, 2021

Aug. 5, 2021

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |… [View More]

4 5

[Twisted-Python] Get IP of connecting client in XMLRPC server
by Remy C. Cool April 28, 2013

April 28, 2013

Hello, On 18 May 2004, the following message was posted to this mailinglist: Jp Calderone exarkun at divmod.com wrote: >Daniel Newton wrote: > > I have a simple XML-PRC server similar to the example below: > > from twisted.web import xmlrpc, server > > class Example(xmlrpc.XMLRPC): > """An example object to be published.""" > > def xmlrpc_add(self, a, b): > """Return sum of arguments.""" > return a + b def … [View More]

3 3

[Twisted-Python] twisted and threading
by twisted-10152003＠atlas.lcs.mit.edu Nov. 26, 2004

Nov. 26, 2004

I wrapped a c library using swig and was hoping to make use of it in a twisted server I am writing. The issue is that the c library fundamentally blocks waiting for input that may never come. Is there a way from twisted to deal with this cleanly within the framework? I.e. some combination of adding a reactor.addSystemEventTrigger event and calling reactor.threadpool.stop seem like it should work but I haven't had any luck yet. (I saw all the previous posts on this topic, but the … [View More]

8 10

[Twisted-Python] mktap news error
by Tim Terlegård Oct. 30, 2004

Oct. 30, 2004

I'm trying to run the twisted.news server. This should be possible using: $ mktap news but that results in ImportError: news. I get the traceback below. What am I doing wrong? Tim Traceback (most recent call last): File "/usr/bin/mktap", line 30, in ? run() File "/usr/lib/python2.3/site-packages/twisted/scripts/mktap.py", line 152, in run options.parseOptions(sys.argv[1:]) File "/usr/lib/python2.3/site-packages/twisted/python/usage.py", line 209, in parseOptions … [View More]

3 3

[Twisted-Python] Re: [Twisted-commits] r12244 - Make spewer log calls in threads, too
by exarkun＠divmod.com Oct. 30, 2004

Oct. 30, 2004

On Sat, 30 Oct 2004 05:12:25 -0600, Andrew Bennetts <spiv(a)wolfwood.twistedmatrix.com> wrote: >Author: spiv > Date: Sat Oct 30 05:12:24 2004 > New Revision: 12244 > > Modified: > trunk/twisted/application/app.py > Log: > Make spewer log calls in threads, too > > Modified: trunk/twisted/application/app.py > ============================================================================== > --- trunk/twisted/application/app.py (original) > +++ trunk/… [View More]

2 1

[Twisted-Python] UncatchableExceptions
by Andrew Bennetts Oct. 30, 2004

Oct. 30, 2004

<foom> exarkun: I suspect we should introduce a UncatchableExceptions constant somewhere <foom> exarkun: and require that all except:'s are preceded by except UncatchableExceptions: raise <exarkun> foom: It's possible that is a good idea. <exarkun> foom: I'm not really sure, though. <spiv> foom: With (KeyboardInterrupt, SystemExit, MemoryError, SystemError) ? <foom> spiv: yes I guess this would live in twisted.python somewhere, and the coding … [View More]

4 3

[Twisted-Python] Weekly Bug Summary
by James Y Knight Oct. 29, 2004

Oct. 29, 2004

Bug summary ______________________ Since 2004-10-23 04:58:55.150000: Bugs opened: 14 Bugs closed: 3 Total open bugs: 327 (+11) New / Reopened Bugs ______________________ Incorrect traceback from trial (7 hours ago) http://www.twistedmatrix.com/bugs/issue769 opened by exarkun [TRIAL] Trial incorrectly reports the number of tests run (6 hours ago) CLOSED http://www.twistedmatrix.com/bugs/issue770 opened by exarkun [TRIAL] Traceback from trial in trivial usage (7 hours ago) … [View More]

1 0

[Twisted-Python] doc/core/howto/components.xhtml question
by Lee Harr Oct. 29, 2004

Oct. 29, 2004

in doc/core/howto/components.xhtml there is a HairDryer class like this: class HairDryer: def plug(self, socket): adapted = IAmericanSocket(socket) assert socket.voltage() == 110, "BOOM" print "I was plugged in properly and am operating" I am new to this interface / adaptation system, but I am thinking it should be: class HairDryer: def plug(self, socket): adapted = IAmericanSocket(socket) assert adapted.voltage() == 110, "BOOM" print … [View More]

2 1

Re: [Twisted-Python] Case for an Async MySQL Driver?
by Seun Osewa Oct. 28, 2004

Oct. 28, 2004

Nick Arnett wrote: >Anybody want to offer more about how this might look? I don't know if I >can fit it into my work, but it would be a terrific addition to my >toolbox (I have many thousands of lines of Python talking to MySQL). >And I suppose it would offer the excuse I've been needing to ask our CEO >about his thoughts on open-sourcing parts of our code. Here are some ideas for an async MySQL 'driver' for Twisted: 1) create or use a connection: connection = MySqlPool.connect(… [View More]

2 2

[Twisted-Python] Latest modpubsub is using Twisted
by L. Daniel Burr Oct. 28, 2004

Oct. 28, 2004

After experiencing the itching and burning of asyncore, their python developers have turned to twisted, the soothing ointment of network programming. http://www.mod-pubsub.org/blog/archives/440_Repubsub_good_to_go.html Naz

1 0

[Twisted-Python] Case for an Async MySQL Driver?
by L. Daniel Burr Oct. 28, 2004

Oct. 28, 2004

Seun Osewa wrote: >Here are some ideas for an async MySQL 'driver' for Twisted: [snip description of API] >This format allows the user to send an unlimited number of queries to >be run together, thus limiting the number of callbacks necessary for a >program requiring many small interactions with the database. "begin" >and "end" will count as an example. This minimalistic API also allows >more advanced (twisted.enterprise style) interfaces to be built on top >of it. I … [View More]

1 0

[Twisted-Python] FTPClient and fetching a file from an FTP server
by Gaspard, Bradley S Oct. 27, 2004

Oct. 27, 2004

I've looked at the ftpclient.py example and have also found an example of moving a file to an ftp server on this list ... but not how to fetch a file from the server. From the examples and the API it looks like the retrieveFile( ) method and a callback are required but I have not yet put the pieces together. I am very much a newbie and would be grateful for any pointers on how to do this.

1 0

[Twisted-Python] IMAP fetchUID speed?
by Nick Arnett Oct. 27, 2004

Oct. 27, 2004

I'm trying to figure out what's happening in an IMAP implementation. The server at the moment has a very big backlog -- perhaps 80K messages. I was expecting that if I did this: d.addCallback(lambda x: self.proto.fetchUID('1:10')) things would move along quickly... but there's a huge delay somewhere. I think it's in that callback, since I've added breakpoints in handleuids() and they're not being reached (as they are when I hit a smaller mailbox on a different server). Thanks for any … [View More]

2 1

[Twisted-Python] twisted run out of file descriptors
by Alec Matusis Oct. 26, 2004

Oct. 26, 2004

Hi I am running twisted on 2.4.21 Kernel. My chat server has been puking and dying the last couple days and it seemed pretty clear that it was dying when it was reaching 1024 open file descriptors. I noticed the default ulimit -n was 1024, so I added a 'ulimit -n 4096' before starting the chat server. That has apparently allowed it to surpass 1024 descriptors (it has 1263 at the moment) but now it is failing to call select (see sample errors below). There is this value FD_SETSIZE in the C … [View More]

8 13

[Twisted-Python] CFReactor
by James Y Knight Oct. 26, 2004

Oct. 26, 2004

Itamar just added half-closing support to Twisted, and I foolishly volunteered to look at adding support to cfreactor for him. However, that was before I looked at it. Now that I have, I have little idea what it's actually doing, so I'm afraid that I'm unable to actually implement this change. The "SelectableSocketWrapper" looks like a horrible kludge, and I'm not sure why it's necessary. Why does it override the wrapped object's "connectionLost"? Why do you have to wrap&override … [View More]

2 4

[Twisted-Python] Case for an Async MySQL Driver?
by Seun Osewa Oct. 26, 2004

Oct. 26, 2004

Hi, I'm new to Twisted, and I was just thinking about how, while 'twisted.enterprise.adbapi' is is a really neat idea, it's sort of a stop-gap solution pending the time async database drivers can be integrated into Twisted. It's not 'right' to have 1 python thread and 1 mysql server thread/process for each connection. How about an event-driven MySQL protocol implementation that fits into the Twisted Framework? (I came accross a MySQL protocol specification online once but I think I've lost … [View More]

5 5

[Twisted-Python] reactor.stop() won't, threads and Queue to blame?
by Brett Viren Oct. 25, 2004

Oct. 25, 2004

Hi, I can't seem to make reactor.stop() actually stop the reactor and allow my program to exit. I hope someone can help. What I'm actually trying to do is implement an execution pipeline so I can serialize certain jobs but still run them in a thread so the main loop can go about its business. I do this with a class, CommandQueue, that has a Queue.Queue and a method that can be called via reactor.callInThread() that slurps the queue and runs any callables sent down it. Each callable's … [View More]result is obtained from a Deferred. This thread loops until I set CommandQueue.stop=True. (Maybe someone knows a better way?) To try to triger the shutdown, I add a callback to the Deferred associated with the final callable sent down the queue. If I instead call shutdown function via reactor.callLater() then the reactor will actually stop. I don't know if it matters, but /bin/ps only shows one instance of python running. Usually I see one instance per thread. The code below and its output shows the problem. #!/usr/bin/env python2.3 from twisted.python import threadable threadable.init(1) from twisted.internet import reactor,defer from Queue import Queue,Empty class CommandQueue: '''Queue up commands for serial calling. One must call the drain() method to start reading the internal queue. Most likely one wants to call this in a thread.''' def __init__(self): "Create a CommandQueue" self.queue = Queue() self.stop = False return def __call__(self,meth,*a,**k): '''Call meth(*a,**k) when it reaches end of queue. Returns a Deferred that will pass the return of meth.''' deferred = defer.Deferred() self.queue.put((deferred,meth,a,k)) return deferred def drain(self): 'Drain the command queue until CommandQueue.stop is True' while not self.stop: try: d,meth,a,k = self.queue.get(True,1) except Empty: print " queue empty" continue print "calling %s(%s,%s)"%(meth.__name__,str(a),str(k)) d.callback(meth(*a,**k)) print "callback done" print "drain closing" return 0 def test1(): import time cq = CommandQueue() reactor.callInThread(cq.drain) def shutdown(x=None): print "Stopping CommandQueue" cq.stop = True print "Stopping reactory" reactor.stop() print "reactor.stop()'ed" def burp(x): for n in range(0,x): time.sleep(1) print x,n return x def chirp(x): print "okay:",x return None def ouch(x): print "bad:",x return x last = 3 for n in range(0,last): print "dispatching",n d = cq(burp,n).addCallbacks(chirp,ouch) if last-n == 1: d.addCallbacks(shutdown,ouch) if __name__ == '__main__': print "running test1" test1() print "end test1" reactor.run() print "reactor exitted" #=-------------- end ------------=# Running this produces the following: [i386]bviren@aviator:test> ./test-commandqueue.py running test1 dispatching 0 dispatching 1 dispatching 2 end test1 calling burp((0,),{}) okay: 0 callback done calling burp((1,),{}) 1 0 okay: 1 callback done calling burp((2,),{}) 2 0 2 1 okay: 2 Stopping CommandQueue Stopping reactory reactor.stop()'ed callback done drain closing At which point I have to hit Control-C and finally get: reactor exitted Here is the mod to use reactor.callLater(): ... last = 3 for n in range(0,last): print "dispatching",n d = cq(burp,n).addCallbacks(chirp,ouch) #if last-n == 1: # d.addCallbacks(shutdown,ouch) reactor.callLater(10,shutdown) ... So, any ideas as to what I'm doing wrong? Thanks, -Brett. [View Less]

4 7

[Twisted-Python] an alternative to epoll, perhaps? --> libevent
by Jonathan Simms Oct. 24, 2004

Oct. 24, 2004

I was talking with hagbard, who is good friends with the guy who wrote libevent (and is listed in the ssh(1) man page, Niels Provos), and he (hagbard) suggested that it might be useful in writing a reactor. Apparently it provides a portable compatability layer on top of whatever native event-notification system there is. just thought it was worth mentioning. -Jonathan

1 0

[Twisted-Python] ANN: deferred howto/tutorial
by Jonathan Simms Oct. 24, 2004

Oct. 24, 2004

Hello all, I was sitting at Jury Duty today, trying to keep myself from the inevitable thoughts of suicide, and I started thinking about how to implement deferreds in C#. I started out by thinking about the logic one would need to use to implement deferreds in python. I wrote out in my notebook an implementation and when I got back home, I was suprised to discover that I wasn't terribly far off. I reflected upon this, and about what had confused me for so long about deferreds in general. ...… [View More]

7 15

[Twisted-Python] two deferred_tutorial patches
by Lee Harr Oct. 24, 2004

Oct. 24, 2004

The first catches a bit more of the output from deferred_ex3.py which makes a bit more sense: Index: doc/core/howto/tutorial/deferred_tutorial.xhtml =================================================================== --- doc/core/howto/tutorial/deferred_tutorial.xhtml (revision 12146) +++ doc/core/howto/tutorial/deferred_tutorial.xhtml (working copy) @@ -157,6 +157,9 @@ File "./deferred_ex2.py", line 35, in failAtHandlingResult raise RuntimeError, "whoops! we encountered an … [View More]error" exceptions.RuntimeError: whoops! we encountered an error + +callback 3 + got result: okay, continue on </pre> <h2>addBoth: the deferred version of finally</h2> Actually, now that I look at it ... the output in the text is just from the wrong program: Index: doc/core/howto/tutorial/deferred_tutorial.xhtml =================================================================== --- doc/core/howto/tutorial/deferred_tutorial.xhtml (revision 12146) +++ doc/core/howto/tutorial/deferred_tutorial.xhtml (working copy) @@ -147,16 +147,22 @@ <pre> callback 1 got result: success +callback 2 + got result: yay! handleResult was successful! about to raise exception errback we got an exception: Traceback (most recent call last): ---- <exception caught here> --- - File "/home/slyphon/Projects/Twisted/trunk/twisted/internet/defer.py", line -326, in _runCallbacks - self.result = callback(self.result, *args, **kw) - File "./deferred_ex2.py", line 35, in failAtHandlingResult + File "deferred_ex3.py", line 94, in ? + behindTheScenes("success") +--- <exception caught here> --- + File "deferred_ex3.py", line 57, in behindTheScenes + result = failAtHandlingResult(result) + File "deferred_ex3.py", line 34, in failAtHandlingResult raise RuntimeError, "whoops! we encountered an error" exceptions.RuntimeError: whoops! we encountered an error + +callback 3 + got result: okay, continue on </pre> <h2>addBoth: the deferred version of finally</h2> And the second one makes the tutorial look right when loaded from the filesystem. I have a feeling I am supposed to start a webserver or process these files somehow, but this was easier for me... Index: doc/core/howto/tutorial/deferred_tutorial.xhtml =================================================================== --- doc/core/howto/tutorial/deferred_tutorial.xhtml (revision 12146) +++ doc/core/howto/tutorial/deferred_tutorial.xhtml (working copy) @@ -1,6 +1,7 @@ <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML//EN"> <html> <head> <title>Deferreds are beautiful! (A Tutorial)</title> +<link type="text/css" rel="stylesheet" href="../stylesheet.css" /> </head> <body> @@ -27,7 +28,7 @@ First, a simple example so that we have something to talk about: -<a href="../listings/deferred/deferred_ex.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex.py" class="py-listing">deferred_ex.py</a> And the output: (since both methods in the example produce the same output, it will only be shown once.) @@ -56,7 +57,7 @@ returned the deferred needs to alert the callback chain that an error has occurred. -<a href="../listings/deferred/deferred_ex1a.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex1a.py" class="py-listing">deferred_ex1a.py</a> <pre> errback @@ -80,7 +81,7 @@ Now let's see what happens when our callback raises an exception -<a href="../listings/deferred/deferred_ex1b.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex1b.py" class="py-listing">deferred_ex1b.py</a> And the output: (note, tracebacks will be edited slightly to conserve space) @@ -112,7 +113,7 @@ errback in the chain. If the chain is started off with a failure, the first method to be called will be the first errback. -<a href="../listings/deferred/deferred_ex2.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex2.py" class="py-listing">deferred_ex2.py</a> <pre> callback 1 @@ -142,7 +143,7 @@ failure or raise an exception) the chain continues on with the next callback. -<a href="../listings/deferred/deferred_ex3.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex3.py" class="py-listing">deferred_ex3.py</a> <pre> callback 1 @@ -168,7 +169,7 @@ returning the value that it received to allow processing the chain to continue, but appearing transparent in terms of the result. -<a href="../listings/deferred/deferred_ex4.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex4.py" class="py-listing">deferred_ex4.py</a> <pre> callback 1 @@ -205,7 +206,7 @@ addCallback followed by an addErrback. -<a href="../listings/deferred/deferred_ex5.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex5.py" class="py-listing">deferred_ex5.py</a> <pre> callback 1 @@ -227,7 +228,7 @@ processing in response to the error, we would have used a passthru, and returned the failure we received, as we see in this next example: -<a href="../listings/deferred/deferred_ex6.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex6.py" class="py-listing">deferred_ex6.py</a> <pre> callback 1 @@ -258,7 +259,7 @@ beforehand and then executes it, the other executes the chain as it is being constructed. This is because deferreds are stateful. -<a href="../listings/deferred/deferred_ex7.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex7.py" class="py-listing">deferred_ex7.py</a> <pre> callback 1 @@ -309,7 +310,7 @@ processing chain will become the result that gets passed to the next callback of the primary deferreds processing chain -<a href="../listings/deferred/deferred_ex8.py" class="py-listing"></a> +<a href="../listings/deferred/deferred_ex8.py" class="py-listing">deferred_ex8.py</a> <pre> callback 1 Thanks for your time. _________________________________________________________________ Express yourself instantly with MSN Messenger! Download today it's FREE! http://messenger.msn.com/ [View Less]

2 1

[Twisted-Python] twisted webdav server
by donfu Oct. 23, 2004

Oct. 23, 2004

hello twisted I've been lurking on this list of a couple of weeks now while getting accustomed to this wonderful framework, which I plan on using in my phd. project. I searched the archives for a webdav server implementation on top of twisted, and it looks like this is a topic that shows up every 6 months or so. But the only actual code is to be found here: http://article.gmane.org/gmane.comp.python.twisted/6068 It looks a bit half-baked and I'm having trouble in getting it to … [View More]

9 16

Re: [Twisted-Python] twisted webdav server
by Sergio Trejo Oct. 23, 2004

Oct. 23, 2004

I concur -- WebDAV rocks! Serg >From: Thomas Weholt <thomas.weholt(a)gmail.com> >Reply-To: 2002(a)weholt.org,Twisted general discussion ><twisted-python(a)twistedmatrix.com> >To: Twisted general discussion <twisted-python(a)twistedmatrix.com> >Subject: Re: [Twisted-Python] twisted webdav server >Date: Fri, 22 Oct 2004 18:08:36 +0200 > >But hey, keep it going; refactor, re-write, do whatever you want to, >just get webdav into the standard twisted-… [View More]

1 0

[Twisted-Python] Help needed: good async design
by Mary Gardiner Oct. 23, 2004

Oct. 23, 2004

I've just been messing about with the async howto and decided that half of it should be broken out into a "designing libraries for use with Twisted" document. Since I haven't actually done very much of this, help appreciated, including but not limited to pointers to the very best design inside the Twisted codebase, and IRC rants. Grab me during the European daytime or leave a message on issue 504. Thanks, Mary

1 0

[Twisted-Python] Weekly Bug Summary
by James Y Knight Oct. 23, 2004

Oct. 23, 2004

/me looks around innocently. Oh, you mean Oct 11 wasn't last week? Damn. ;) James Bug summary ______________________ Since 2004-10-11 18:03:50.270000: Bugs opened: 11 Bugs closed: 6 Total open bugs: 316 (+5) New / Reopened Bugs ______________________ retrial bugs (6 days ago) CLOSED http://www.twistedmatrix.com/bugs/issue751 opened by exarkun mktap argument and man page (yesterday) http://www.twistedmatrix.com/bugs/issue755 opened by opq mktap arguments (3 days ago) … [View More]

1 0

[Twisted-Python] as a side note...
by stefan Oct. 22, 2004

Oct. 22, 2004

the twisted framework was really a productive environment for me... until I found twisted.Quotes http://svn.twistedmatrix.com/cvs/*checkout*/trunk/doc/fun/ Twisted.Quotes?root=Twisted hilarious :) stefan.

2 1