Mailman 3 March 2004 - Twisted

[Twisted-Python] JellyToNode and boolean types
by Graham Clinch March 23, 2004

March 23, 2004

I've just started having problems with JellyToNode dying on boolean types (Bug tracker issue 363), but it doesn't seem to have moved along much recently, even though there is a seemingly accepted patch; are there any plans to apply the patch? Thanks, Graham

1 0

Re: [Twisted-Python] Threading examples...
by William McLendon March 23, 2004

March 23, 2004

Thanks, So, now my example looks like this: import time from twisted.internet import reactor def aSillyBlockingMethod(x): time.sleep(2) print x reactor.callFromThread(reactor.stop) # run method in thread reactor.callInThread(aSillyBlockingMethod, "2 seconds have passed") It still just hangs... I have to go kill it from another window after getting its pid from ps. Am I doing the reactor.stop thing correctly? Basically, I have an application that talks via a http interface to a user and I need to spawn off and do stuff from time to time. I'm still learning how all the reactor eventloops and whatnot work. I ran into a problem where I'm trying to run something via twisted.internet.protocol.ProcessProtocol and serve its results up from within a reactor.listentTCP() page handler ... but it blew up. So, I'm thinking that I could maybe just fork it off and run that way. I've been trying to figure out how the reactors() work and the threading and whatnot the last few days but am kind of finding little help in the docs and google that is at my level of understanding... seems most of the stuff is snippets and pieces that assume you already see the big picture :-( Any help here is greatly appreciated ;-) Thanks, -William >From: Andrew Bennetts <andrew-twisted(a)puzzling.org> >Reply-To: twisted-python(a)twistedmatrix.com >To: twisted-python(a)twistedmatrix.com >Subject: Re: [Twisted-Python] Threading examples... >Date: Wed, 24 Mar 2004 09:30:13 +1100 > >On Tue, Mar 23, 2004 at 12:19:01PM -0700, William McLendon wrote: > > Hi, > > > > I'm trying out some of the threading examples from the web and am >getting > > some a lockup at the end. > > > > Here's the code I'm playing with, I pulled it straight from the >examples: > > > > (source: > > http://twisted.sourceforge.net/TwistedDocs-1.2.0/howto/threading.html) > > > > > > #!/usr/bin/env python > > import time > > from twisted.internet import reactor > > > > def aSillyBlockingMethod(x): > > import time > > time.sleep(2) > > print x > > > > # run method in thread > > reactor.callInThread(aSillyBlockingMethod, "2 seconds have passed") > >This example doesn't call to reactor.stop(), so it never stops. Put a call >to "reactor.callFromThread(reactor.stop)" after the print statement, for >example, and it should shutdown cleanly. > > > Is there something I need to do that will make the thread go away? Are > > there some more examples of threading in Twisted-Python available? > >The only example I can think of is the implementation of >twisted.enterprise.adbapi, which presents an asynchronous interface to >blocking DB-API modules by running it in threads. > >-Andrew. > > >_______________________________________________ >Twisted-Python mailing list >Twisted-Python(a)twistedmatrix.com >http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python _________________________________________________________________ Is your PC infected? Get a FREE online computer virus scan from McAfee® Security. http://clinic.mcafee.com/clinic/ibuy/campaign.asp?cid=3963

2 1

Re: [Twisted-Python] Threading examples...
by William McLendon March 23, 2004

March 23, 2004

Hmmm... I tried something pretty close to that (though I have no callback called writeRequestAndFinish() in my example and am not sure what it's supposed to do)... but running the threads.deferToThread() routine still leaves me with the problem that the thread doesn't die. I can't kill the app without going and manually killing it via pid. Is there anything that I can do so that when aSillyBlockingMethod() is finished it just exits? Thanks, -William >From: stephan <mailinglists(a)shechen.at> >Reply-To: twisted-python(a)twistedmatrix.com >To: twisted-python(a)twistedmatrix.com >Subject: Re: [Twisted-Python] Threading examples... >Date: Tue, 23 Mar 2004 14:25:13 -0800 > >The following snippet is the code I use and it works for my needs. Be >careful with non-threadsafe code (db api, etc...) though. > >========== >from twisted.internet import threads > >threads.deferToThread(aSillyBlockingMethod, x).addCallback(\ > writeRequestAndFinish, request) >========= > >I am using this in a twisted webserver that is why I am registering the >writeRequestAndFinish methode to finish up on the render methode where I >returned server.NOT_DONE_YET. But you can register any callback or no >callback as well. > >_stephan > > >On Tue, 23 Mar 2004 12:19:01 -0700, William McLendon <wcmclen(a)hotmail.com> >wrote: > >>Hi, >> >>I'm trying out some of the threading examples from the web and am getting >>some a lockup at the end. >> >>Here's the code I'm playing with, I pulled it straight from the examples: >> >>(source: >>http://twisted.sourceforge.net/TwistedDocs-1.2.0/howto/threading.html) >> >> >>#!/usr/bin/env python >>import time >>from twisted.internet import reactor >> >>def aSillyBlockingMethod(x): >> import time >> time.sleep(2) >> print x >> >># run method in thread >>reactor.callInThread(aSillyBlockingMethod, "2 seconds have passed") >> >> >>Is there something I need to do that will make the thread go away? Are >>there some more examples of threading in Twisted-Python available? >> >>Thanks, >> -William _________________________________________________________________ Get rid of annoying pop-up ads with the new MSN Toolbar FREE! http://clk.atdmt.com/AVE/go/onm00200414ave/direct/01/

1 0

[Twisted-Python] Threading examples...
by William McLendon March 23, 2004

March 23, 2004

Hi, I'm trying out some of the threading examples from the web and am getting some a lockup at the end. Here's the code I'm playing with, I pulled it straight from the examples: (source: http://twisted.sourceforge.net/TwistedDocs-1.2.0/howto/threading.html) #!/usr/bin/env python import time from twisted.internet import reactor def aSillyBlockingMethod(x): import time time.sleep(2) print x # run method in thread reactor.callInThread(aSillyBlockingMethod, "2 seconds have passed") Is there something I need to do that will make the thread go away? Are there some more examples of threading in Twisted-Python available? Thanks, -William _________________________________________________________________ Is your PC infected? Get a FREE online computer virus scan from McAfee® Security. http://clinic.mcafee.com/clinic/ibuy/campaign.asp?cid=3963

3 2

[Twisted-Python] Isolating ISFTPServer in Conch's SFTP
by Andy Gayton March 23, 2004

March 23, 2004

I'm looking to create a filesystem backend for twisted that could be used by any filelike twisted application (sftp, webdav etc). I've got a proof of concept filesystem interface working - IFileSystem .. not the best of names ;), which I'm about to try and sftp into. ISFTPServer is a nice clean interface which it'd be easy to write an adapter for from my IFileSystem - but its implementation is bolted into FileTransferServer along with a bunch of protocol stuff .. I had been vaguely planning to break ISFTPServer's implementation out of FileTransferServer and move it into a realm avatar when I got this far so different users could have different filesystems but now that I get to looking at it - FileTransferServer is brought into existance when a sftp sybsystem is requested by the sftp client, which happens after authentication .. It's beginning to look like most of conch/ssh/session.py would need to move into an avatar - so the avatar for a given user could be asked for a shell, or a sftp subsystem and they would get the right shell/ sftp onto a filesystem for that user .. I was hoping that Paul, or someone else may have some thoughts in this area to guide me .. cheers, Andy.

3 6

[Twisted-Python] Re: [Twisted-commits] r10342 - fix #537, #414 (microdom no longer swallows whitespace, so it's probably much slower)
by Andrew Bennetts March 22, 2004

March 22, 2004

On Mon, Mar 22, 2004 at 04:33:59PM -0700, Itamar Shtull-Trauring wrote: > Author: itamarst > Date: Mon Mar 22 16:33:58 2004 > New Revision: 10342 > > Modified: > trunk/twisted/protocols/sux.py > trunk/twisted/test/test_xml.py > trunk/twisted/web/microdom.py > Log: > fix #537, #414 (microdom no longer swallows whitespace, so it's probably much slower) And it also appears to have broken tests, according to buildbot. I suspect some of the tests were checking for broken behaviour, but they really should be fixed. -Andrew.

2 2

Re: [Twisted-Python] Cisco-style hierarchial CLI
by exarkun＠divmod.com March 22, 2004

March 22, 2004

On Sat, 20 Mar 2004 18:43:36 +0000, Phil Mayers <p.mayers(a)imperial.ac.uk> wrote: >All, > > I'm putting together some glue-ware for a system, and would like to hide > the underlying nature of it. It's a bit of software that fits in and > around routers / switches etc. and there's a pretty common CLI for those > these days, which consists of a hierarchial context-based set of > commands, plus completion, e.g. on Cisco, although I suspect everyone is > familiar with the concept: > > [snip examples] > > The hiearchial configure mode is mapped onto a hierarchial configuration > file, e.g. the above would generate: > > subsystem > trusted > vlan 1 > ! > ! > > It's main features are: > > 1) Tab completion and partial -> full conversion > 2) Nested modes > > Relevant to twisted is I want to replace the manhole interactive > interpreter. > > Any such beast exist? twisted.python.usage has some support for subcommands. It doesn't support arbitrary abbreviations (if I recall correctly), but could probably be made to without much difficulty. Tab completion would have to be offered by whatever UI was presented, of course, and facilitated by some easily-done introspection into the Options class. t.p.usage.Options instances set their "subOptions" attribute when a sub-command is encountered. I think you could exploit this fact to support nested states, by grabbing the subOptions object and asking it to parse further input. I'm not sure how "backing up" should work, but you could probably accomplish it by keeping a stack of all the options classes that you get from the subOptions attribute. Of course it supports arbitrarily deep nesting, so multilevel commands are support. The API is pretty simple, you just create an Options subclass with a subCommands class attribute bound to a list of lists of the form ["longname", "shortname", OtherOptionsSubclass, "Description"]. The existing code won't get you all the way there (especially the help formatting), but it seems like a reasonable place to start. Jp

2 1

[Twisted-Python] Carnivore Warning: This message contains subversive content.
by Christopher Armstrong March 22, 2004

March 22, 2004

We're probably going to be switching the Twisted code repository to Subversion during the PyCon sprints (some time between saturday and tuesday). There will be a short period during conversion when neither CVS nor SVN will be accessible. I'm going to disable the CVS repository so nobody can commit while I'm converting it, run cvs2svn on it, and create a new repository at /svn/Twisted. I might not convert tags and branches from the CVS repo to their SVN counterparts; last time I tried with a test-run it seemed to either take an incredibly long time or it was stuck, and I cancelled it. However, that's not too big of a deal; the old CVS repository will still be accessible read-only, so people will still be able to check out old tags and branches. Of course all old *revisions* will be converted to the SVN repository. After this I'll be working on updating our release scripts and all info that references the CVS server. The SVN repository will be accessible from the web (and, in fact, our other SVN projects are already accessible) at http://cvs.twistedmatrix.com/cvs/. People with write access will use the SVN URL svn+ssh://user@cvs.twistedmatrix.com/svn/Twisted. The twisted-commits list will continue working. I still need to figure out what to do about IRC notification of commits. I might set up a CIA[1] server, or just use their central server. I wrote SVN support for buildbot a while ago, so I'll get it set up so our SVN commits trigger our buildbot[2]. Did I forget anything? 1: http://cia.navi.cx/ 2: http://twistedmatrix.com/buildbot/ -- Twisted | Christopher Armstrong: International Man of Twistery Radix | Release Manager, Twisted Project ---------+ http://radix.twistedmatrix.com/

7 9

[Twisted-Python] Cisco-style hierarchial CLI
by Phil Mayers March 22, 2004

March 22, 2004

All, I'm putting together some glue-ware for a system, and would like to hide the underlying nature of it. It's a bit of software that fits in and around routers / switches etc. and there's a pretty common CLI for those these days, which consists of a hierarchial context-based set of commands, plus completion, e.g. on Cisco, although I suspect everyone is familiar with the concept: client: sh <question mark> server: ip - show IP items server: foo - show Foo items server: bar - show Bar items client: sh f <question mark> server: ver - show foo version server: connections - show foo connections client: sh f c <question mark> server: <cr> - show connection summary server: <int> - show connection detail client: sh f c 3 server: <some stuff> Similarly, for configure mode: client: configure server: ok client: subsystem server(subsystem): ok client: <question mark> server(subsystem): trusted - configure trusted ports server(subsystem): untrusted - configure untrusted ports server(subsystem): map - map from trusted to untrusted client: trust server(subsystem-trusted): ok client: <question mark> server(subsystem-trusted): ip - add a trusted port by IP server(subsystem-trusted): phys - add a trusted physical port server(subsystem-trusted): vlan - add a trusted vlan client: vlan 1 The hiearchial configure mode is mapped onto a hierarchial configuration file, e.g. the above would generate: subsystem trusted vlan 1 ! ! It's main features are: 1) Tab completion and partial -> full conversion 2) Nested modes Relevant to twisted is I want to replace the manhole interactive interpreter. Any such beast exist? -- Regards, Phil +------------------------------------------+ | Phil Mayers | | Network & Infrastructure Group | | Information & Communication Technologies | | Imperial College | +------------------------------------------+

2 1

[Twisted-Python] Re: Thanks :)
by stephen＠thorne.id.au March 22, 2004

March 22, 2004

2 1