Mailman 3 March 2003 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz Aug. 5, 2021

Aug. 5, 2021

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |… [View More]

4 5

[Twisted-Python] documentation issue?
by rprice＠collegenet.com April 27, 2003

April 27, 2003

Hi, I am working my way through "The Twisted Documentation" Jan 29, 2003 and found a problem with an example (or with me). At http://twistedmatrix.com/documents/howto/plugin it says: % mktap qotd Saving qotd application to qotd.tap... Saved. % twistd -f qotd.tap % nc localhost 8007 An apple a day keeps the doctor away. % kill `cat twistd.pid` The problem is when I run 'mktap qotd' I get the following error: Unknown command: qotd and then it prints the usage and options help. I am using … [View More]

3 3

[Twisted-Python] t.i.process uid/gid suckiness
by Tommi Virtanen April 23, 2003

April 23, 2003

The handling of uid/gid changes and SIGCHLD all around twisted are in an appalling state. I've tried to bitch at the right people, but that hasn't helped, so I'm taking the more heavyhanded approach of just fixing stuff. Let the code talk. However, I still don't consider myself an authority on what Twisted should do, don't have that much time longer term (I will not maintain this code permanently), and don't know what silly limitations the windows port of python has. So, I'll try to … [View More]write down what changes I'm planning on doing, so you have a chance of vetoing. If I get no comments, I'll just basically go ahead and commit what I happen to want to, touching a many areas of mktap/t.i.process/procmon/whatever. If you want to avoid a de facto hijack-fix-abandon process, TALK NOW 0) make the t.i.process setuid/setgid code actually work (see patch; BTW is the initgroups part really needed? I feel my pure-python 6-liner does the same thing.) 1) make all places that take uid/gid just silently take in strings, too, and use pwd/grp to convert them to uids and gids as necessary 2) make .taps store uids and gids as strings 3) defer procmon startup so the processes are forked only after setuid has happened. 4) try to fix the child process races, atleast including deferring signal-triggered processing to happen outside the actual signal handler, rewriting the reap logic silliness, and stopping procmon from trying to kill reaped children. 5) fix whatever problems I noticed while fixing the above 6) whatever else I feel like improving at the time 7) ??? 8) profit! diff -u -u -r1.50 process.py --- twisted/internet/process.py 10 Mar 2003 20:16:57 -0000 1.50 +++ twisted/internet/process.py 11 Mar 2003 13:08:00 -0000 @@ -33,10 +33,25 @@ pty = None try: - from initgroups import initgroups import pwd + try: + from initgroups import initgroups + except: + import grp + def initgroups(username, dummy): + l=[] + for groupname, password, gid, userlist in grp.getgrall(): + if username in userlist: + l.append(gid) + os.setgroups(l) + def switch_uid(uid, gid): + os.setgid(gid) + initgroups(pwd.getpwuid(uid)[0], gid) + os.setuid(uid) except: - def initgroups(*args): pass + def switch_uid(uid, gid): + os.setgid(gid) + os.setuid(uid) from twisted.persisted import styles from twisted.python import log, failure @@ -229,9 +244,7 @@ os.chdir(path) # set the UID before I actually exec the process if settingUID: - os.setgid(gid) - initgroups(pwd.getpwuid(uid)[0], gid) - os.setuid(uid) + switch_uid(uid, gid) os.execvpe(command, args, environment) except: # If there are errors, bail and try to write something @@ -482,9 +495,7 @@ # set the UID before I actually exec the process if settingUID: - os.setgid(gid) - initgroups(pwd.getpwuid(uid)[0], gid) - os.setuid(uid) + switch_uid(uid, gid) os.execvpe(command, args, environment) except: stderr = os.fdopen(1, 'w') -- :(){ :|:&};: [View Less]

5 7

[Twisted-Python] Lore vs. latex2html: Fight to the Finish
by Moshe Zadka April 22, 2003

April 22, 2003

Dear Twisted developers, I have started converting Thinking Like a Computer Scientist in Python to Lore, to try and see what Lore is missing. It has been a most education experience. The two prime things Lore is currently missing for lossless conversion (of the specific chapter I tested) are: * EPS images support * Indexing support However, beyond that, I am interested to know which looks better: latex2html: http://www.ibiblio.org/obp/thinkCSpy/chap01.htm Lore: http://twistedmatrix.com/… [View More]

4 3

[Twisted-Python] flow - a state-machine consumer
by Clark C. Evans April 9, 2003

April 9, 2003

After being convinced on IRC that my use cases arn't what Deferred is meant to solve, Donovan "wzZzy" and I put together a first pass at a more granular 'consumer'. I'm now using it to build some fairly complicated web pages from a database, and may find its way into Woven (although perhaps not in its current form). Anyway, the tool includes: 0. the Flow dispatcher, which is a reactor like mechanism driving events. 1. a mechanism to execute a function in a thread, where the … [View More]

3 3

[Twisted-Python] How do I upload files using FTPClient?
by Daniel Burr April 9, 2003

April 9, 2003

I am currently designing a code-deploying service, to be used in conjunction with a variety of source control tools. I'm looking to use Twisted in the implementation of the file-transfer mechanism, as Twisted's broad protocol support would make it easy for me to switch from say, FTP to HTTP, or to some custom protocol I roll myself. I've experimented with twisted.protocols.ftp.FTPClient, and the one thing I can't seem to grok is how to perform file uploads. I've read through the code, and it … [View More]

2 3

[Twisted-Python] more thoughts on resumable async data flows
by Clark C. Evans April 8, 2003

April 8, 2003

Howdy. I've made quite a few changes to flow.py and it's quickly approaching maturity. To summarize, flow.py is a way to express sequential, streaming data flows that are interruptable as a collection of small, atomic operations. This is needed since sometimes an operation must block, flow.py takes care of resuming your flow at a later time. It's trivial, but here is an example... def printResult(data): print data def addOne(data): return data+1 def finished(): print "… [View More]finished" def dataSource(data): return [1, 1+data, 1+data*2] a = Flow() a.addBranch(dataSource, finished) a.addCallable(addOne) a.addCallable(printResult) a.execute(2) a.execute(8) The above code constructs a flow, starting with a 'branch' operation that generates a series of events, in this case, the lists [1,3,5] and then in a second execution, [1,9,17]. For each one of these events, a function addOne is called on them, and then the output of that function is directed to be printed. This mechanism works with generators... def simpleGenerator(data): for x in range(data): yield x b = Flow() b.addBranch(simpleGenerator) b.addCallable(printResult) b.execute(5) While this may not be all that useful, what Flow brings to the table is the ability to PauseFlow within a processing stage, for example class simpleIterator: def __init__(self, data): self.data = data def __iter__(self): return self def next(self): print "." if self.data < 0: raise StopIteration ret = self.data self.data -= 1 # # imagine a blocking operation here... sometime if ret % 2: raise PauseFlow # <= Goes to main event loop return ret c = Flow() c.addBranch(simpleIterator) c.addCallable(printResult) c.execute(5) The above code produces 4, 2, 0 ; while this may not be all that interesting, if there were N stages above this code, they would all be resumed properly. By tossing PauseFlow, the entire Flow event loop is stopped, and a reactor.callLater(0, loop-again) is called; giving other events in the queue to work. Thus, the flow construct provides a way to not only manage a bunch of useful code snippets into a process; but more importantly gives a way that the entire flow can be interruped and then resumed later when data arrives. Anyway, it's in the sandbox if anyone wants to play... Clark P.S. Unfortunately, it looks like PauseFlow doesn't work in the context of a generator... pity. Hopefully I'm doing something wrong. [View Less]

3 8

[Twisted-Python] Problems with PB and Jelly...
by Jasper Phillips April 4, 2003

April 4, 2003

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I'm new to twisted, and attempting to use it for networkable gaming; unfortunately I've run into some problems. I have a Perspective <-> Referenceable server/client setup, and am trying to pass objects between them. Following the online docs I've set all the relavent classes to inherit from pb.Copyable + pb.RemoteCopy, and passed them all to pb.setUnjellyableForClass. However, I still get "Module not allowed" exceptions raised in twisted.… [View More]

5 12

[Twisted-Python] wxPython and Twisted event loops
by Uwe C. Schroeder April 3, 2003

April 3, 2003

Hi, for those interested, I just posted a recipe on the activestate.com python cookbook about how to get wxPython running with Twisted withoud having blocked menu's and modal dialogs. It's a simple and dirty hack, but it's working on linux and win (basically all systems using the default select reactor) enjoy UC -- Open Source Solutions 4U, LLC 2570 Fleetwood Drive Phone: +1 650 872 2425 San Bruno, CA 94066 Cell: +1 650 302 2405 United States Fax: +1 650 872 2417

3 3

[Twisted-Python] win32guireactor
by Thomas Heller April 2, 2003

April 2, 2003

Here's my win32guireactor code, which at least for me, works better than win32eventreactor in my application. I have some problems in my app when using win32eventreactor: If the app displays a message box, no callLater calls are done (because a win32 messagebox has it's own event loop, and doIteration() is not called during this time. There are also other things that the user can do which shows the same behaviour, dragging a scrollbar for example. The second problem is that … [View More]

2 2