Mailman 3 March 2005 - Twisted

[Twisted-Python] watch a directory (Win32)
by Henning.Ramm＠mediapro-gmbh.de 08 Mar '05

08 Mar '05

Hello twisted folks! Last week I found this great framework that seems to do most of what I need. But it's a bit hard to get into, as you know... I'm on WinXP with Python 2.3. I need to watch a directory for new files and found this recipe using Win32 events: http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/156178 I'd like to use a twisted reactor instead of that while loop, but don't understand how to handle those Win32 notifies using deferreds. Or perhaps there is a better twisted solution, that I didn't find in the docs? I'd prefer a portable way (my script could also run on AIX or MacOS X), but as far as I found, it's heavily system dependent (Win32: win32file.FindFirstChangeNotification, BSD/OSX: kqueue?, Linux: dnotify?) Best regards, Henning Hraban Ramm Südkurier Medienhaus / MediaPro Support/Admin/Development Dept.

3 3

[Twisted-Python] Daemonize
by Dan 08 Mar '05

08 Mar '05

There are lots of nice examples in the Twisted documentation on how to write a server but I can't seem to find anywhere that making it daemonize is mentioned. All the examples hold onto the terminal after reactor.run() is called. If I want a Twisted server to return the terminal and run as a daemon how would I accomplish that aside from starting it with nohup? Thanks! Dan

2 1

RE: [Twisted-Python] process directory or alike in Twisted?
by Jeff.Silver＠edl.uk.eds.com 07 Mar '05

07 Mar '05

> I want the application to be divided into processes, > each dealing with a specific aspect of the > application; some in a central server and some in > arbitrary machines in a local network. I'll use the > Perspective Broker protocol for communication, but I > want each process to know the addresses of all the > others and be able to communicate with the others > without prior knowledge of their location. How is it > usual to do such a thing? I suggest you look at Zeroconf, and read the current thread: Anyone have any code or links to code related to using ZeroConf / Rendezous with Twisted? I think that Zeroconf has the sort of capability you're after. The bad news is that it is not (yet?) in twisted. Hence the thread. Jeff.

1 0

[Twisted-Python] process directory or alike in Twisted?
by Joachim Boomberschloss 06 Mar '05

06 Mar '05

I am thinking about using twisted as the framework of my distributed application, and I have some questions about it. I want the application to be divided into processes, each dealing with a specific aspect of the application; some in a central server and some in arbitrary machines in a local network. I�ll use the Perspective Broker protocol for communication, but I want each process to know the addresses of all the others and be able to communicate with the others without prior knowledge of their location. How is it usual to do such a thing? I thought of a central server holding the addresses of processes, such that each process registers its details at start-up, and gets notified when there are changes in the list of processes (similarly to the Pyro name server). To detect the location of the central server I suppose a broadcast mechanism should be used, although I don�t know what a broadcast mechanism is exactly and whether it is supported by Twisted or not. Is there anything like this already implemented in Twisted? Thanks, Joe. __________________________________ Celebrate Yahoo!'s 10th Birthday! Yahoo! Netrospective: 100 Moments of the Web http://birthday.yahoo.com/netrospective/

1 0

[Twisted-Python] Anyone have any code or links to code related to using ZeroConf / Rendezous with Twisted?
by jarrod roberson 05 Mar '05

05 Mar '05

What I have found on google is lots of talk no implemenation, and the little implementation that is talked about is a dead link :-( I wanted to make sure I was not re-inventing the wheel before I start on this myself.

6 6

[Twisted-Python] Weekly Bug Summary
by James Y Knight 05 Mar '05

05 Mar '05

Bug summary ______________________ Since 2005-02-26 07:36:08.640000: Bugs opened: 12 Bugs closed: 17 Total open bugs: 334 (-5) Urgent: 7 (+0) Bug: 131 (-5) Feature: 129 (+1) Wish: 67 (-1) New / Reopened Bugs ______________________ ==== Urgent ==== plugins.tml doesn't work with split up packages (5 days ago) http://twistedmatrix.com/bugs/issue906 opened by exarkun [CORE] [PATCH] pollreactor fails to cleanup client sockets properly (5 days ago) CLOSED http://twistedmatrix.com/bugs/issue907 opened by spiv ==== Bug ==== [PATCH] fix twisted.words.protocols.jabber.jid to add stringprep (2 days ago) http://twistedmatrix.com/bugs/issue912 opened by ralphm [PATCH] rename xish.xpath's intern to internQuery (yesterday) http://twistedmatrix.com/bugs/issue913 opened by ralphm microdom getElementsByTagName (4 days ago) http://twistedmatrix.com/bugs/issue909 opened by int [TRIAL] Trial --tbformat=emacs now shows plain-style tracebacks (3 months ago) http://twistedmatrix.com/bugs/issue783 opened by radix [CORE] [PATCH] make LoopingCall.stop() stop the loop immediately (3 days ago) http://twistedmatrix.com/bugs/issue911 opened by zooko MSN File Transfer (4 days ago) http://twistedmatrix.com/bugs/issue908 opened by cphsu [CONCH] No ProtocolWrapper defined in twisted/conch/ssh/session.py (5 days ago) http://twistedmatrix.com/bugs/issue905 opened by spiv [CONCH] _scanDirectory broken (5 days ago) http://twistedmatrix.com/bugs/issue904 opened by spiv [TRIAL] Control-C in trial sometimes doesn't stop it. (9 months ago) http://twistedmatrix.com/bugs/issue628 opened by jknight ==== Feature ==== [CORE] [PATCH] weak tasks (3 days ago) http://twistedmatrix.com/bugs/issue910 opened by zooko Bugs Closed ______________________ ==== Urgent ==== [CORE] [PATCH] pollreactor fails to cleanup client sockets properly (5 days ago) http://twistedmatrix.com/bugs/issue907 opened by spiv, closed by spiv [TRIAL] Trial timeout handling is totally broken, won't accept even the default value (1 month ago) http://twistedmatrix.com/bugs/issue866 opened by Tv, closed by jknight ==== Bug ==== [XISH] twisted.xish.domish.ExpatElementStream tries to pop empty namespace stack (6 months ago) http://twistedmatrix.com/bugs/issue673 opened by horatio, closed by ralphm [XISH] [PATCH] xish.domish chokes on namespaced attributes (12 months ago) http://twistedmatrix.com/bugs/issue535 opened by ssweens, closed by ralphm [XISH] [PATCH] Jabber xmlstream parse bug (with patch and unit test) (6 months ago) http://twistedmatrix.com/bugs/issue701 opened by delx, closed by spiv [PB] datetime support in jelly/unjelly (2 weeks ago) http://twistedmatrix.com/bugs/issue894 opened by kkinder, closed by glyph [TRIAL] Intermittent twisted.trial.test.test_util.TestMktemp failure (3 months ago) http://twistedmatrix.com/bugs/issue799 opened by exarkun, closed by exarkun [CORE, TRIAL] Undesirable ValueError exception masking by namedAny() (2 months ago) http://twistedmatrix.com/bugs/issue808 opened by exarkun, closed by exarkun testCyclicAliases in t.mail.test_mail is weird (2 months ago) http://twistedmatrix.com/bugs/issue810 opened by marienz, closed by exarkun [WEBSITE] Website still refers to copyright assignment (1 week ago) http://twistedmatrix.com/bugs/issue903 opened by hypatia, closed by hypatia [TRIAL] [not a bug] trial --until-failure does not stop on cleanup errors (1 week ago) http://twistedmatrix.com/bugs/issue901 opened by spiv, closed by spiv [NEWS] [PATCH]twisted.protocols.nntp is broken (19 months ago) http://twistedmatrix.com/bugs/issue65 opened by smurf, closed by exarkun [MAIL] [PATCH] twisted.mail.smtp.SMTP fails on whitespace preceeding a client command. (1 month ago) http://twistedmatrix.com/bugs/issue865 opened by dw, closed by exarkun [CORE] socket is not closed when connection failed (2 weeks ago) http://twistedmatrix.com/bugs/issue895 opened by maoy, closed by exarkun manhole tests don't deal well with failure and are cwd-sensitive (1 month ago) http://twistedmatrix.com/bugs/issue878 opened by jknight, closed by exarkun [TRIAL] "trial --until-failure --debug" totally broken (2 months ago) http://twistedmatrix.com/bugs/issue834 opened by exarkun, closed by jknight ==== Wish ==== [NAMES] [PATCH] t.names shouldn't depend on t.flow (1 week ago) http://twistedmatrix.com/bugs/issue902 opened by marienz, closed by jknight

1 0

[Twisted-Python] PB Error (printing exceptions in deferreds)
by Mustafa Sakalsiz 04 Mar '05

04 Mar '05

Hi all, I am trying to develop an application with twisted and using Pb. I have a trouble that I couldn't fix. I tried googling to find an solution, but didn't find an exact answer. The problem is "I don't want exceptions be printed in server side". The solution already exists in Pb, if I raise an exception derived from pb.Error in a (view, execute, ...) method. However, if I raise the same exception in a deferred or callback function, the exception is printed. Here is an example, server.py : Works as I expect server2.py : Prints the exceptions, which I don't want client.py : Catches the exception in both ways Is there a solution which works in any way to avoid printing for specific exceptions. Best regards, Musti ============== server.py (works well)============ #! /usr/bin/python from twisted.spread import pb from twisted.internet import reactor class MyError(pb.Error): pass class One(pb.Root): def remote_broken(self): msg = "fall down go boom" raise MyError(msg) def main(): reactor.listenTCP(8800, pb.PBServerFactory(One())) reactor.run() if __name__ == '__main__': main() ======================================= =========== server2.py (prints exceptions)============ #! /usr/bin/python from twisted.spread import pb from twisted.internet import reactor from twisted.internet import defer class MyError(pb.Error): pass class One(pb.Root): def badFoo(self, result): msg = "fall down go boom" raise MyError(msg) def remote_broken(self): d = defer.Deferred() d.addCallback(self.badFoo) d.callback(0) return d def main(): reactor.listenTCP(8800, pb.PBServerFactory(One())) reactor.run() if __name__ == '__main__': main() ========================================== === client.py (works same for both server and server2)======= #! /usr/bin/python from twisted.spread import pb from twisted.internet import reactor def main(): factory = pb.PBClientFactory() reactor.connectTCP("localhost", 8800, factory) d = factory.getRootObject() d.addCallbacks(got_obj) reactor.run() def got_obj(obj): # change "broken" into "broken2" to demonstrate an unhandled exception d2 = obj.callRemote("broken") d2.addCallback(working) d2.addErrback(broken) def working(): print "erm, it wasn't *supposed* to work.." def broken(reason): print "got remote Exception" print " .type =", reason.type reactor.stop() main() =============================================

1 0

RE: [Twisted-Python] Twisted, Threading, Extension Modules and th e GIL
by Grant McDonald 03 Mar '05

03 Mar '05

I just realised after re-reading my post that the call to deferToThread should have been: d = threads.deferToThread(self.builder.newbuild, buildJob) d.addCallback(self.builderFinished) How silly of me, i'll test it now and see if there are still problems! -----Original Message----- From: twisted-python-bounces(a)twistedmatrix.com [mailto:twisted-python-bounces@twistedmatrix.com]On Behalf Of Grant McDonald Sent: 04 March 2005 09:20 To: twisted-python(a)twistedmatrix.com Subject: [Twisted-Python] Twisted, Threading, Extension Modules and the GIL Hi everyone, I have a threading question regarding Twisted and the explanation is a bit long-winded but please bear with me. The scenario: I have created an automated build system in Python for PowerBuilder (awful language) that allows a scheduler to assign build jobs to dispatcher programs across a network. These dispatchers have a GUI component coded in wxPython. The initial implementation involved also creating a separate builder program that was spawned by the dispatchers when a build job was received. The builder code called an extension module to interface with the low-level PowerBuilder compiler library. This was done due to the fact the calls to rebuild the application and deploy it are exceptionally CPU-intensive and don't return for many minutes (approx. 30 or so for a large application) and all attempts to include this in the dispatcher resulted in the user interface freezing. Recently I came across twisted documentation with regards to programming using twisted threads. As an experiment on this concept I amalgamated the dispatcher and builder programs and called the builder code using the following: d = threads.deferToThread(self.builder.newbuild(buildJob)) d.addCallback(self.builderFinished) It should be noted that the extension module (a pyrex extension I have created myself) implements the releasing and re-acquiring of the Global Interpreter Lock for all blocking calls. From my understanding this should work but the user interface freezes. Can someone please point me in the direction of a solution? Thanks, Grant McDonald Important notice: This message is intended for the individual(s) and entity(s) addressed. The information contained in this transmission and any attached, may be confidential and may also be the subject of legal privilege, public interest immunity or legal professional privilege. Any review, retransmission, dissemination or other use of, taking of any action in reliance upon this information by person or entities other than the recipient is prohibited and requires authorization from the sender. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person) you may not copy or deliver this message to anyone. In such cases you should destroy this message and kindly notify the sender by reply email. WARNING: Although Infocomp has taken reasonable precautions so that no viruses are present in this e-mail, the company cannot accept responsibility for any loss or damage arising from the use of e-mail attachments.

1 0

[Twisted-Python] Twisted, Threading, Extension Modules and the GIL
by Grant McDonald 03 Mar '05

03 Mar '05

Hi everyone, I have a threading question regarding Twisted and the explanation is a bit long-winded but please bear with me. The scenario: I have created an automated build system in Python for PowerBuilder (awful language) that allows a scheduler to assign build jobs to dispatcher programs across a network. These dispatchers have a GUI component coded in wxPython. The initial implementation involved also creating a separate builder program that was spawned by the dispatchers when a build job was received. The builder code called an extension module to interface with the low-level PowerBuilder compiler library. This was done due to the fact the calls to rebuild the application and deploy it are exceptionally CPU-intensive and don't return for many minutes (approx. 30 or so for a large application) and all attempts to include this in the dispatcher resulted in the user interface freezing. Recently I came across twisted documentation with regards to programming using twisted threads. As an experiment on this concept I amalgamated the dispatcher and builder programs and called the builder code using the following: d = threads.deferToThread(self.builder.newbuild(buildJob)) d.addCallback(self.builderFinished) It should be noted that the extension module (a pyrex extension I have created myself) implements the releasing and re-acquiring of the Global Interpreter Lock for all blocking calls. From my understanding this should work but the user interface freezes. Can someone please point me in the direction of a solution? Thanks, Grant McDonald

1 0

[Twisted-Python] anyone interested in helping work on a UPnP server?
by Anthony Baxter 03 Mar '05

03 Mar '05

Hey there, I want to look at extending shtoom's UPnP support to create a UPnP server for Linux &c. I can do the work for the UPnP side, but I'm not particularly clear on the commands needed to insert the relevant ipchains or whatever rules. If you're up on this stuff, and want to help out, drop me an email. Thanks, Anthony -- Anthony Baxter <anthony(a)interlink.com.au> It's never too late to have a happy childhood.

1 0

Twisted March 2005