Mailman 3 April 2007 - Twisted

[Twisted-Python] twisted pysnmp status
by Brendan Simon 19 Apr '07

19 Apr '07

Hi, I just wanted to know what the latest status is with twisted and pysnmp. Is pysnmp 4.x supported? Is full SNMPv3 supported? What is the roadmap and/or plans for twisted and pysnmp ??? I want to write and SNMPv3 GUI manager in python :) I'm not sure if the complexity and dependency of twisted is worth the effort? Then again on the other hand it may provide lots of things I would probably need to write anyway ? Given I would also like SSH and maybe even WBEM and/or WS-Management protocols too, then maybe twisted provides a better framework ??? Cheers, Brendan.

4 7

[Twisted-Python] SSL and Perspective Broker - 3rd attempt
by Alex Couper 19 Apr '07

19 Apr '07

##Sorry about that, I had some rich text formatting in the first two messages:## Attached are three files: a server, a client and a ssl certificate Thanks to twisteds remote calls, I can successfully call functions on the server from the client (or send objects if I need to). Fantastic What I can't seem to do, is get the SSL to secure the server from a non-authorised client (one that has access to stunnel.pem). So that if the client does not have the correct certificate it cannot connect to the server. What am I doing wrong? I have adapted some code found here for this example: http://www.lothar.com/tech/papers/PyCon-2003/pb-pycon/pb.html#auto3 Alex Couper

1 0

[Twisted-Python] SSL and Perspective Broker - 2nd attempt
by Alex Couper 19 Apr '07

19 Apr '07

##Sorry about that, not sure why the first one didn't attach the message:## Attached are three files: a server, a client and a ssl certificate Thanks to twisteds remote calls, I can successfully call functions on the server from the client (or send objects if I need to). Fantastic What I can't seem to do, is get the SSL to secure the server from a non-authorised client (one that has access to stunnel.pem). So that if the client does not have the correct certificate it cannot connect to the server. What am I doing wrong? I have adapted some code found here<http://www.lothar.com/tech/papers/PyCon-2003/pb-pycon/pb.html>for this example. Alex Couper

1 0

[Twisted-Python] epoll reactor problems
by Alec Matusis 18 Apr '07

18 Apr '07

We just switched 2 types of production servers to epoll reactor( Twisted 2.5) from poll reactor (Twisted 2.2). The CPU%% utilization of the first type of server that does not do much except occasionally pushing messages to about 5000 clients dropped from about 40% to 8%, which is very good. The second type of server is more complicated. The CPU utilization of that server (as measured by top) went down from 40% to about 15% after switching to epoll. Here is the problem: after about 10min of running that server with CPU%% staying at about 15%, the CPU suddenly jumps to 99.9% for that process and just stays there. We reproduced this several times. The server remains responsive, even when top shows 99.9% CPU. (Which is very different from 99.9% CPU from real load when we used poll- we are intimately familiar with the performance in that regime unfortunately.) The kernel is 2.6.11.4-21.12-smp Can anybody help with this 99.9% CPU epoll problem?

8 14

[Twisted-Python] SSL and Perspective broker
by Alex Couper 17 Apr '07

17 Apr '07

Attached are three files: a server, a client and a ssl certificate Thanks to twisteds remote calls, I can successfully call functions on the server from the client (or send objects if I need to). Fantastic What I can't seem to do, is get the SSL to secure the server from a non-authorised client (one that has access to stunnel.pem). So that if the client does not have the correct certificate it cannot connect to the server. What am I doing wrong? I have adapted some code found here<http://www.lothar.com/tech/papers/PyCon-2003/pb-pycon/pb.html>for this example. Alex Couper

1 0

[Twisted-Python] confusion with general web serving
by Jonathan Vanasco 17 Apr '07

17 Apr '07

i'm missing a key piece of connectivity here: i'm building a twisted daemon to serve files. right now it will serve off a local structure, in the future it will do that + handle proxying to s3. I stripped out all the app specific code below. my issue is that i can't figure out how to display a file on the system for a url, short of slurping it i thought static.File would have soemthing to do with it, but I can't figure out how to get it into the http.Request.process routine. suggestions ? ---------------------------------------------------- class UserphotoRequestHandler(http.Request): re_userphoto= re.compile("""^\w{32}(?:_[smlt])?.jpg$""") def process(self): if self.path == '/favicon.ico': self.finish() return if not self.re_userphoto.findall( self.path ): return return_notFound() myFilname= self.db_lookup(): if not myFilname: return return_notFound() # how do i render myFilename ? self.finish() def return_notFound( self ): self.setResponseCode(http.NOT_FOUND) self.write("invalid request.") self.finish() class UserphotoHttp(http.HTTPChannel): requestFactory = UserphotoRequestHandler class UserphotoHttpFactory(http.HTTPFactory): protocol= UserphotoHttp if __name__ == "__main__": from twisted.internet import reactor reactor.listenTCP(7087, UserphotoHttpFactory()) reactor.run( )

2 2

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 15 Apr '07

15 Apr '07

Bug summary ______________________ Summary for 2007-04-08 through 2007-04-15 Bugs opened: 16 Bugs closed: 5 Total open bugs: 902 (+11) |== Type Changes |== Priority Changes |== Component Changes |Defect: +8 |Highest: -1 |Core: +4 |Enhancement: +2 |High: +2 |Foolscap: +1 |Task: +2 |Normal: +10 |Trial: +3 |Low: +1 |Web: +2 |Web2: +1 |Website: +1 New / Reopened Bugs ______________________ ===== High ===== [#2554] strange connect timeouts (opened by gudron) task web http://twistedmatrix.com/trac/ticket/2554 ===== Normal ===== [#2556] cfreactor breaks twisted.trial (opened by bromine) defect core http://twistedmatrix.com/trac/ticket/2556 [#2557] links on front page obscure one another (opened by zooko) defect website http://twistedmatrix.com/trac/ticket/2557 [#2558] noise about unclean reactor makes it hard for me to read trial output (opened by zooko) defect trial http://twistedmatrix.com/trac/ticket/2558 [#2559] trial runs unit tests in an arbitrary order (opened by zooko) (CLOSED, duplicate) defect trial http://twistedmatrix.com/trac/ticket/2559 [#2560] tests which time out don't get their tearDown() methods called (opened by zooko) (CLOSED, invalid) defect trial http://twistedmatrix.com/trac/ticket/2560 [#2561] .py/.pyc mismatch causes internal trial error (opened by exarkun) defect trial http://twistedmatrix.com/trac/ticket/2561 [#2562] No test coverage for amp unhandled client-side failures (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2562 [#2563] __file__ is relative in test module when invoked via "trial foo/bar.py" (opened by exarkun) defect trial http://twistedmatrix.com/trac/ticket/2563 [#2564] 'maximum recursion depth exceeded' when closing loopback transports (opened by j1m) defect core http://twistedmatrix.com/trac/ticket/2564 [#2565] Exception occurring in Foolscap CopyableSlicer. (opened by kgi) defect foolscap http://twistedmatrix.com/trac/ticket/2565 [#2566] Request for listenUDPOnce (or similar) (opened by Peaker) (CLOSED, wontfix) enhancement core http://twistedmatrix.com/trac/ticket/2566 [#2567] twisted.python.log.err does not have useful docstring (opened by konrads) defect core http://twistedmatrix.com/trac/ticket/2567 [#2568] trial cleanThreads breaks run until-failure (opened by therve) (CLOSED, duplicate) defect trial http://twistedmatrix.com/trac/ticket/2568 [#2570] mechanism for specifying a cred checker for twistd plugins to use (opened by glyph) enhancement core http://twistedmatrix.com/trac/ticket/2570 ===== Low ===== [#2569] web2 has no examples for HTTP client (opened by konrads) enhancement web2 http://twistedmatrix.com/trac/ticket/2569 Closed Bugs ______________________ ===== Highest ===== [#2356] twisted/test/test_banana.py uses StringIO incorrectly (opened by exarkun, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/2356 ===== Normal ===== [#2560] tests which time out don't get their tearDown() methods called (opened by zooko, closed by therve, invalid) defect trial http://twistedmatrix.com/trac/ticket/2560 [#2566] Request for listenUDPOnce (or similar) (opened by Peaker, closed by exarkun, wontfix) enhancement core http://twistedmatrix.com/trac/ticket/2566 [#2568] trial cleanThreads breaks run until-failure (opened by therve, closed by therve, duplicate) defect trial http://twistedmatrix.com/trac/ticket/2568 [#2559] trial runs unit tests in an arbitrary order (opened by zooko, closed by therve, duplicate) defect trial http://twistedmatrix.com/trac/ticket/2559

1 0

[Twisted-Python] Jabber support in Twisted Words
by Karol Nowak 14 Apr '07

14 Apr '07

Hi, I'm looking for a Python XMPP library for a new project that I'm writing and I have to questions regarding Twisted Words: * How XMPP compliant are its jabber components (anywhere near 100% of the base specification?)? * Which version of Python is required to run Twisted Words? Thanks in advance for any help. :) -- regards Karol 'grzywacz' Nowak

1 0

Re: [Twisted-Python] Implementing an event manager in twisted
by Andrew Francis 14 Apr '07

14 Apr '07

Hello Justin: >Whew. :) I certainly don't plan to re-implement >Twisted, since it already exists and it's ace; I want >something at a higher level. My aim here is to make >my existing application(s) even more modular so that >functionality can be added and extended in a simple, >common way. This principle has already provided >excellent benefits in the past. A good book on Event management is David Luckham's "The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems." I think the higher level stuff revolves around the event pattern language (also known as the trigger language)- how one defines an event and the mechanisms for detecting events. I am developing a WS-BPEL processor. Not many people know about WS-BPEL. WS-BPEL is a language that has event handlers that are based on time and web service calls. To correctly implement the specification, I also have to deal with triggering activities based on patterns in a message or attributes of the SOAP header. My experiences so far.... For time based stuff, Twisted is pretty strong (in opposition - Stackless is weak). I use TaskLoopCall help implement time and alarm triggered stuff. For web services, I have been writing classes that represent end-point-references based on the WSA standard. For instance, a tasklet in my WS-BPEL processor tells (or subscribes to) my "event manager" that it is interested in a particular EPR (say a SOAP message with a "buy" operation). In turn, a scheduler suspends the tasklet. When my Twisted based Request Handler receives a http request, as a part of the response, the handler creates an EPR representing the client end and sends it to the event manager. If the "event manager" can match the incoming EPR, it will ask the scheduler to wake up the associated tasklet. So far, this works fairly well. For 80% of stuff, Twisted and Stackless work really well together. My EPR classes are still pretty rough. However in a month or two, they should be in better shape. I am not sure if anyone is really interested but I would be more than happy to put it out there. Cheers, Andrew __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

1 0

[Twisted-Python] The Trial of the DirtyReactorError
by Matthew Glubb 14 Apr '07

14 Apr '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi All, I have to say that I am largely getting along famously with Twisted (and Python) now. I have started writing unit tests for my application and when I run them using trial I sometimes get DirtyReactorErrors ('reactor left in unclean state'). This is a nice error. It tells me that I am not shutting down resources correctly which would otherwise be left hanging around and be difficult to debug. I understand why this is occurring, its a simple matter of calling tcp.Port.stopListening() to suppress the error. However, I am more concerned with learning about where the most appropriate place to run this routine would be. I am not happy about running it in the unit test as it doesn't solve the problem, it just suppresses it. I can't seem to find an easy way to stop a port from listening from within a ServerFactory. Should I be writing a class that wraps the ServerFactory to run tcp.Port.stopListening() at the appropriate time? Please bear in mind that I am creating multiple 'one-shot' servers that are always shut down as soon as they have done their business. I am guessing that the stopService methods would be more appropriate for a conventional server that serves multiple clients / requests. Your thoughts? Thanks a lot for your time :) Matt m a t t h e w g l u b b ________________________________________________________________________ Z Group PLC Tel: +44 (0) 8700 111 173 Fax: +44 (0) 8707 051 393 Txt: +44 (0) 7800 140 877 Web: <http://www.zgroupplc.com/> This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. The opinions expressed in this mail are those of the author and do not necessarily represent the views of the company. If you have received this email in error please notify <service(a)zgroupplc.com> -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (Darwin) iD8DBQFGHmQKyI6MkdKPngkRAlkwAJ4zebpjOsfItDtqIaRJbj0kyN7jhACdHvYC 17YRmuZNefQfCxCesMStUWI= =dh4Z -----END PGP SIGNATURE-----

4 6