Mailman 3 August 2008 - Twisted

[Twisted-Python] Controlling logging in xmlrpc server
by Don Dwiggins 29 Aug '08

29 Aug '08

I have an XMLRPC server running nicely, and have set up logging to a file using t.p.log (mainly for debugging). It all works fine, but I'm getting entries in the log like the following: 2008/08/28 16:44 -0700 [HTTPChannel,0,127.0.0.1] 127.0.0.1 - - [28/Aug/2008:23:44:02 +0000] "POST / HTTP/1.1" 200 683 "-" "Zend_XmlRpc_Client" (all one line -- excuse the folding). I'd like to be able to control this: disable these log messages when I want, log additional information about the request, etc. (In particular, I'd like to see the xmlrpc "method" name.) I've tracked down the source of the messages to HTTPFactory.log in t.w.http.py. At this point, I'm not sure how to proceed. I don't use the factory explicitly, just instantiate a subclass of xmlrpc.XMLRPC, wrap it in a server.Site and pass it to the default reactor. What would I need to do to access the HTTPFactory (or maybe subclass it) in this context? Is there a better approach to this? Thanks, -- Don Dwiggins Advanced Publishing Technology

1 0

[Twisted-Python] RemoteReference decref
by A 29 Aug '08

29 Aug '08

Hi, I'm still working on an Actionscript pb client, and have run into a bit of a conundrum with RemoteReference which is using python's built-in __del__ to trigger a decref. Actionscript doesn't have destructors so I will need to trigger the decref manually. based on my capture of a clent/server converation I am thinking that the client could do this in proto_answer s -: ('version', 6) r -: ['version', 6] r -: ['message', 1, 'root', 'login', 1, ['tuple', 'alice'], ['dictionary']] s -: ('answer', 1, ['tuple', 'x\x9b\x95\x1c\tJp\xe0\x96]\xf4\xdb\xeb\x13\t9', ('remote', 1)]) r -: ['message', 2, 1, 'respond', 1, ['tuple', '\x06\x04\xf1vI\xfeP\xa0\xdfzl(\xd9\x7f!t', ['remote', 1]], ['dictionary']] s -: ('answer', 2, ('remote', 2)) r -: ['decref', 1] r -: ['message', 3, 2, 'joinGroup', 1, ['tuple', '#lookingForFourth'], ['dictionary']] s -: ('answer', 3, ('remote', 3)) r -: ['decref', 2] r -: ['message', 4, 3, 'send', 1, ['tuple', 'You can call me Al.'], ['dictionary']] s -: ('message', 1, 1, 'print', 1, ['tuple', '<alice> says: You can call me Al.'], ['dictionary']) s -: ('answer', 4, ['None']) r -: ['decref', 3] Not sure where I get a reference to RemoteReference though. any ideas ?

2 2

[Twisted-Python] Could not accept new connection
by Pavel 29 Aug '08

29 Aug '08

Hi all, today I got this error in my twisted.log [twisted.web.server.Site] Could not accept new connection (ECONNABORTED) What could be a possible cause of this? Any ways to fix it? Thanks in advance. -- Good luck, Pavel Bastov

4 5

[Twisted-Python] Is Ldaptor stable / still maintained?
by Luciano Cavalheiro da Silva 29 Aug '08

29 Aug '08

Hi there, Anybody could tell me whether Ldaptor, which is build on top of twisted, is still maintained or has been abandoned? Is it stable? I've found on its home page it has not been updated in the last 3 years... I'm starting a project (production system) in python which has to access an Openldap server, so I'm in doubt what would be better to use by now, ldaptor or python-ldap? Best regards, Luciano

2 1

Re: [Twisted-Python] Monitoring configuration of twisted calls.
by Steve Lewis 28 Aug '08

28 Aug '08

Actually, I think I just figured it out: def wrapper(*args, **kw): func = self._getProxy(URL["url"], URL["user"], URL["passwd"]).callRemote(remote_method, *args, **kw) func.addCallback(self.handleSuccess, method) return func return wrapper All I needed was to add a callback! Steve ----- Original Message ---- From: Jean-Paul Calderone <exarkun(a)divmod.com> To: Twisted general discussion <twisted-python(a)twistedmatrix.com> Sent: Thursday, August 28, 2008 4:01:10 PM Subject: Re: [Twisted-Python] Monitoring configuration of twisted calls. On Thu, 28 Aug 2008 06:25:40 -0700 (PDT), Steve Lewis <spiritualmechanic(a)yahoo.com> wrote: >I'm fairly new to twisted, although we are using it in production. What I'd like to do, is have a simple redlight/greenlight method (over XML-RPC) to tell me which methods have been called successfully at least once. The goal of this is not so much performance or uptime, but to just tell me that we are configured correctly. > >We're using twisted as a sort of service bus, so we have a decent amount of configuration that needs to be set up. > >What I've considered so far: > >[snip] > >2. Extending/subclassing XMLRPC: > > def _getFunction(self, functionPath): > ''' > Overrides XMLRPC._getFunction to use our simple mapper. > ''' > > ## attempt default behavior for local methods > try: > func = XMLRPC._getFunction(self, functionPath) > return func > except NoSuchFunction: > pass > >This would work in my head, but in actuality, the call doesn't actually happen here, it just returns the function. > This is probably the best approach. `_getFunction´ should probably be a public method. Its docstring directs users to override it, which is rather in conflict with it being private. To overcome the problem of the function not actually being called inside `_getFunction´, you just need to apply a wrapper to the function which is looked up. The wrapper can mark the call as successful. For example: def _getFunction(self, functionPath): f = XMLRPC._getFunction(self, functionPath) def wrapper(*a, **kw): result = f(*a, **kw) self._monitor[functionPath] = True return result return wrapper I'd also recommend filing a ticket to make `_getFunction´ public, so that you don't have to rely on a private hook to make this work. Jean-Paul _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

1 0

Re: [Twisted-Python] Monitoring configuration of twisted calls.
by Steve Lewis 28 Aug '08

28 Aug '08

Okay, that seems to work. One more question: We've defined a class called XMLRPCWithRemote that subclasses XMLRPC. Some of the methods are local, others with be called using the Proxy. I tried to wrap the function but I'm getting: exceptions.AttributeError: Deferred instance has no __call__ method This is the code I have for wrapping: def wrapper(*args, **kw): func = self._getProxy(URL["url"], URL["user"], URL["passwd"]).callRemote(remote_method, *args, **kw) result = func(*args, **kw) monitor[functionPath] = True return result return wrapper _getProxy is defined thusly: def _getProxy(self, url, username=None, password=None): log.msg("Get proxy") return Proxy(url, user=username, password=password, allowNone=True, useDateTime=True) So it looks like I'm getting a deferred back from the callRemote, so it appears harder to wrap? I think that's what's going on. I'm guessing the local method doesn't require a deferred, so that's why it works. Is there something obvious I'm missing? I started going down the path of overriding xmlrpc.Proxy or xmlrpc._QueryFactory but I'm not sure that's the simplest way. Thanks a bunch, Steve ----- Original Message ---- From: Jean-Paul Calderone <exarkun(a)divmod.com> To: Twisted general discussion <twisted-python(a)twistedmatrix.com> Sent: Thursday, August 28, 2008 4:01:10 PM Subject: Re: [Twisted-Python] Monitoring configuration of twisted calls. On Thu, 28 Aug 2008 06:25:40 -0700 (PDT), Steve Lewis <spiritualmechanic(a)yahoo.com> wrote: >I'm fairly new to twisted, although we are using it in production. What I'd like to do, is have a simple redlight/greenlight method (over XML-RPC) to tell me which methods have been called successfully at least once. The goal of this is not so much performance or uptime, but to just tell me that we are configured correctly. > >We're using twisted as a sort of service bus, so we have a decent amount of configuration that needs to be set up. > >What I've considered so far: > >[snip] > >2. Extending/subclassing XMLRPC: > > def _getFunction(self, functionPath): > ''' > Overrides XMLRPC._getFunction to use our simple mapper. > ''' > > ## attempt default behavior for local methods > try: > func = XMLRPC._getFunction(self, functionPath) > return func > except NoSuchFunction: > pass > >This would work in my head, but in actuality, the call doesn't actually happen here, it just returns the function. > This is probably the best approach. `_getFunction´ should probably be a public method. Its docstring directs users to override it, which is rather in conflict with it being private. To overcome the problem of the function not actually being called inside `_getFunction´, you just need to apply a wrapper to the function which is looked up. The wrapper can mark the call as successful. For example: def _getFunction(self, functionPath): f = XMLRPC._getFunction(self, functionPath) def wrapper(*a, **kw): result = f(*a, **kw) self._monitor[functionPath] = True return result return wrapper I'd also recommend filing a ticket to make `_getFunction´ public, so that you don't have to rely on a private hook to make this work. Jean-Paul _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

2 1

[Twisted-Python] Monitoring configuration of twisted calls.
by Steve Lewis 28 Aug '08

28 Aug '08

I'm fairly new to twisted, although we are using it in production. What I'd like to do, is have a simple redlight/greenlight method (over XML-RPC) to tell me which methods have been called successfully at least once. The goal of this is not so much performance or uptime, but to just tell me that we are configured correctly. We're using twisted as a sort of service bus, so we have a decent amount of configuration that needs to be set up. What I've considered so far: 1. Modifying each xmlrpc method individually and setting a boolean to True in a dictionary: if results: self._monitor['xmlrpc.method.name'] = True This is okay, but I'd like something that is more generic so I don't have to write this code in every single XMLRPC method. 2. Extending/subclassing XMLRPC: def _getFunction(self, functionPath): ''' Overrides XMLRPC._getFunction to use our simple mapper. ''' ## attempt default behavior for local methods try: func = XMLRPC._getFunction(self, functionPath) return func except NoSuchFunction: pass This would work in my head, but in actuality, the call doesn't actually happen here, it just returns the function. 3. Extending/subclassing QueryProtocol: def handleStatus(self, version, status, message): if status != '200': self.factory.badStatus(status, message) I could override QueryProtocol and in the handleStatus method set a field in a dictionary. There are probably many ways to do this wrong, and I'm a Java guy just getting used to the twisted way of doing things. I apologize if my attempts are painful and/or hilarious. Thanks, Steve L.

2 1

[Twisted-Python] Use the Launchpad plugin on our trac? (was Fwd: Bugzilla and Trac Launchpad plugins: Request for beta testers)
by Jonathan Lange 27 Aug '08

27 Aug '08

Hello all, Launchpad has recently released a Trac plugin that lets Launchpad synchronize bugs and bug comments from Launchpad to Trac and vice versa. Can we please install this on our Trac? jml ---------- Forwarded message ---------- From: Graham Binns <graham(a)canonical.com> Date: Sat, Aug 23, 2008 at 7:55 AM Subject: Bugzilla and Trac Launchpad plugins: Request for beta testers To: Warthogs list <warthogs(a)lists.canonical.com> Howdy, warthogs, I'm writing to you to ask for help with testing some cool new features that we're going to be adding to Launchpad shortly. We've developed (well, we've contracted people to develop) plugins for Bugzilla and Trac that allow bidirectional communication between Launchpad and the remote bug trackers that have them installed. As I said, we need some help testing these plugins. Specifically, we need to have them installed on a number of remote bug trackers so that we can use the plugins to communicate with those trackers. If you know of any bug trackers whose administrators might be interested in helping us out (or, even better, if you're one of those administrators yourself), please point them to the following pages on the help wiki, which will explain how to download and install the Launchpad plugins: For Bugzilla: http://help.launchpad.net/Bugs/BugzillaPlugin For Trac: http://help.launchpad.net/Bugs/TracPlugin Installing one of the plugins means that: * Launchpad will be able to forward bugs to upstream bug trackers that have the plugin installed. Users of those bug trackers won't have to check Launchpad for bugs registered against their project; they'll be forwarded straight to the upstream tracker. * If a bug watch is created against an upstream bug, Launchpad will tell the upstream bug tracker which Launchpad bug is watching it. This means that not only is there a link in Launchpad to the upstream bug, but there's also a link in the upstream bug tracker to the Launchpad bug. * Launchpad will be able to import comments from upstream bugs which are being watched in Launchpad. If you register a bug watch against an upstream bug you'll be able to read the conversation about that bug on Launchpad, including the comments that are made on the upstream bug tracker. * Launchpad will be able to push comments to upstream bugs which are linked to a Launchpad bug, so if you add a comment on Launchpad in reply to a comment which was imported from an upstream bug tracker, the comment will automatically be added to the conversation on the upstream bug tracker, too. This means that users of both Launchpad and the upstream tracker can view the whole conversation about the bug without leaving their preferred environments. If you've got any further questions, please feel free to ask me. Thanks in advance for your help, Graham -- Graham Binns | PGP Key: 4DAD18FA -- warthogs mailing list warthogs(a)lists.canonical.com https://lists.ubuntu.com/mailman/listinfo/warthogs

2 2

[Twisted-Python] a question about self.factory in pb.Broker
by A 25 Aug '08

25 Aug '08

I'm attempting to build a Twisted pb client in Actionscript. or at least enough to act as the client in this example . . http://twistedmatrix.com/projects/core/documentation/howto/pb-cred.html#aut… I'm a bit stuck here . . def _sendError(self, fail, requestID): """(internal) Send an error for a previously sent message. """ if isinstance(fail, failure.Failure): # If the failures value is jellyable or allowed through security, # send the value if (isinstance(fail.value, Jellyable) or self.security.isClassAllowed(fail.value.__class__)): fail = fail.value elif not isinstance(fail, CopyableFailure): fail = failure2Copyable(fail, self.factory.unsafeTracebacks) if isinstance(fail, CopyableFailure): fail.unsafeTracebacks = self.factory.unsafeTracebacks self.sendCall("error", requestID, self.serialize(fail)) where should self.factory be set ? what is self.factory ? PbClientFactory ?

2 3

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 23 Aug '08

23 Aug '08

1 0