Mailman 3 October 2009 - Twisted

[Twisted-Python] reactor.run() do not return after reactor.stop()
by Stanislav Yudin 10 Oct '09

10 Oct '09

Hi everyone, I am having a problem with current twisted trunk (rev 27375). I am trying to implement simple ssh client with conch.ssh but right now my implementation works wrong way. I've made a wrapper class for my client factory, to separate host/creds information and command I want to execute. So in execute method of the wrapper I am calling reactor.run() - (that blocks execute method) and in one of callbacks for success/error calling reactor.stop(). So the problem is that the first call to execute returns from reactor.run() right after reactor.stop(), but second call to same method of same instance do not return ever. I believe I am doing something wrong, so please help with find out what I've missed. Problem code attached.

4 5

Re: [Twisted-Python] HTTPClientFactory's deferred never finishing download on .vcf (vcard file) link
by exarkun＠twistedmatrix.com 10 Oct '09

10 Oct '09

On 05:34 am, listsin(a)integrateddevcorp.com wrote: > >On Oct 9, 2009, at 5:53 AM, Reza Lotun wrote: >>>I haven't found any way to dump the actual headers from within >>>Twisted >> >>The getPage function in twisted.web is suited for simple calls but >>won't return returns. What you have to do is create your own slightly >>modified version of getPage that keeps track of the factory used for >>the call (by attaching it to the deferred or something). > >Yah, I kind of think this code was intended to do his own getPage() >but I'm not exactly sure what the point was. Maybe he used it for >debugging along the way, but the original intent was lost due to lack >of VCS (as was he!) > >I ended up rewriting it to use the simple client.getPage() > >Along the way, I ran into: > >http://python.net/crew/mwh/apidocs/twisted.web.http.Request.html > >Good Lord, no wonder I'm confused. > >Half PEP-8, http://www.python.org/dev/peps/pep-0008/, half JavaRama. > >I finally figured out that it was a stupid string formatting bug in >the code that was being echoed by Twisted but swallowed by the "Grand >Catcher of all Things Exception" in Twisted.. > >Once I found and fixed that, everything works fine -- until the next >time. As Reza Lotun pointed out, exceptions raised by application code and caught by Twisted are logged. If you find a place where application code can raise an exception and Twisted doesn't log it, this is a bug and should be reported. Jean-Paul

1 0

[Twisted-Python] Disturbing aspect of zope.interface
by Brian Granger 09 Oct '09

09 Oct '09

Hi, I know this is not the zope list, but I am encountering this in a twisted project, so I wanted to get some ideas here first. I am finding that zope.interface is like an infectious disease. Here is a simple example: In [35]: import zope.interface as zi In [37]: class A(object): ....: pass In [38]: class IB(zi.Interface): ....: pass In [39]: hasattr(A, '__provides__') Out[39]: False In [41]: # Inheriting from A gives A additional methods In [42]: class B(A): ....: zi.implements(IB) In [43]: hasattr(A, '__provides__') Out[43]: True In [45]: # C is clean of the additional methods In [46]: class C(object): ....: pass In [47]: hasattr(C, '__provides__') Out[47]: False The disturbing thing is that now A (which is just an object) has been hacked on by zope.interface. It has additional methods (__provides__, etc.) that are specific to zope. Summary: If a class A is later subclassed by something B that calls zi.implements, the original class A becomes infected with all the zope.interface stuff. Is there a way to avoid this? Doesn't this seem like a bad idea? Cheers, Brian

9 11

[Twisted-Python] IMAP IDLE client support
by Adam MacBeth 08 Oct '09

08 Oct '09

It doesn't appear that Twisted's IMAP client (twisted.mail.imap.IMAP4Client) supports the IDLE command. Are there any plans for this or does anyone have any thoughts on the complexity of implementing it? Thanks, Adam

1 0

[Twisted-Python] PB vs JMS
by jacopo.pecci＠gmail.com 08 Oct '09

08 Oct '09

I looked at PB for an architecture with one client distributing some processing to several servers. Now I came across JMS and I have seen that using ActiveMQ with the Stomp protocol there would be a good support for Python. Surprising I couldn't find any article comparing the two technologies. I wonder if they target different problems (it doesn't look to me). Is anyone able to sketch advantages of one solution against the other? Thanks, Jacopo

5 4

Re: [Twisted-Python] Problem with XMLRPC resource wrapped with guard basic auth
by asset 07 Oct '09

07 Oct '09

I was indeed being tricked. I actually tested soap with a real client, but with xmlrpc i was using the browser. I was expecting to see the same error message, and instead got a new one that was presented by the modifications I pulled out of the trunk to support the issue in #4014. I was expecting to see the older error message and it was replaced. A quick test via, >>> import xmlrpclib >>> server = xmlrpclib.Server('http://user:password@localhost:9999/rpc2') >>> server.quote() Showed it indeed worked like it should. Swapped it to use SSL and now I'm all set. Thank you for the clarification. Next time I'll test more before posting to the list. ;) TWKiel ---------------------------------------- From: exarkun(a)twistedmatrix.com Sent: Tuesday, October 06, 2009 6:43 PM To: asset(a)impactdamage.com, "Twisted general discussion" <twisted-python(a)twistedmatrix.com> Subject: Re: [Twisted-Python] Problem with XMLRPC resource wrapped with guard basic auth On 12:00 am, asset(a)impactdamage.com wrote: >Using the current trunk r27366 (which is after #4014 fixed a related >issue), I am having trouble with an implementation of web.guard wrapped >XMLRPC. This is a new test implementation to expose both a soap and >xmlrpc >interface. SOAP works, but xmlrpc throws UnsupportedMethod POST. I think you're being tricked by the confusing way in which this exception is displayed and by a slight implementation difference (and indeed externally visible behavioral difference) between XMLRPC and SOAPPublisher. SOAPPublisher defines "render" and no other render methods. So it will accept any request method and treat it the same way. It will never raise UnsupportedMethod. XMLRPC, on the other hand, defines "render_POST" and no other render methods, so it will only accept POST requests. For any other request, it will raise UnsupportedMethod and create that exception with a tuple of which methods it does allow. ('POST',) in this case. The exception I see when I approach this server at /rpc2 with my web browser (which is the only thing I've tried, because it's too much work to put together a real xml-rpc client that supports basic auth) is just what I'd expect. The browser issues a GET, the XMLRPC resource rejects this, indicating it only accepts POSTs. It may be worth improving the way UnsupportedMethod exceptions are stringified to make it more clear what's going on. Or, if this doesn't actually explain your problem, feel free to point that out and provide more details about how the client you're using behaves. Jean-Paul

1 0

[Twisted-Python] using perspective broker to talk to a subprocess?
by Ryan Burns 07 Oct '09

07 Oct '09

Hi All, I'm writing a twisted application where I'd like to run and communicate with subprocesses that also happen to be twisted apps. I'm wondering if I can somehow combine twisted's process and perspective broker code so that I can launch a twisted server in a subprocess and communicate with it via the perspective broker using the subprocess's stdin/stdout. Ideally, it would be great if this could scale, say up to 200 subprocesses. Disregarding reasons of why I would want to do this, is this something that is possible? I've looked at the perspective broker classes and the processProtocol as well as some of the helpers, but I don't quite see how to make it happen. Should I just use a socket instead and handle managing unique names/ports per subprocess on my own? Or any alternative ideas? Ultimately I just want to run subprocesses from my twisted app and communicate with them without having to do a bunch of parsing on my own and the subprocesses will be twisted as well, so I figure why not make use of twisted for my IPC. Thanks, Ryan

2 2

[Twisted-Python] Problem with XMLRPC resource wrapped with guard basic auth
by asset 07 Oct '09

07 Oct '09

Using the current trunk r27366 (which is after #4014 fixed a related issue), I am having trouble with an implementation of web.guard wrapped XMLRPC. This is a new test implementation to expose both a soap and xmlrpc interface. SOAP works, but xmlrpc throws UnsupportedMethod POST. Here is my test code, can anybody tell me if im doing something wrong? Again, /soap works, but /rpc2 freaks on the POST method being unavailable. ###### test-script.py from zope.interface import implements from twisted.internet import reactor from twisted.web.resource import IResource, Resource from twisted.web import server, guard from twisted.cred.portal import IRealm from twisted.python import log from zope.interface import implements from twisted.python import log from twisted.internet import reactor from twisted.web import server, resource, guard, xmlrpc, soap from twisted.cred.portal import IRealm, Portal from twisted.cred.checkers import InMemoryUsernamePasswordDatabaseDontUse import sys def getQuote(): return "Victory to the burgeois, you capitalist swine!" class XMLRPCQuoter(xmlrpc.XMLRPC): def xmlrpc_quote(self): return getQuote() class SOAPQuoter(soap.SOAPPublisher): def soap_quote(self): return getQuote() class WebServicesRealm(object): implements(IRealm) def requestAvatar(self, avatarId, mind, *interfaces): if resource.IResource in interfaces: node = resource.Resource() node.putChild("rpc2", XMLRPCQuoter()) node.putChild("soap", SOAPQuoter()) return resource.IResource, node, lambda: None raise NotImplementedError() if __name__ == "__main__": log.startLogging(sys.stdout) checker = [InMemoryUsernamePasswordDatabaseDontUse(foo='bar')] webServicesWrapper = guard.HTTPAuthSessionWrapper(Portal(WebServicesRealm(), checker), [guard.BasicCredentialFactory("test")]) reactor.listenTCP(9999, server.Site(webServicesWrapper)) reactor.run() ###### http://localhost:9999/soap *good* http://localhost:9999/rpc2 *bad; POST isnt an allowed method* Thanks, TWKiel

6 9

[Twisted-Python] Example of a long-polling asynchronous web servic?
by Stephen Mattison 07 Oct '09

07 Oct '09

Hey guys I'm trying to implement some web-services over JSON-RPC, and one of the methods needs to use server-push. I will try and explain my problem as well as I can. I have a client, which is an iPhone, natively running a JSON-RPC( or XML-RPC ) client implementation. I need to do something like this from the iPhone service = ServerProxy("http://mydomain.com/webservice") init_data = service.subscribe_to_updates() ... ... ... some_result = service.some_regular_function(params) How can I implement this in Twisted? -- Stephen Mattison

2 2

[Twisted-Python] Structural issues in Lore XHTML documents
by Kevin Horn 06 Oct '09

06 Oct '09

I've been looking over the xhtml documents used to generate the twisted documentation, and I've noticed a number of issues: - some docs do not have a DOCTYPE declaration, I think they should all have one - of those documents that do have DOCTYPEs, some are using xhmtl-strict, and some are using xhtml-transitional, which is preferred? I think they should all use the same one - some of the docs are lacking an xml namespace attribute in their root <html> element...I think they should either all have one, or none of them should - according to: http://twistedmatrix.com/projects/lore/documentation/howto/lore.html all of the docs should have the same text in both their <title> element and their <h1> element...this is not the case I'm planning to correct some of these issues, but I wanted to get others' opinions on exactly how to go about it. For example, what DOCTYPE to use, XMLNS to use, etc. Thoughts? Suggestions? I've opened a ticket (#4050) at http://twistedmatrix.com/trac/ticket/4050 Please comment. Thanks, Kevin Horn

2 3