Mailman 3 March 2013 - Twisted

[Twisted-Python] debugging listenTCP
by Matthew Pounsett 24 Mar '13

24 Mar '13

I've got a weird one here. I've just come back to some code that I haven't worked on in a while, which is a simple XMLRPC server. Last time I touched it I was working on adding cred support, so I'd gone from using a direct call to server.Site() in my listenTCP call to using my own factory/portal/etc. When I fired it up this time, listenTCP was failing to bind to the requested ports, but not raising an exception. I started writing up an email to ask about debugging this, but while doing information collection it started working again. Then not. Now it's working again. It looks like I've got some sort of intermittent failure, but I have no idea how to track it down. # 'interfaces' is just a simple list of IP addresses. The map() # call provides formatting for the log message logger.debug("Connecting to port {} on interfaces: {}".format( port, ", ".join(map( lambda x: "'{}'".format(x), interfaces)))) for iface in interfaces: reactor.listenTCP(port, factory, interface=iface) reactor.run() The application should bind to [::1]:8602 and 127.0.0.1:8602, and logging seems to indicate this is what it's trying to do. 01:28:31 [server ] Connecting to port 8602 on interfaces: '::1', '127.0.0.1' However, intermittently lsof and netstat are showing no binding. > netstat -an | grep -c 8602 0 I tried turning on twisted's internal logging, but that is giving me nothing useful. I see no way to turn up the debugging level on this log, but I normally use python's standard logger and perhaps I've missed some piece of documentation. This is a sample from when it was failing: 2013-03-12 01:28:31+0000 [-] Log opened. 2013-03-12 01:28:31+0000 [-] ServerFactory starting on 8602 2013-03-12 01:28:31+0000 [-] Starting factory <insurrection.server.ServerFactory instance at 0x85a81488> 2013-03-12 01:28:31+0000 [-] ServerFactory starting on 8602 Can anyone suggest anything more I can do to track down the problem next time it crops up?

2 1

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 24 Mar '13

24 Mar '13

1 0

[Twisted-Python] Second pre-release of Twisted 13.0.0
by Thomas Hervé 20 Mar '13

20 Mar '13

Hello there, Due to some test problems (#5989 being reverted), we cut a new pre-release for your testing pleasure. You can find the tarballs here: http://twistedmatrix.com/~therve/13.0.0pre2/ Please give a quick test! -- Thomas

4 3

[Twisted-Python] banana SIZE_LIMIT
by Sergey Gerasimov 18 Mar '13

18 Mar '13

Hi, Are they some simple ways (keeping existing interface) around BananaError for long values returned from PB methods?

3 2

[Twisted-Python] more complex IBodyProducer?
by Kevin McIntyre 18 Mar '13

18 Mar '13

has anyone implemented a more complex IBodyProducer than class POSTRequestProducer(): implements(IBodyProducer) def __init__(self, body): self.body = body self.length = len(self.body) def startProducing(self, consumer): consumer.write(self.body) return succeed(None) def pauseProducing(self): pass def stopProducing(self): pass I have an upload intensive application, that during periods of poor connectivity ends up with a lots on zombie http TCP connections. I'm thinking maybe that the "pause" is being called and that my request deferred is in a paused state.

1 0

[Twisted-Python] Twisted Visualizations
by anatoly techtonik 18 Mar '13

18 Mar '13

Hi, I always thought that there is not enough art in STEM education, and looking at how the STEAM powered education gains momentum, I can not resist to throw in the idea to the Python community. STEAM = (Science, Technology, Engineering, Arts, Mathematics) So far, the PyCon has talks that cover everything above around the core, but not really much of A stuff. To me it would be interesting to see the visualization of Twisted, the visualization of Stackless, the visualization of how source code transforms to data and code sections in memory and how the data is processed in this memory. That may not be strictly related to the Python, but it is vital for Python development that people know how things work starting from the moment they press a key to launch a Python interpreter. That's the first thing people do - they touch the key on a keyboard. That's the entrypoint . For the people who want to start with Python it will be interesting to see how systems work in 3D, 2D or any other xD that is accepted by human brain (even in 1D if we can accept the idea of a simple scroller for Python source code). It will be interesting to see open source visualization models that many people can iterate on and improve in parts. I imagine some things to a some degree and can draw some sketches on paper, but what would be awesome if people at PyCon could use the chance to gather together and discuss the idea from the perspective of folks with visual arts experience (Blender, ...) - will those twisted visualizations be awesome? Will they be useful? Interesting for artists? What could happen to make them possible and the whole process fun. -- anatoly t.

1 0

[Twisted-Python] Jabber client, tls and iqauth
by rakdeFR 18 Mar '13

18 Mar '13

Hi! I did some searches about my problem and didn't find any thing that match in the archives. I'm trying to do a simple jabber client with the twisted framework in order to automatically send messages. The server is a prosody server, and enabled the tls and iq auth. So far, I can connect to the server, and can't login. If I'm doing a XmlStreamFactory with the basicClientFactory, I have these initializers/authenticator: Initializers [<twisted.words.protocols.jabber.xmlstream.TLSInitiatingInitializer object at 0x2c1ef50>, <twisted.words.protocols.jabber.client.IQAuthInitializer object at 0x2c1ef90>] Authenticator <twisted.words.protocols.jabber.client.BasicAuthenticator instance at 0x10f2320> And if I create a XMPPClientFactory, I have these: Initializers [<twisted.words.protocols.jabber.client.CheckVersionInitializer object at 0x2fe7f50>, <twisted.words.protocols.jabber.xmlstream.TLSInitiatingInitializer object at 0x2fe7fd0>, <twisted.words.protocols.jabber.sasl.SASLInitiatingInitializer object at 0x2ff1050>, <twisted.words.protocols.jabber.client.BindInitializer object at 0x2ff1090>, <twisted.words.protocols.jabber.client.SessionInitializer object at 0x2ff10d0>] Authenticator <twisted.words.protocols.jabber.client.XMPPAuthenticator instance at 0x2fdd320> So I look up the SEND and RECV message between the client and server, and I notice that if I do a XMPPClientFactory, it's doing a tls connection, then say it doesn't have the feature for iq auth. And if I'm doing a basicClientFactory, I don't have the tls, so when it tries to logon with iq, the server answers that it needs the tls. After noticing that, I tried to change the initializers and the authenticator in the connected function. But when I'm doing a XMPPClientFactory with a BasicAuthenticator, I don't have the tls anymore. What do I need to change in order to have the tls and after the iq auth? Thank you for your help. rkadeFR My current code: 19 class ClientXMPP(object): 20 def __init__(self, jid_user, password_user): 21 self.reactor = reactor 22 XmlStreamFactory = client.basicClientFactory(jid_user, password_user) 23 XmlStreamFactory.addBootstrap(xmlstream.STREAM_CONNECTED_EVENT, self.connected) 24 XmlStreamFactory.addBootstrap(xmlstream.STREAM_END_EVENT, self.disconnected) 25 XmlStreamFactory.addBootstrap(xmlstream.STREAM_AUTHD_EVENT, self.authenticated) 26 XmlStreamFactory.addBootstrap(xmlstream.INIT_FAILED_EVENT, self.init_failed) 27 connector = SRVConnector(reactor, 'xmpp-client', jid_user.host, XmlStreamFactory) 28 connector.connect() 29 self.finished = Deferred() 30 31 def rawDataIn(self, buf): 32 print "RECV: %s" % unicode(buf, 'utf-8').encode('ascii', 'replace') 33 34 def rawDataOut(self, buf): 35 print "SEND: %s" % unicode(buf, 'utf-8').encode('ascii', 'replace') 36 37 def connected(self, xs): 38 xs.rawDataInFn = self.rawDataIn 39 xs.rawDataOutFn = self.rawDataOut 40 print 'Connected.' 41 self.xmlstream = xs 42 # 43 print 'Initializers', xs.initializers 44 print 'Authenticator', xs.authenticator 45 print 'Am I initialized?', xs.initiating 46 # Log trafic out 47 48 def disconnected(self, xs): 49 print 'Disconnected.' 50 self.finished.callback(None) 51 52 def authenticated(self, xs): 53 print "Authenticated." 54 presence = domish.Element((None, 'presence')) 55 xs.send(presence) 56 self.reactor.callLater(5, xs.sendFooter) 57 58 def send(self, message): 59 print 'Send', message 60 61 def init_failed(self, failure): 62 print "Initialization failed. Failure:" 63 print failure 64 # self.xmlstream.sendFooter() 65 # self.xmlstream.authenticator.initializeStream()

2 1

[Twisted-Python] Final request URI from an Agent response
by Jonathan Jacobs 18 Mar '13

18 Mar '13

Hello Twisters, I'm interested in working on ticket #5435: The ability to discover the final URI of an Agent request/response. Thomas summarised a previous IRC conversation on this topic quite well in a comment on the ticket [1]. The biggest issue I've encountered so far is that Request.uri is a relative URI. Since it is not possible to reconstruct an absolute URI given the information that Request has, at the very least the URI scheme is lost, we have a few options: * Allow Request.uri to be either an absolute URI or a relative URI byte string, however this means that consumers of this attribute need to be aware that it could be either; * Add a new attribute/method to Request (and parameter to Request.__init__) for the absolute URI, again this means that consumers need to be aware that the absolute URI might not be present. If we are to change Request's URI API, it would be a good idea to do this as few times as possible. (One seems like a good number to me.) JP commented that it would be nice if there was an object that represented a URL we could use, referring to ticket #5388. And although I would love to see #5388 finished (and might even be persuaded to work on it), discussions with Itamar and reading ticket comments have left me weary of the many nuanced complexities of this task. What are the thoughts on changing the meaning of Request.uri? Should the IRI branch be finished before attempting this ticket? (Note that this doesn't necessarily include my volunteering.) [1] <https://twistedmatrix.com/trac/ticket/5435#comment:9> -- Jonathan

4 6

Re: [Twisted-Python] TWISTED DINNER TOMORROW: 5:30PM on Sunday 2013-03-17 at Buca di Beppo in Campbell, CA. RSVP required.
by Duncan M. McGreggor 17 Mar '13

17 Mar '13

Yes! I'm coming :-) d Sent from my iPhone On Mar 16, 2013, at 11:48 AM, "Bradley M. Kuhn" <bkuhn(a)sfconservancy.org> wrote: > On behalf of the Twisted Project Leadership Committee at Software > Freedom Conservancy, I'd like to invite all Twisted developers and > contributors who are here at PyCon 2013 to the Second Annual Twisted > Project Dinner at Buca di Beppo in Campbell, CA. > > I've made a reservation for 17:30 (5:30 PM) tomorrow, Sunday 17 March > 2013. > > *Please* RSVP by private email to me at <bkuhn(a)sfconservancy.org> by > noon (12:00) on Sunday so I can update the restaurant with the proper > number for the reservation. > > Let's meet by 5PM (17:00) in the lobby of the Hyatt Regency Santa Clara > to coordinate rides from the venue, with a plan to be leaving by 5:15 > PM. We'll get cabs as necessary if there aren't enough cars among us to > get us all there. > > If you'd like to meet us at the restaurant, here's the address: > > Buca di Beppo > 1875 S Bascom Ave > Campbell, CA 95008 > Phone: +1-408-377-7722 > URL: http://www.bucadibeppo.com/restaurants/ca/campbell/ > > The reservation is in my name, in case you arrive at the restaurant > before the main group. > -- > Bradley M. Kuhn, Executive Director, Software Freedom Conservancy > > _______________________________________________ > Twisted-Python mailing list > Twisted-Python(a)twistedmatrix.com > http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

1 0

Re: [Twisted-Python] TWISTED DINNER TOMORROW: 5:30PM on Sunday 2013-03-17 at Buca di Beppo in Campbell, CA. RSVP required.
by burak.arslan＠arskom.com.tr 17 Mar '13

17 Mar '13

Hello! please count me in, i think i'll be anle to make it. Thanks -- Sent from my mobile. Pardon the brevity.On 16/03/2013 11:48 Bradley M. Kuhn wrote: On behalf of the Twisted Project Leadership Committee at Software Freedom Conservancy, I'd like to invite all Twisted developers and contributors who are here at PyCon 2013 to the Second Annual Twisted Project Dinner at Buca di Beppo in Campbell, CA. I've made a reservation for 17:30 (5:30 PM) tomorrow, Sunday 17 March 2013. *Please* RSVP by private email to me at <bkuhn(a)sfconservancy.org> by noon (12:00) on Sunday so I can update the restaurant with the proper number for the reservation. Let's meet by 5PM (17:00) in the lobby of the Hyatt Regency Santa Clara to coordinate rides from the venue, with a plan to be leaving by 5:15 PM. We'll get cabs as necessary if there aren't enough cars among us to get us all there. If you'd like to meet us at the restaurant, here's the address: Buca di Beppo 1875 S Bascom Ave Campbell, CA 95008 Phone: +1-408-377-7722 URL: http://www.bucadibeppo.com/restaurants/ca/campbell/ The reservation is in my name, in case you arrive at the restaurant before the main group. -- Bradley M. Kuhn, Executive Director, Software Freedom Conservancy _______________________________________________ Twisted-Python mailing list Twisted-Python(a)twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

1 0