Mailman 3 January 2007 - Twisted

[Twisted-Python] twisted and gprs networks
by John Aherne 08 Jan '07

08 Jan '07

I am looking at using PDA devices talking to a server over gprs. I need to push data to the PDA over elapsed timeframes that might be hours. Naturally during this timespan the device may have been dropped from the network or acquire a different IP address. However to push data to the PDA, I need to record the IP and port used by the PDA for its first contact since it is stuck behind a firewall. The socket needs to be kept open on the PDA so the server can keep responding on the same session over a period of time. Using straight sockets I can do this by holding the reference to the IP/port used by the PDA. And checking every now and then that the connection is still valid. But I am no comms expert and I need to keep track of over 100 devices and keep reliably sending messages to them at random intervals. So, I thought it might be better to use some framework for the server since I am no expert on sockets. But looking through the docs for twisted and some of the code, I can't see anywhere how I can get and use a reference to the port and reuse the open session on the PDA. Can I do this with twisted or should I look for some other way of doing what I want. I was thinking I could use irc with twisted but not sure if I am barking up the wrong tree. Thanks for any ideas of solving the problem. John Aherne

6 5

[Twisted-Python] Twisted µConf @ linux.conf.au
by Stephen Thorne 08 Jan '07

08 Jan '07

It turns out there's going to be a sizable contingent of Twisted hackers at linux.conf.au '07. As such, I'm attempting to organise a Micro Conference on the sunday before the conference. I'm planning on gathering at where we're staying Randwick Lodge, 211 Avoca St because there's wifi access available, and I'd like to be able to sit down and hack. Jonathan has mentioned wanting to hack on trial, and while I'm not resistant to that, I'm open to suggestions. :) http://shiny.thorne.id.au/shiny/shiny.html http://zoomin.com.au/australia/nsw/sydney/randwick/avoca+street/211/ Stephen. Scanned by the NetBox from NetBox Blue (http://netboxblue.com/)

1 0

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 07 Jan '07

07 Jan '07

Bug summary ______________________ Summary for 2006-12-31 through 2007-01-07 Bugs opened: 28 Bugs closed: 19 Total open bugs: 810 (+9) |== Type Changes |== Priority Changes |== Component Changes |Defect: +5 |Highest: -3 |Conch: +0 |Enhancement: +5 |High: +0 |Core: +4 |Task: +0 |Normal: +12 |Mail: +1 |Low: +1 |Names: +0 |News: +1 |Pb: -1 |Release Management: +3 |Trial: +1 |Web: -1 |Web2: +0 |Website: +1 |Words: +1 New / Reopened Bugs ______________________ ===== Highest ===== [#2344] Typos in AMP docstrings (opened by scmikes) (CLOSED, fixed) defect core http://twistedmatrix.com/trac/ticket/2344 [#2365] trial should completely manage its output stream (opened by glyph) defect trial http://twistedmatrix.com/trac/ticket/2365 ===== High ===== [#2357] "twistd words" should also run an amp server (opened by glyph) enhancement words http://twistedmatrix.com/trac/ticket/2357 [#1120] OS-X vs PTYProcess, OSError vs IOError (opened by warner) defect core http://twistedmatrix.com/trac/ticket/1120 ===== Normal ===== [#2340] Special case inlineCallbacks for case where Deferred already has value (opened by itamarst) enhancement core http://twistedmatrix.com/trac/ticket/2340 [#2341] Merge twisted.internet.process.PTYProcess and Process (opened by itamarst) defect core http://twistedmatrix.com/trac/ticket/2341 [#2342] scgi client doesn't handle content-length (opened by jknight) defect web2 http://twistedmatrix.com/trac/ticket/2342 [#2343] createCGIEnvironment should refuse if path segments have a / (opened by jknight) defect web2 http://twistedmatrix.com/trac/ticket/2343 [#2346] Header generation not conforming to RFC822 and RFC2046 (opened by tekNico) defect web2 http://twistedmatrix.com/trac/ticket/2346 [#2347] "Register" Trac link not working (opened by tekNico) (CLOSED, fixed) defect website http://twistedmatrix.com/trac/ticket/2347 [#2348] Does the ticket bot still work? (opened by jknight) (CLOSED, invalid) task website http://twistedmatrix.com/trac/ticket/2348 [#2349] unify "download" page on the web site (opened by glyph) enhancement website http://twistedmatrix.com/trac/ticket/2349 [#2350] Update release process to only use one branch (opened by glyph) enhancement release management http://twistedmatrix.com/trac/ticket/2350 [#2351] Apt line for Ubuntu dapper that contains released Twisteds (opened by glyph) enhancement release management http://twistedmatrix.com/trac/ticket/2351 [#2352] Document and enforce deprecation policy (opened by glyph) (CLOSED, duplicate) enhancement release management http://twistedmatrix.com/trac/ticket/2352 [#2353] Change Twisted "main" release to a time-based version number (opened by glyph) enhancement release management http://twistedmatrix.com/trac/ticket/2353 [#2354] Handling of EINTR in threadedselectreactor.py (opened by dkosovic) defect core http://twistedmatrix.com/trac/ticket/2354 [#2355] twisted/protocols/stateful.py uses StringIO incorrectly (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2355 [#2356] twisted/test/test_banana.py uses StringIO incorrectly (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2356 [#2358] twisted.conch.insults.insults.ITerminalTransport.setScrollRegion missing (opened by exarkun) defect conch http://twistedmatrix.com/trac/ticket/2358 [#2359] Release TwistedConch-0.8 (opened by radix) (CLOSED, fixed) task core http://twistedmatrix.com/trac/ticket/2359 [#2360] Release TwistedMail-0.4 (opened by radix) (CLOSED, fixed) enhancement mail http://twistedmatrix.com/trac/ticket/2360 [#2361] Release TwistedNames-0.4 (opened by radix) (CLOSED, fixed) enhancement names http://twistedmatrix.com/trac/ticket/2361 [#2362] Release TwistedWords-0.5.0 (opened by radix) (CLOSED, fixed) enhancement words http://twistedmatrix.com/trac/ticket/2362 [#2363] Release TwistedLore-0.3.0 (opened by radix) (CLOSED, fixed) enhancement release management http://twistedmatrix.com/trac/ticket/2363 [#2364] Release TwistedNews-0.3.0 (opened by radix) enhancement news http://twistedmatrix.com/trac/ticket/2364 [#2366] Make filepath work on windows (opened by jknight) defect core http://twistedmatrix.com/trac/ticket/2366 ===== Low ===== [#2345] All POP3 IMailbox should allow Deferred return values (opened by exarkun) enhancement mail http://twistedmatrix.com/trac/ticket/2345 Closed Bugs ______________________ ===== Highest ===== [#1514] twisted.spread.banana check for INT vs. LONGINT will fail on some 64-bit platforms (opened by itamarst, closed by exarkun, fixed) defect pb http://twistedmatrix.com/trac/ticket/1514 [#2284] web2 submitRequest result does not have content-length (opened by ghazel, closed by foom, fixed) defect web2 http://twistedmatrix.com/trac/ticket/2284 [#2344] Typos in AMP docstrings (opened by scmikes, closed by glyph, fixed) defect core http://twistedmatrix.com/trac/ticket/2344 [#2329] Release TwistedCore-2.5 (opened by radix, closed by radix, fixed) enhancement core http://twistedmatrix.com/trac/ticket/2329 [#2330] Release TwistedWeb-0.7 (opened by radix, closed by radix, fixed) enhancement web http://twistedmatrix.com/trac/ticket/2330 ===== High ===== [#1120] OS-X vs PTYProcess, OSError vs IOError (opened by warner, closed by itamarst, ) defect core http://twistedmatrix.com/trac/ticket/1120 [#484 ] manhole gtk2: Gtk-ERROR **: Char offset 1 is off the end of the line aborting... (opened by slyphon, closed by acapnotic, worksforme) defect conch http://twistedmatrix.com/trac/ticket/484 [#2332] Subprojects Efficacy Review (opened by glyph, closed by glyph, fixed) enhancement core http://twistedmatrix.com/trac/ticket/2332 ===== Normal ===== [#1605] twisted.python.components.{getAdapterClass,getAdapterClassWithInheritance} mispell "deprecated" in docstring (opened by exarkun, closed by itamarst, fixed) defect core http://twistedmatrix.com/trac/ticket/1605 [#2302] t.web2.channel.http.HTTPParser deals with HEAD requests incorrectly (opened by ghazel, closed by foom, fixed) defect web2 http://twistedmatrix.com/trac/ticket/2302 [#1619] Reloading html page with unchanged CSS generates traceback (opened by jacob, closed by jknight, duplicate) defect web2 http://twistedmatrix.com/trac/ticket/1619 [#2347] "Register" Trac link not working (opened by tekNico, closed by jknight, fixed) defect website http://twistedmatrix.com/trac/ticket/2347 [#2348] Does the ticket bot still work? (opened by jknight, closed by jknight, invalid) task website http://twistedmatrix.com/trac/ticket/2348 [#2352] Document and enforce deprecation policy (opened by glyph, closed by radix, duplicate) enhancement release management http://twistedmatrix.com/trac/ticket/2352 [#2363] Release TwistedLore-0.3.0 (opened by radix, closed by radix, fixed) enhancement release management http://twistedmatrix.com/trac/ticket/2363 [#2359] Release TwistedConch-0.8 (opened by radix, closed by radix, fixed) task core http://twistedmatrix.com/trac/ticket/2359 [#2360] Release TwistedMail-0.4 (opened by radix, closed by radix, fixed) enhancement mail http://twistedmatrix.com/trac/ticket/2360 [#2361] Release TwistedNames-0.4 (opened by radix, closed by radix, fixed) enhancement names http://twistedmatrix.com/trac/ticket/2361 [#2362] Release TwistedWords-0.5.0 (opened by radix, closed by radix, fixed) enhancement words http://twistedmatrix.com/trac/ticket/2362

1 0

Re: [Twisted-Python] Twisted Adapter
by glyph＠divmod.com 06 Jan '07

06 Jan '07

On 02:09 pm, n_draghetta(a)yahoo.com wrote: >I have a wrapper written in Python for a TLS library written in C. I have to write an adapter in Twisted in order to encrypt the communication. Twisted already includes TLS support via PyOpenSSL. See: http://twistedmatrix.com/documents/current/api/twisted.internet.interfaces.… There are some annoying deficiencies, mainly where PyOpenSSL has left out wrapping an API, but in general it works well. It is certainly possible to plug in your own, but it would involve a fairly deep understanding of the implementation details of both Twisted and your TLS library. If you need some TLS feature that Twisted does not currently provide, your best bet would be looking at this ticket, and contributing patches to help us with it: http://twistedmatrix.com/trac/ticket/2293 We don't wish to fork PyOpenSSL, and certainly are not enthusiastic to maintain it, but the current maintainer seems to have abandoned it, and it would be easier to continue some light maintenance without him than to port to a whole new TLS layer.

1 0

Re: [Twisted-Python] Twisted Adapter
by glyph＠divmod.com 06 Jan '07

06 Jan '07

On 11:12 am, n_draghetta(a)yahoo.com wrote: >Hi all! >I have a wrapper in Python and I want to make an adapter in Twisted so that the wrapper can be used.I haven't found any informations about adapters in Twisted.Can anyone guide me please/send me to a tutorial? What do you mean by "wrapper"? Depending on what you mean, you might not need to write anything at all. Here is a tutorial on Twisted's components / adapters system: http://twistedmatrix.com/projects/core/documentation/howto/components.html and there's something a bit more detailed here, that shows lots of protocol code hooked up to it: http://twistedmatrix.com/projects/core/documentation/howto/tutorial/compone… Do these answer your question?

2 1

[Twisted-Python] Twisted Adapter
by n_draghetta 06 Jan '07

06 Jan '07

Hi all! I have a wrapper in Python and I want to make an adapter in Twisted so that the wrapper can be used.I haven't found any informations about adapters in Twisted.Can anyone guide me please/send me to a tutorial? Thanks. __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

1 0

[Twisted-Python] writing a newsletter manager in Twisted
by Manlio Perillo 04 Jan '07

04 Jan '07

Hi and happy new year. I would like to write a newsletter manager in Twisted, using twisted.mail and twisted.names. I have the following requirements: 1) The sending of mails should be queued. The sending should friendly to server and internet load 2) I should be notified when an email address in unreachable (after n tries) 3) I want to use a caching DNS server, where I should be able to control the TTL (not sure this is a good idea) Is this possible with Twisted and how much code I have to write? A much simpler solution is to just use a MTA like Postfix and a DNS server like Bind, but Twisted is more portable and flexible (?). Thanks Manlio Perillo

3 3

[Twisted-Python] how can i connect curses getch function and a process launched with spawnprocesss?
by Gabriel Santonja 03 Jan '07

03 Jan '07

Hello, first : Happy new year 2007. second : I have some difficulties with curses getch() function and process launch with spawnprocess. I'm newbie in Twisted so i'm using the curses example who work fine with irc factory. i'm using the process howto too But when i try to send a message to a process with a >>> self.transport.writeSequence(contents+"\n") It's work fine with deferred but never with the curses.getch() i need a loop like that : - a caracter is push on the keyboard - getch function of curses send it - this event is processing - a message is send to the process (launch by spawnprocess) who is concerned - a result is send by the process and he is processing by the program i think I need to work with the reactor but i do not know how. I have trie all i can imagine but nothing work. Could you help me? Thanks gabriel

2 2

[Twisted-Python] How do I gracefully handle losing a connection?
by fritz 03 Jan '07

03 Jan '07

Hello all, I'm building off of the ssh client example in the excellent O'Reilly book on Twisted by Abe Fettig but I've run into some problems and I'm not sure how I should proceed. Basically, I've implemented additional methods in order to handle connection issues with the client. The goal being, exiting of the program and printing out an error message detailing why the connection failed: class ClientCommandFactory(protocol.ClientFactory): ... def clientConnectionFailed(self, connector, reason): print reason.getErrorMessage() reactor.stop() class CommandChannel(channel.SSHChannel): ... def closed(self): reactor.stop() def openFailed(self, reason): print reason.getErrorMessage() reactor.stop() class ClientCommandTransport(transport.SSHClientTransport): ... def connectionFailed(self, reason): print reason.getErrorMessage() reactor.stop() def connectionLost(self, reason): print reason.getErrorMessage() reactor.stop() The problem I'm currently facing is that. The connection properly ends and the program exits when bad data is supplied on the command line but when the program exits cleanly CommandChannel.closed() forces a call to ClientCommandTransport.connectionLost() and we see an exception thrown on a connection that I thought should end cleanly: Connection to the other side was lost in a non-clean fashion: Connection lost. Traceback (most recent call last): File "/usr/lib/python2.3/site-packages/twisted/internet/posixbase.py", line 226, in mainLoop self.runUntilCurrent() File "/usr/lib/python2.3/site-packages/twisted/internet/base.py", line 555, in runUntilCurrent call.func(*call.args, **call.kw) File "/usr/lib/python2.3/site-packages/twisted/internet/base.py", line 414, in _continueSystemEvent callable(*args, **kw) File "/usr/lib/python2.3/site-packages/twisted/internet/base.py", line 375, in disconnectAll failure.Failure(main.CONNECTION_LOST)) --- <exception caught here> --- File "/usr/lib/python2.3/site-packages/twisted/python/log.py", line 53, in callWithLogger return callWithContext({"system": lp}, func, *args, **kw) File "/usr/lib/python2.3/site-packages/twisted/python/log.py", line 38, in callWithContext return context.call({ILogContext: newCtx}, func, *args, **kw) File "/usr/lib/python2.3/site-packages/twisted/python/context.py", line 59, in callWithContext return self.currentContext().callWithContext(ctx, func, *args, **kw) File "/usr/lib/python2.3/site-packages/twisted/python/context.py", line 37, in callWithContext return func(*args,**kw) File "/usr/lib/python2.3/site-packages/twisted/internet/tcp.py", line 554, in connectionLost Connection.connectionLost(self, reason) File "/usr/lib/python2.3/site-packages/twisted/internet/tcp.py", line 402, in connectionLost protocol.connectionLost(reason) File "code/python/sshclient/sshclient.py", line 33, in connectionLost reactor.stop() File "/usr/lib/python2.3/site-packages/twisted/internet/base.py", line 342, in stop raise RuntimeError, "can't stop reactor that isn't running" exceptions.RuntimeError: can't stop reactor that isn't running If I remove reactor.stop() from ClientCommandTransport.connectionLost() I then face the issue of some connection problems not being handled correctly and the program will go idle on some bad connections. So my question is, how can I fix my code to handle these exceptions and all cases of bad connections and connections terminating abnormally? Where should I implement connectionLost() and connectionFailed() and how can I cleanly disconnect from the SSH server without seeing ugly errors like the one above? Thanks in advance, Fritz

1 0

[Twisted-Python] a question ablout DeferredList
by hzqij 03 Jan '07

03 Jan '07

i have a sample code about DeferredList like this: from twisted.internet import reactor, defer def printResult(results): for resultInfo in results: success, result = resultInfo if success: print result reactor.stop() def addTen(result): return result + " ten" deferred1 = defer.Deferred() deferred2 = defer.Deferred() deferred3 = defer.Deferred() dl = defer.DeferredList([deferred1, deferred2, deferred3]).addCallback(printResult) deferred1.callback('one') deferred2.callback('two') deferred3.callback('three') reactor.run() then i run this code, it print: one two three but the reactor never stop even i have call reactor.stop() on printResult, i press CTRL+C, some error happen: Unhandled error in Deferred: Traceback (most recent call last): File "/usr/local/lib/python2.4/site-packages/twisted/internet/defer.py", line 317, in _runCallbacks self.result = callback(self.result, *args, **kw) File "/usr/local/lib/python2.4/site-packages/twisted/internet/defer.py", line 507, in _cbDeferred self.callback(self.resultList) File "/usr/local/lib/python2.4/site-packages/twisted/internet/defer.py", line 239, in callback self._startRunCallbacks(result) File "/usr/local/lib/python2.4/site-packages/twisted/internet/defer.py", line 304, in _startRunCallbacks self._runCallbacks() --- <exception caught here> --- File "/usr/local/lib/python2.4/site-packages/twisted/internet/defer.py", line 317, in _runCallbacks self.result = callback(self.result, *args, **kw) File "defer5.py", line 8, in printResult reactor.stop() File "/usr/local/lib/python2.4/site-packages/twisted/internet/base.py", line 342, in stop raise RuntimeError, "can't stop reactor that isn't running" exceptions.RuntimeError: can't stop reactor that isn't running plz help me, thank you!

3 2