Mailman 3 October 2010 - Twisted

[Twisted-Python] connectionLost never reached after calling loseConnection: stuck in CLOSE_WAIT forever
by Stefano Debenedetti Oct. 16, 2010

Oct. 16, 2010

Apologies for the double posting, I am resending this because the original message appears to have triggered some mbox format handling bug somewhere and it appears truncated at the first content line starting with "From" here: http://twistedmatrix.com/pipermail/twisted-python/2010-October/023029.html sorry about this ste -------- Messaggio originale -------- Oggetto: connectionLost never reached after calling loseConnection: stuck in CLOSE_WAIT forever Data: Sat, 16 Oct 2010 17:22:56 +0200 … [View More]Mittente: Stefano Debenedetti <ste(a)demaledetti.net> A: twisted-python(a)twistedmatrix.com Hi, I have a similar problem as described in this old mail [1] except that I am not using threads at all. Basically my app is a server that accepts connections from a client (connection A), when A is established it opens connections B and C to another server and forwards data from A to B and from C back to A. Here is how data is forwarded: def forward(_from, to): _from.dataReceived = to.transport.write to.transport.registerProducer(_from.transport, True) def loseConnection(proto, onlost=lambda *args: None): proto.connectionLost = onlost proto.transport.unregisterProducer() proto.transport.loseConnection() as soon as connectionMade has been called on connection A, B and C: forward(A_protocol, B_protocol) forward(C_protocol, A_protocol) as soon as it decides its job is done and wants to tear down all connections: loseConnection(B_protocol) loseConnection(C_protocol, lambda *a: loseConnection(A_protocol)) The debug logs in my code assure me that the loseConnection function is always called with the A_protocol as argument, yet sometimes and totally unpredictably as far as I can tell connectionLost is not called on some A_protocol instances and corresponding A connections get stuck in CLOSE_WAIT state. Another hint is that netstat shows 1 byte in the Recv-Q for those connections (and 0 in the Send-Q). In another mail [2] in that old thread I got this snippet """ Your issue with CLOSE_WAIT sockets could be due to registering producers which have no further data to produce. """ This sounds like it could be my case, even if as you can see I am always unregistering producers from transports before I call loseConnection on them. Does this sound familiar in any way? Any suggestions off top of head while I try to come up with a self-contained sample which is reliably reproducing the issue I'm seeing happening only "sometimes and quite seldom[TM]"? Thanks, ciao ste [1] http://twistedmatrix.com/pipermail/twisted-python/2008-June/017853.html [2] http://twistedmatrix.com/pipermail/twisted-python/2008-June/017855.html [View Less]

1 0

[Twisted-Python] problem using imap mail client
by jim gardener Oct. 15, 2010

Oct. 15, 2010

hi, I installed twisted on ubuntu lucid .When I checked the version ,it shows Version('twisted', 10, 0, 0) I tried to run imap4client.py giving it hostname='imap.gmail.com' and entered my username and password..When I run the program I am getting "twisted.internet.error.TCPTimedOutError: TCP connection timed out" error. I was able to login and read my gmail using python imaplib though..I am wondering why it doesn't work with twisted thanks jim

5 6

[Twisted-Python] State of "insults"?
by Nathan Oct. 14, 2010

Oct. 14, 2010

JP, what's the current state of the "insults" module you wrote? I'm looking to bolt an ncurses-like client interface onto one of my projects, and I didn't want to reinvent the wheel if it had already been done, so some diligent searching turned up the "insults" module you wrote. There's almost no examples, and the API documentation seems to consist of only method names (which are all very reasonably named), but not much in the way of actual descriptions. Is this a stable, portable module … [View More]

2 2

[Twisted-Python] Missing self.wakeUp() in epoll reactor's callLater
by CARSON Oct. 12, 2010

Oct. 12, 2010

I noticed that callLater in the epollReactor does not actually wake up the reactor; the code for the threaded select reactor, however, does do this via a call to self.wakeUp. It seems like epoll reactor should be patched so that call later ends with self.wakeUp - does this seem correct?

2 1

[Twisted-Python] I am confused on transport.write and transport.writeSomeData
by koder chen Oct. 11, 2010

Oct. 11, 2010

It seems that, when use "self.transport.write" in the protocol implementation, it will buffer the content for a long time before it actually send it out, especially when the size of content is big, is there a 'flush' like method that I can do the flush manually? And when use 'self.transport.writeSomeData', if the size of content to be sent is large, it will not be able to send anything. What is the strategy to use it?

2 2

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com Oct. 10, 2010

Oct. 10, 2010

1 0

[Twisted-Python] Conch for file transfer?
by Laurens Van Houtven Oct. 9, 2010

Oct. 9, 2010

Hi, Is there any documentation about using Conch for file transfer anywhere? I'm interested in doing a continuous deployment thing using it. That means two parts: 1) the ability to submit changes: the hard part here is file transfer of the binary diffs 2) the ability to control a subprocess: basically like supervisord but not written with medusa 3) manual intervention would be nice, so manhole I can't find any documentation or examples, but these classes do exist. I've considered giving up … [View More]

2 2

[Twisted-Python] recommended starting point for http debugging/logging proxy.
by Gelonida Oct. 8, 2010

Oct. 8, 2010

Hi, Can anybody recommend a good starting point for a twisted http proxy, or comment on the links that I'll mention lateron in this post? I'd like to use a ddebugging it for playing/debugging/filtering Initially I'd just like to log all requests. lateron I'd like to save certain responses on the disk. Please note: Im familiar with python and http / html in general. I'm not experienced with twisted, but thought, that this might be a good example / excuseto learn a little. I … [View More]

2 1

[Twisted-Python] patch for TLS
by jason-sage＠creativetrax.com Oct. 7, 2010

Oct. 7, 2010

(cc to both twisted and sage-devel lists) Hi all, In the Sage project (http://sagemath.org), we apply a patch to the Twisted version we distribute. I'd like to clean out our custom patches and push them upstream, if possible. So I have a couple of questions (I'm not terribly familiar with Twisted): 1. Is the patch below generally useful? 2. Is there a better way to do this than to patch the file? 3. What do we need to do to incorporate it upstream in Twisted? PATCH (against the … [View More]

3 2

[Twisted-Python] ConFoo 2011 Call for Speakers
by Yannick Gingras Oct. 6, 2010

Oct. 6, 2010

Greetings Twisters, We, Montréal-Python, are the coordinators of the Python track at ConFoo 2011 and we are very proud to announce our call for speakers. PHP-Québec, Montréal-Python, Montreal.rb, W3Qc, and OWASP Montréal are organizing the first edition of the ConFoo conference, which will be held in Montréal on March 9th through 11th at the Hilton Bonaventure Hotel. With over 500 expected attendees, ConFoo is one of the largest Web development conference in North America. ConFoo is about … [View More]

1 0

[Twisted-Python] Limiting a task.Cooperator to N work units / sec
by Phil Mayers Oct. 3, 2010

Oct. 3, 2010

Is there an easy way to make a task.Cooperator instance only execute N ticks / sec, summed across all iterators it's driving? So if you add two iterators, they each run at N/2 per sec, 3 at N/3, etc. It seems like this ought to do it: N = <rate> def myScheduler(x): # reschedule N times per second reactor.callLater(1.0/N, x) class myTermination: def __call__(self): # stop immediately after one iterator.next() return True myCoop = task.Cooperator( … [View More]

2 4

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com Oct. 3, 2010

Oct. 3, 2010

1 0

[Twisted-Python] getPage generates a traceback in abstract.py
by Jason J. W. Williams Oct. 2, 2010

Oct. 2, 2010

I'm really pulling my hair out here. The code in question uses getPage: http://gist.github.com/607124 If I remove the postdata argument to getPage no problem (except the postdata is required by server I'm calling). However, no matter what I put in postdata, I get this: http://gist.github.com/607126 Any help is greatly appreciated. -J

3 4

[Twisted-Python] Unable to start twistd service on Ubuntu 10.04 when using pseudo terminal
by Garret Heaton Oct. 1, 2010

Oct. 1, 2010

To me this seems like a very strange problem and I've tried to debug it best I can but I don't know much about many of the components at work. Here's what happened: I've been happily using Capistrano to deploy many twistd services to Ubuntu 9.04 machines. It restarts them via an init.d script based off this template: http://twistedmatrix.com/trac/attachment/ticket/3434/twistdplugin. I'm running a self-installed Twisted 8.2.0 on both systems with some small tweaks to logging. On newer Ubuntu … [View More]

2 3

[Twisted-Python] how to write a safe catch-all
by Chris Withers Oct. 1, 2010

Oct. 1, 2010

Hi All, The attached .py file demonstrates a problem I'm having with a little scheduler I need to maintain. The loop() function is supposed to be a "catch all and report" error handler. However, when the async code initiated by doStuff throws the AttributeError, what actually gets logged is: 2010-09-28 14:41:15,706 ERROR : log (14757|7f691ba676e0): Unhandled Error Traceback (most recent call last): File "test_looping.py", line 41, in <module> reactor.run() File … [View More]

5 33