Mailman 3 March 2012 - Twisted

[Twisted-Python] How to Improve Twisted efficiency
by Peng Xiao -X (penxiao - Digital China at Cisco) March 13, 2012

March 13, 2012

Hi experts, I wrote a TCP client program used twisted to receive lots of data from the server and decode them for analysis. But the efficiency is ugly. I used “profile” and “pstats” to analysis and found selectreactor.py is time consuming. what is selectreactor.py used for? How can I improve that? Very thanks. 2012-03-13 17:46:10+0800 [-] Tue Mar 13 17:46:10 2012 astar_prof.txt 2012-03-13 17:46:10+0800 [-] 2012-03-13 17:46:10+0800 [-] 9111 function calls (9070 … [View More]

2 1

[Twisted-Python] Distributed system programming
by nivedita datta March 11, 2012

March 11, 2012

Hi, I have the following query "Can programming for distributed system done using twisted? If yes, kindly provide some resource to get started. If not, please suggest any existing module for the same on python." Regards, Nivedita

2 2

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com March 11, 2012

March 11, 2012

1 0

[Twisted-Python] ampoule & cx_Freeze
by gelin yan March 9, 2012

March 9, 2012

Hi All Have your guys used cx_Freeze & ampoule? I did try to make a standalone executable app with ampoule; however, the program failed to execute at the early stage of starting. I noticed an exception raised on utils.py: p = FilePath(__main__.__file__) AttributeError: 'module' object has no attribute __file__. I guess once the main file is tuned into the executable one, __file__ will be removed. It looks like ampoule need this attribute. Any idea? Thanks gelin yan

2 2

[Twisted-Python] Twisted TCP Window Full due to time-consuming fuction
by Peng Xiao -X (penxiao - Digital China at Cisco) March 7, 2012

March 7, 2012

Hi experts I have a program written by twisted to receive data from the server. But the speed is a little slow. The problem happened in the code below def dataReceived(self, data): """ Appends newly received data to the receive buffer, and then attempts to parse as many messages as possible. """ # Buffer possibly incomplete data first self.receiveBuffer += data # Attempt to parse as many … [View More]

2 1

[Twisted-Python] Question : PyNotify call from twist daemon
by bino oetomo March 6, 2012

March 6, 2012

Dear All ... I have a Serial service in my twisted script Inside my 'class ArduinoReceiver(LineReceiver):' , I have a function like : ---START---- def setdisplay(self, dispmode): global mynotify self.ntf_title = 'TOMBOL' self.ntf_body = 'Coba aja' try : mynotify.close() except : pass print 'Try to display button notification %s' % (dispmode) mynotify = pynotify.Notification(self.ntf_title, self.… [View More]

2 4

Re: [Twisted-Python] Twisted/PyPy rocks!
by Itamar Turner-Trauring March 4, 2012

March 4, 2012

> Couple of points: > > * Have been able to use poll reactor on Linux, but epoll doesnt work .. is > that expected? Maybe because the epoll reactor implementation uses Twisted > own C wrapper instead of the - only > recently - available one in Python standard lib? That was fixed in trunk recently, you could try that. > * I will test PyPy with kqueue on FreeBSD .. > > * Are there regular buildslaves running trial on PyPy? Does that make > sense? Hopefully soon, … [View More]

4 6

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com March 4, 2012

March 4, 2012

1 0

[Twisted-Python] Twisted+PyPy+kqueue => rocks^2!
by Tobias Oberstein March 3, 2012

March 3, 2012

It's flying;) I've added kqueue support to PyPy and got it running with Twisted/PyPy on FreeBSD. https://bitbucket.org/pypy/pypy/pull-request/29/finish-kqueue-support Tested with Twisted trunk ('cause of #1918 kqueue support in Twisted) and hammered with a WebSocket testsuite. Twisted trial not yet .. Marketing blurb: "Twisted/PyPy's best supported platform is now BSD (less Linux, since of #3114)" Sorry, couldn't resist saying that;) \Tobias

1 0

[Twisted-Python] Twisted reactor cpu usage
by Ilya Biin March 2, 2012

March 2, 2012

I'm using epoll reactor and sample HTTP Proxy realization. From another process i'm executing ~30 HTTP requests per second and twisted process is consuming 10% cpu The profiler output is: 937706 function calls (934675 primitive calls) in 59.988 CPU seconds Ordered by: cumulative time List reduced from 312 to 15 due to restriction <15> ncalls tottime percall cumtime percall filename:lineno(function) … [View More] 1 0.000 0.000 59.988 59.988 base.py:1167(run) 1 0.076 0.076 59.988 59.988 base.py:1172(mainLoop) 12697 55.456 0.004 59.253 0.005 epollreactor.py:169(doPoll) 13553 0.086 0.000 3.797 0.000 log.py:71(callWithLogger) 13553 0.096 0.000 3.691 0.000 log.py:66(callWithContext) 13553 0.047 0.000 3.481 0.000 context.py:117(callWithContext) 13553 0.067 0.000 3.426 0.000 context.py:61(callWithContext) 13552 0.095 0.000 3.359 0.000 posixbase.py:544(_doReadOrWrite) 5454 0.097 0.000 1.736 0.000 tcp.py:182(doRead) 5453 0.167 0.000 1.639 0.000 basic.py:543(dataReceived) 12697 0.095 0.000 0.587 0.000 base.py:762(runUntilCurrent) 4453 0.025 0.000 0.574 0.000 http.py:495(rawDataReceived) 6000 0.036 0.000 0.547 0.000 http.py:1515(lineReceived) 2000 0.029 0.000 0.454 0.000 tcp.py:371(doConnect) 5098 0.104 0.000 0.428 0.000 abstract.py:212(doWrite) 937706 function calls (934675 primitive calls) in 59.988 CPU seconds Ordered by: internal time List reduced from 312 to 15 due to restriction <15> ncalls tottime percall cumtime percall filename:lineno(function) 12697 55.456 0.004 59.253 0.005 epollreactor.py:169(doPoll) 59101 0.277 0.000 0.277 0.000 <string>:1(fileno) 5098 0.252 0.000 0.252 0.000 tcp.py:212(writeSomeData) 24453 0.198 0.000 0.198 0.000 __init__.py:1230(getEffectiveLevel) 5453 0.167 0.000 1.639 0.000 basic.py:543(dataReceived) 5098 0.104 0.000 0.428 0.000 abstract.py:212(doWrite) 5454 0.097 0.000 1.736 0.000 tcp.py:182(doRead) 13553 0.096 0.000 3.691 0.000 log.py:66(callWithContext) 12697 0.095 0.000 0.587 0.000 base.py:762(runUntilCurrent) 13552 0.095 0.000 3.359 0.000 posixbase.py:544(_doReadOrWrite) 13553 0.086 0.000 3.797 0.000 log.py:71(callWithLogger) 1 0.076 0.076 59.988 59.988 base.py:1172(mainLoop) 16556 0.074 0.000 0.074 0.000 context.py:86(getContext) 17451 0.073 0.000 0.094 0.000 epollreactor.py:71(_add) 17098 0.068 0.000 0.085 0.000 epollreactor.py:112(_remove) What is wrong? Why twisted perfomance is so poor here? -- Ilya Biin [View Less]

4 10

[Twisted-Python] Non-PDF version of the Twisted book?
by Daniel Bryan March 2, 2012

March 2, 2012

I'm new to Twisted and very interested in learning more, and I learn best with something like a book. I came across this: *twisted*matrix.com/documents/current/core/howto/*book*.pdf I was wondering if there's a copy of it available in a form other than PDF? I'd like to read it on my Kindle, so if there's a version in an eBook format or even just HTML that'd be superb!

5 4

[Twisted-Python] Twisted/PyPy rocks!
by Tobias Oberstein March 1, 2012

March 1, 2012

Just wanted to say: PyPy running Twisted rocks! Works just out of the box: PyPy, Twisted + Autobahn. Speedups of up to multiple times .. without a single code change. Btw: * Tornado seems to be unstable on PyPy .. at least in my testing (sporadic segfaults) * have been able to outperform node.js and others (incl. JVM) based WebSocket implementations * only beaten by websocket++ - a C++/ASIO based implementation. expected. == Couple of points: * Have been able to use poll reactor on Linux, … [View More]

2 1

[Twisted-Python] connectionMade, TLS and DoS protection timeouts
by Tobias Oberstein March 1, 2012

March 1, 2012

I was wondering how I could protect a Twisted server from evil clients initiating, but never completing a TLS handshake. connectionMade is only called when the TLS handshake has completed, right? When doing listenSSL, is there a hook which is fired right after the TCP handshake is complete, before the TLS handshake begins, so that I can setup a callLater/dropConnection timeout? This is the piece I am missing, since for TCP-level protection (Syn floods etc), I can use kernel parameters / … [View More]

3 5

[Twisted-Python] ProcessMonitor stderr stdout
by Kevin McIntyre March 1, 2012

March 1, 2012

Newbie question: I'm calling addProcess and everything works well, but I'm trying to understand how to capture/handle stderr stdout for that spawned process. -- Kevin McIntyre | Software Engineer | *Green Charge Networks* Cell 718-249-5058 | kmcintyre(a)greenchargenet.com | www.greenchargenet.com

3 2