Mailman 3 March 2012 - Twisted

[Twisted-Python] How to use multi-core CPU in Twisted
by Peng Xiao -X (penxiao - Digital China at Cisco) 26 Mar '12

26 Mar '12

Hi experts I want to use multi-core of CPU in twisted for parallel programming. Could anyone tell me how to archive that? Very thanks. Best Regards, Xiao Peng

2 1

[Twisted-Python] Start New Employment Today
by corydodt＠twistedmatrix.com 26 Mar '12

26 Mar '12

I would like to take this time to welcome you to our hiring process and give you a brief synopsis of the position's benefits and requirements. If you are taking a career break, are on a maternity leave, recently retired or simply looking for some part-time job, this position is for you. Occupation: Flexible schedule 2 to 8 hours per day. We can guarantee a minimum 20 hrs/week occupation Salary: Starting salary is 2000 EUR per month plus commission, paid every month. Business hours: 9:00 AM to 5:00 PM, MON-FRI, 9:00 AM to 1:00 PM SAT or part time (Europe time). Region: Europe. Please note that there are no startup fees or deposits to start working for us. To request an application form, schedule your interview and receive more information about this position please reply to Garland(a)jobdayseu.com,with your personal identification number for this position IDNO: 3315

1 0

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 25 Mar '12

25 Mar '12

1 0

[Twisted-Python] when will failure.Failure() be a problem?
by gelin yan 24 Mar '12

24 Mar '12

Hi All As regards issues like #5567 & #4219, Failure object creation is not thread safe. I use deferToThread daily due to many blocking apis still have to be used in my system. I looked into the code and noticed there is a global count used in Failure.__init__. An increment will be made for every __init__ invoke. I consider it is one part can be treated as thread unsafe. Because I didn't use Failure() besides of logging exec_info and didn't meet any crash issue related to Failure() so I consider it is not a serious problem. I am curious who has experience like system crash or data corruption with Failure. Regards gelin yan

3 3

Re: [Twisted-Python] [Twisted-commits] r33889 - Merge elementresource-5395: Add renderElement, for rendering Elements.
by Itamar Turner-Trauring 23 Mar '12

23 Mar '12

On 03/16/2012 10:51 PM, dreid(a)wolfwood.twistedmatrix.com wrote: > Author: dreid > Date: Fri Mar 16 20:51:46 2012 > New Revision: 33889 > > Added: > trunk/twisted/web/topfiles/5395.feature > - copied unchanged from r33888, /branches/elementresource-5395/twisted/web/topfiles/5395.feature > Modified: > trunk/twisted/web/template.py > trunk/twisted/web/test/test_template.py I notice no documentation was added. Perhaps we should start requiring documentation updates for all new features?

4 9

[Twisted-Python] questions about twisted usage
by Uri Okrent 22 Mar '12

22 Mar '12

Hello all, I'm a twisted novice, but I was brought on to a project where twisted is pretty heavily in use. I'm running into all sorts of issues that make me wonder if we're using twisted properly or as it was intended. I have been through the documentation, but I think I need more in-depth answers. So here are a bunch of general questions about twisted. Once I understand this stuff I think I might be able to ask more cogent questions about my specific implementation (or maybe understand why things are the way they are). 1. Is deferToThread running the function in a real python thread? Should this be used (rather than a standard deferred) for any function that might block? 2. I understand that deferreds run "later". However, once a deferred (or a deferToThread) is picked up and run, does it run from start to finish? Can it be interrupted in the middle of the function? How about its callback/errback? Can another deferred jump in for processing in between a deferred and it's callback/errback, or in the middle of processing another deferred? 3. Are there any guarantees regarding the order of execution of deferreds? (I.e., are deferreds processed in the order in which they are created?) 4. Related to #2, and #3, does it make sense to use twisted when requests that are serviced may depend on one another. For example, a client makes a request 'add-A' which is deferred (so that the server can keep processing requests), and immediately afterwards makes a request 'modify-A' (which is also run as a deferred). Can I count on add-A being done so that modify-A doesn't attempt to work on something which hasn't been created yet? 5. Related to all of the above. What If I want to modify a database inside a deferred? Is that incorrect usage? Specifically, if all my requests run as deferred, and they all start a transaction and the beginning, and commit the transaction at the end, will I run into problems due to context switching in the middle of deferreds? (such as one request committing for both requests, starting two transactions in a row, committing twice in a row, and so on.) Thanks in advance. Please let me know if I'm so off that my questions don't even make sense =) -- Uri Please consider the environment before printing this message. http://wwf.panda.org/savepaper/

6 11

[Twisted-Python] [ANN]: Autobahn WebSockets new release
by Tobias Oberstein 22 Mar '12

22 Mar '12

New releases of AutobahnPython and AutobahnTestSuite completed: AutobahnPython ========================== Release 0.5.0 of AutobahnPython is done, including a bunch of new features, improvements and some fixes: WebSocket: - DoS protection: WS opening handshake timeouts (configurable) - DoS protection: failing TCP by drop vs abort (configurable) - performance: optimized buffer management - performance: optimized/pluggable frame maskers - performance: PyPy compatibility/testing - performance: IOCP/epoll/kqueue compatibility/testing - feature: prepareMessage/sendPreparedMessage - feature: for WSS clients, automatically create TLS context - feature: user agent WS support detection helper WAMP: - feature: exclude/eligible lists for publish - feature: Welcome message implemented - performance: optimized msg dispatch to subscribers Misc: - polished / completed docs Links: - Package: http://pypi.python.org/pypi/autobahn - Source: https://github.com/tavendo/AutobahnPython - Reference: http://autobahn.ws/developers/reference/python/index.html - Home (under construction): http://autobahn.ws/developers/autobahnpython AutobahnTestSuite ========================== New release of AutobahnTestSuite: - now comes completely packaged on PyPi - installs as a single tool: "wstest" - wstest includes 12 modes The modes: - fuzzing: the known fuzzing client/server doing the WS test suite dance - echo: simple WS echo client and server for testing - broadcast: simple WS broadcast server and client driver for testing - testee: client and server to test Autobahn itself - wamp: test client and server for WAMP implementors and - wsperfcontrol / wsperfmaster: We have started collaborating with the WebSocket++ project (Peter Thorson) to build a distributed WS load generator / performance testing tool. This will allow running multiple instances of the "wsperf" load generator/probe distributed both in LAN and WAN. The probe will produce load / tests onto a testee target WS server. AutobahnTestSuite will act as a controller for the probes, aggregate results, produce web UI, .. This thing is preliminary / still in the cooking .. but I think it has the potential to take "WS testing" to the next level. Links: - Package: http://pypi.python.org/pypi/autobahntestsuite - Source: https://github.com/tavendo/AutobahnTestSuite - Docs: http://autobahn.ws/testsuite - wsperf: http://www.zaphoyd.com/wsperf Misc Pointers ============== - AutobahnTestSuite (the WebSocket testsuite) : has been split off into own repo / package - AutobahnJS (WAMP/JS implementation) : also was split off An overview of all Autobahn related code repos on GitHub: http://autobahn.ws/developers/code A documentation of WAMP (The WebSocket Application Messaging Protocol) - asynchronous RPC/PubSub over WebSocket is started on http://wamp.ws/

1 0

[Twisted-Python] unhandled error in example pb_client.py
by Wolfgang Rohdewald 20 Mar '12

20 Mar '12

this is twisted 11.0.0 on kubuntu 11.10 if I call cd /usr/share/doc/python-twisted-words/examples/pb_client.py python pb_client.py fdfdasfdfdas.com 1000 a b c I am getting an unhandled error. Same for servers not answering or rejecting. how would I have to modify pb_client if I want to catch and handle all errors? my real-world problem is more complicated: In case of error I show a modal Qt4 message box. This gives me interactions between twisted and qt4reactor leading to infinite recursion. I can fix that for DNS lookup failure and not answering servers by temporarily disabling qt4reactor, but for rejecting servers I cannot get rid of the unhandled error. But before tackling that, I want to understand how I can really catch and handle all errors. when that works I will have one more problem: I my case I have class myClient(pb.PBClientFactory): def clientConnectionFailed(self, connector, reason): """connection from client to server failed""" print 'getErrorMessage:', repr(reason.getErrorMessage()) which gives me "DNS lookup failed: address u'fdksfsfa0s0f.com' not found: [Errno -5] Zu diesem Hostnamen geh\xc3\xb6rt keine Adresse." so it is translated to German. But pb_client.py returns english messages if I insert and use myClient. $LANG is the same for both: de_DE.UTF-8 so why does pb_client not translate the message? -- Wolfgang

2 1

[Twisted-Python] Problem about Multithread
by hz hanks 18 Mar '12

18 Mar '12

Hi, All I just started Twisted and I've a problem when using it. I want to write a program for both the client and the server that the client can download something from the server. Therefore, I want every client and server pair can use multithread to download the different parts of the files at the same time in order to increase the download speed. But I just know how to send simple message between server and client, such as protocol.Protocol.dataReceived. Any one can give me some advice. Very appreciated! Best, Hanks

3 3

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 18 Mar '12

18 Mar '12

1 0