Mailman 3 November 2007 - Twisted

[Twisted-Python] Confused about threads
by Mark L Nov. 19, 2007

Nov. 19, 2007

Hi, I'm new to twisted, and have read a few pages, but things are going over my head and I'm not finding the answer I need. What I want to do is create a class in my python application which manages network activity and starts the reactor. I want to run that class as a thread. I've done all of this, except when I get to reactor.run(). Then it says that signal must be started in main. If I move the reactor.run() into main then it starts up fine - but it doesn't run in a separate thread. I want the network running in the background in a separate thread so I can manage other server tasks distinctly. I realise this is probably a critical misunderstanding on my part of how twisted is meant to be used - so I'd appreciate any clarifications on this point that I wasn't able to find in the documentation. Which, again, is probably just a critical failure of mine to find. Thanks, Mark

3 2

[Twisted-Python] thread performance under twisted
by abbas ali chezgi Nov. 19, 2007

Nov. 19, 2007

hello dears, i am working on a VPN project using twisted. the main section for tunneling data written in C API for performance. but handshaking is done in twisted and when client authenticated one thread is created using deferedToThread and all data encryption and exchange will be done in C code. my problem is performance. how can i tune system (twisted core and threads) to allow created threads run with high priority than twisted core? how can i profile my threads? with best regards, chezgi ================================= chezgi,abbas ali MSC student at computer Architecture Department of Electronic and Computer Engineering Isfahan University of Technology Isfahan Iran email: chezgi(AT)ec(DOT)iut(DOT)ac(DOT)ir ================================= --------------------------------- Be a better pen pal. Text or chat with friends inside Yahoo! Mail. See how.

2 1

[Twisted-Python] Hack Fest! Tomorrow, Monday, San Francisco. Last call.
by zooko Nov. 19, 2007

Nov. 19, 2007

Folks: You are invited to attend a Hack Fest at Allmydata Headquarters in San Francisco. The date is tomorrow, Monday, Nov 19, between the end of Business Hours and midnight. My earlier message [1] invited people to bring source code to demonstrate live on a projector, preferably open-source and/or peer- to-peer source code. Also, you are welcome to come without source code, in order to socialize, eat yummy Goat Hill Pizza (Potrero Hill), see other people's open-source and/or peer-to-peer source code demonstrated, etc. How does one demonstrate source code? Well, we envision having two projector screens, one which shows the source code, and one which shows the resulting application running, and we see how the behavior of the app changes when we change the source code. Perhaps this will lead to submitting patches to our favorite open source projects or something. But in any case, there will definitely be pizza and beer. Please e-mail zooko(a)zooko.com. Regards, Zooko [1] http://lists.zooko.com/pipermail/p2p-hackers/2007-November/ 001441.html

1 0

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com Nov. 18, 2007

Nov. 18, 2007

Bug summary ______________________ Summary for 2007-11-11 through 2007-11-18 Bugs opened: 28 Bugs closed: 15 Total open bugs: 1043 (+13) |== Type Changes |== Priority Changes |== Component Changes |Defect: +2 |Highest: -1 |Conch: +1 |Enhancement: +12 |High: +1 |Core: +3 |Normal: +13 |Release Management: +10 |Low: +1 |Trial: +0 |Vfs: -1 |Web: +1 New / Reopened Bugs ______________________ ===== Highest ===== [#2882] test_process hanging on vista slave (popup)- (opened by bigdog) defect core http://twistedmatrix.com/trac/ticket/2882 [#2885] Automate version updating (goodly) (opened by radix) enhancement release management http://twistedmatrix.com/trac/ticket/2885 [#2893] assertEqual is hard to read. (opened by jml) (CLOSED, fixed) enhancement trial http://twistedmatrix.com/trac/ticket/2893 [#2897] Deprecate visiting test (opened by jml) (CLOSED, fixed) enhancement trial http://twistedmatrix.com/trac/ticket/2897 [#2898] Add ITestCase for Trial tests (opened by jml) (CLOSED, fixed) enhancement trial http://twistedmatrix.com/trac/ticket/2898 [#2899] addCleanup should run even if setUp fails. (opened by jml) (CLOSED, fixed) defect trial http://twistedmatrix.com/trac/ticket/2899 [#2906] Provide framework for decorating tests (opened by jml) enhancement trial http://twistedmatrix.com/trac/ticket/2906 [#2882] test_process hanging on vista slave (popup)- (opened by bigdog) defect core http://twistedmatrix.com/trac/ticket/2882 ===== High ===== [#2881] Add a variable in twisted.python.runtime to check for vista (opened by bigdog) defect core http://twistedmatrix.com/trac/ticket/2881 [#2896] FilePath.exists gives results inconsistent with FilePath.isdir (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2896 ===== Normal ===== [#2883] Remove attributes and methods from IReporter that imply text output (opened by jml) enhancement trial http://twistedmatrix.com/trac/ticket/2883 [#2884] Tool to update / generate NEWS file (opened by radix) enhancement release management http://twistedmatrix.com/trac/ticket/2884 [#2886] Need good code for building Twisted release tarballs. (opened by radix) enhancement release management http://twistedmatrix.com/trac/ticket/2886 [#2887] Automated release announcement (opened by radix) enhancement release management http://twistedmatrix.com/trac/ticket/2887 [#2888] Automate uploading tarballs to TMRC (opened by radix) enhancement release management http://twistedmatrix.com/trac/ticket/2888 [#2889] Automate updating the downloads page and the front page when a new release happens (opened by radix) enhancement release management http://twistedmatrix.com/trac/ticket/2889 [#2890] Automate updating the howtos on the twistedmatrix web site (opened by radix) enhancement release management http://twistedmatrix.com/trac/ticket/2890 [#2891] Automate updating the API docs on the twistedmatrix web site (opened by radix) enhancement release management http://twistedmatrix.com/trac/ticket/2891 [#2892] Holistic release automation tool (opened by radix) enhancement release management http://twistedmatrix.com/trac/ticket/2892 [#2894] twisted.test.test_defer.DeferredTestCase.testMaybeDeferred should be faster and four different tests (opened by exarkun) enhancement core http://twistedmatrix.com/trac/ticket/2894 [#2895] proxyForInterface should make it possible to specify the attribute name that the wrapped object is assigned to (opened by radix) enhancement core http://twistedmatrix.com/trac/ticket/2895 [#2901] proxyForInterface should allow upcalls (opened by jml) enhancement core http://twistedmatrix.com/trac/ticket/2901 [#2902] bad flag value in twisted.conch.ssh.filetransfer (opened by mmoskwa) defect conch http://twistedmatrix.com/trac/ticket/2902 [#2903] Clean up warnings in twisted.trial tests (opened by jml) (CLOSED, wontfix) enhancement trial http://twistedmatrix.com/trac/ticket/2903 [#2904] assertWarns doesn't handle duplicate warnings properly (opened by jml) defect core http://twistedmatrix.com/trac/ticket/2904 [#2905] ReverseProxyResource adds an extra '/' which confuses the backend web server (opened by trohed) defect web http://twistedmatrix.com/trac/ticket/2905 [#2907] "./setup.py install --prefix=relative/path" behaves surprisingly (opened by zooko) enhancement release management http://twistedmatrix.com/trac/ticket/2907 ===== Low ===== [#2900] Provide a way to run a series of tests without restarting the reactor (opened by jml) enhancement trial http://twistedmatrix.com/trac/ticket/2900 Closed Bugs ______________________ ===== Highest ===== [#2882] test_process hanging on vista slave (popup)- (opened by bigdog, closed by bigdog, ) defect core http://twistedmatrix.com/trac/ticket/2882 [#2857] test_stdio doesn't correctly pass the reactor to subprocesses (opened by therve, closed by therve, fixed) defect core http://twistedmatrix.com/trac/ticket/2857 [#2893] assertEqual is hard to read. (opened by jml, closed by jml, fixed) enhancement trial http://twistedmatrix.com/trac/ticket/2893 [#2897] Deprecate visiting test (opened by jml, closed by jml, fixed) enhancement trial http://twistedmatrix.com/trac/ticket/2897 [#2862] [PATCH] Tiny doc tweak for twisted.protocols.amp (opened by dripton, closed by jml, fixed) defect core http://twistedmatrix.com/trac/ticket/2862 [#2899] addCleanup should run even if setUp fails. (opened by jml, closed by jml, fixed) defect trial http://twistedmatrix.com/trac/ticket/2899 [#1264] twisted.vfs.test.test_ftp is enough to drive a sane man mad (opened by exarkun, closed by therve, fixed) defect core http://twistedmatrix.com/trac/ticket/1264 [#2598] Monkey-patching support code (opened by jml, closed by jml, fixed) enhancement core http://twistedmatrix.com/trac/ticket/2598 [#2180] FilesystemLock needs a method that defers until it can acquire a lock (opened by wsanchez, closed by dreid, fixed) enhancement core http://twistedmatrix.com/trac/ticket/2180 [#2898] Add ITestCase for Trial tests (opened by jml, closed by jml, fixed) enhancement trial http://twistedmatrix.com/trac/ticket/2898 ===== High ===== [#1781] Remove TestCase._wait from Trial (opened by jml, closed by jml, wontfix) enhancement trial http://twistedmatrix.com/trac/ticket/1781 ===== Normal ===== [#2785] twisted.trial.itrial.IReporter is missing addSkip (opened by exarkun, closed by jml, fixed) defect trial http://twistedmatrix.com/trac/ticket/2785 [#2735] twisted.vfs.adapters.ftp._FileToConsumerAdapter doesn't fully implement IConsumer (opened by therve, closed by therve, fixed) defect vfs http://twistedmatrix.com/trac/ticket/2735 [#2903] Clean up warnings in twisted.trial tests (opened by jml, closed by jml, wontfix) enhancement trial http://twistedmatrix.com/trac/ticket/2903 [#1950] PyUnitTestCase.id is redundant and should be removed (opened by glyph, closed by jml, fixed) enhancement trial http://twistedmatrix.com/trac/ticket/1950 Ticket Lifetime Stats ______________________ Oldest open ticket - [#38] Should be a way to create documentation aliases (since 2003-07-12 16:08:03). Newest open ticket - [#2907] "./setup.py install --prefix=relative/path" behaves surprisingly (since 2007-11-16 18:21:31). Mean open ticket age: 562 days, 4:41:38.242047. Median: 457 days, 23:55:53.456813. Standard deviation: 411 days, 11:59:35.412533. Interquartile range: 509 days, 1:40:22. Mean time between ticket creation and ticket resolution: 124 days, 23:46:42.342090. Median: 15 days, 13:27:30. Standard deviation is 228 days, 8:13:18.325244. The interquartile range is 136 days, 12:10:27. Mean time spent in review: 68 days, 13:01:08.836530. Median: 3 days, 20:59:56. Standard deviation: 156 days, 6:25:19.237999. Interquartile range: 29 days, 3:11:52. Mean number of times a ticket is reviewed: 2.0623655914. Median: 1 Standard deviation: 1.73960284545. Interquartile range: 1. Contributor Stats ______________________ In the last 4 weeks, 13 unique ticket reporters 5 unique ticket reviewers 7 unique ticket resolvers In the last 24 weeks, 64 unique ticket reporters 15 unique ticket reviewers 14 unique ticket resolvers In the last 48 weeks, 149 unique ticket reporters 17 unique ticket reviewers 24 unique ticket resolvers

1 0

[Twisted-Python] Timing problem with PB Broker's connectionReady
by Alan Franzoni Nov. 17, 2007

Nov. 17, 2007

Hello everybody, I'm running Twisted 2.5 on 32-bit Ubuntu Linux (tested with both Feisty and Gutsy) and python2.5. All packages are the distro's own ones. I'm experiencing a small problem with the broker's connectionReady method on the server side of the PB connection. It's not huge and doesn't cause problems in real-world applications, but it's making more difficult for me to write a proper unit test. According to the docs, connectionReady is called as soon as Banana negotiation is done. This is true on the client side; connectionReady gets called before the client can get the root object from the server. But this is not true on the server side; as you can see from the printout of the attached file, the client says it already has got the server's root object but the connectionready hasn't been called on the server yet. In order to be sure connectionReady has been called on the server side, I must trigger an additional callRemote. I suppose there's some sort of caching or lazy behaviour implied here. Did I do something wrong? How can I force connectionReady to be called on the server side *before* the client can actually fetch the root object's remotereference? Thanks. -- Alan Franzoni <alan.franzoni.xyz(a)gmail.com> - Togli .xyz dalla mia email per contattarmi. Remove .xyz from my address in order to contact me. - GPG Key Fingerprint (Key ID = FE068F3E): 5C77 9DC3 BD5B 3A28 E7BC 921A 0255 42AA FE06 8F3E

2 2

[Twisted-Python] [Fwd: Last chance for PyCon talk & tutorial proposals!]
by Itamar Shtull-Trauring Nov. 16, 2007

Nov. 16, 2007

-- Itamar Shtull-Trauring http://itamarst.org

1 0

[Twisted-Python] Hack Fest -- this coming Monday evening, allmydata.com, San Francisco
by zooko Nov. 16, 2007

Nov. 16, 2007

Folks: We're hosting another Hack Fest at allmydata headquarters in San Francisco! This time will be much like last time [1], but with more emphasis on Real Live Code on projector screens. The fun will begin after the worker drones clock out of their factories at 5 o'clock PM. The fun will probably end sometime before midnight, when we all turn into pumpkins. So please RSVP by e-mailing zooko(a)zooko.com and I will give you directions to our office and the URL for the planning wiki. Plan to bring some Real Live Code if you have any, preferably open-source and/ or peer-to-peer. You get points for demoing your cool project, double-points for demonstrating how you can change the source code before our very eyes to make it do something new, and triple points for committing the results into your revision control repository while the audience watches! We hope to have two projectors working side by side. Allmydata.com will provide projectors, pop, packets, pizza, pillows, and party-favors. Regards, Zooko [1] http://lists.zooko.com/pipermail/p2p-hackers/2007-November/ 001412.html

1 0

[Twisted-Python] profiling live twisted application
by Alec Matusis Nov. 15, 2007

Nov. 15, 2007

What is the best non-intrusive way to profile a live twisted application? We have TCP servers with epoll reactors. We want to optimize them as our usage grows.

6 6

[Twisted-Python] Two main loops
by Bernie Roehl Nov. 15, 2007

Nov. 15, 2007

I've got a 3D game that I've implemented in Python using an existing game engine. The engine "owns" the main loop, i.e. I call engine.run() and it makes callbacks to my application on every frame (and other game event). Now I'm adding networking, and I'd like to use Twisted. However, Twisted uses the same approach as the game engine -- I call reactor.run() and it makes callbacks to my application. So, how do I integrate the two? My first though is to call reactor.run() in a separate thread, but of course that adds additional complexity in terms of synchronization. I notice the docs mention reactor.iterate(), which appears to be designed for exactly what I'm doing. However, it's not clear how to use it, and the method appears to be deprecated. Any suggestions are appreciated... -- Bernie Roehl Mail: broehl(a)gmail.com

8 28

[Twisted-Python] Keeping track of what you're doing
by Jonathan Lange Nov. 15, 2007

Nov. 15, 2007

Hey guys, One of the big problems I've had as a part-time Twisted contributor is keeping track of what the hell I'm doing, or what I should be doing, or what I'm waiting for. Between the listing of my local branches/ directory, my assigned tickets and the review queue things can get confusing. It turns out that Jean-Paul has set up a couple of useful Trac reports and features to help. I thought I'd post them to the list, because they are making my life more pleasant. 1. Review Tickets, By Order You Should Review Them In http://twistedmatrix.com/trac/report/15 This would be a little better if it excluded branches that you authored, but at the moment we don't keep this information. 2. Tickets with Branches This doesn't have a convenient URL. However, you can simply do a custom query for tickets that are open, owned by you and have 'Branch' is not ''. Bookmark it. This is a good way to keep track of the tickets that you have actually started. If you are like me, you use the "Assigned" state fairly haphazardly. It's a good idea to review this list and compare it to the branches in your local directory and the branches in the actual repository so that you can remove stale or merged branches. 3. My Tickets Awaiting Review http://twistedmatrix.com/trac/report/17 This shows tickets that you have put up for review. Thanks to Jean-Paul for setting up these queries and continuing to make our Trac more helpful. jml

1 0