Mailman 3 February 2007 - Twisted

[Twisted-Python] is it possible to use an ORM in Twisted?
by slowtech chen Feb. 12, 2007

Feb. 12, 2007

Hey guys, I know there is adbapi to do database operations for twisted. The way adbapi works is similar to deferToThread in some ways, I guess the difference is adbapi handles some thread issues automatically, and provides a connection pool. So here comes my question: Is it possible to use an ORM by calling deferToThread(ORM operations...), it seems to me that if you take care of the thread issues, this is doable. Even so I have no any clue though :). I am new to Twisted and the above … [View More]

2 1

[Twisted-Python] Possible trial -u / threads bug
by Mark Leonard Feb. 12, 2007

Feb. 12, 2007

Hi, I'm encountering a problem when using deferToThread in a unit test and running it with trial -u. The code below demonstrates the problem. It fails (by timing out) on the second pass. It seems to fail reliably on Twisted 2.5.0 (Python 2.5.0), but on a Twisted 2.0.1 (Python 2.4.1) installation it works just fine. I think the problem is related to trial's cleanup of the threadpool. I did try (as a test) add reactor.threadpool.stop() to tearDown and reactor.threadpool.start() to setUp, … [View More]

2 1

RE: [Twisted-Python] general documentation question
by Jean-Paul Calderone Feb. 11, 2007

Feb. 11, 2007

On Sun, 11 Feb 2007 11:12:47 -0500, Lee Connell <lee.a.connell(a)gmail.com> wrote: >Hi Christopher, > >Thanks for response, yeah connected is public and it's useable If you can't find the documentation for it, how do you know it's public? Jean-Paul

2 2

[Twisted-Python] Removing cruft from logs
by "Einar S. Idsø" Feb. 11, 2007

Feb. 11, 2007

Hi, I am currently developing an application which will first and foremost be an xmlrpc server with an adbapi or sasync backend. The number of xmlrpc-requests is expected to be up to around a hundred per second. Unfortunately, the logging system by default logs the following for each and every request, leading to ridiculous logfiles: 2007/02/11 12:54 CET [HTTPChannel,0,127.0.0.1] 127.0.0.1 - - [11/Feb/2007:11:54:57 +0000] "POST /RPC2 HTTP/1.0" 200 122 "-" "xmlrpclib.py/1.0.1 (by www.… [View More]

3 2

[Twisted-Python] general documentation question
by Lee Connell Feb. 11, 2007

Feb. 11, 2007

I am trying to get use to the documentation in twisted, as I am new to python as well. I am using a LineReceiver class for a client I am building. There are some attributes like “connected, delimiter, transport”. I am having a tough time finding them within the twisted documentation. I’ve looked at all subclasses that I can see that are related to LineReceiver and can’t seem to find where they are defined. I did find a twistedmatrix user that has these listed, but how do I find this in … [View More]

2 2

[Twisted-Python] Howto access protocol outside of the class
by Lee Connell Feb. 11, 2007

Feb. 11, 2007

I have a class: class ForemClient(LineReceiver): I am using wxPython to build a GUI. I am having the hardest time trying to access the instance of this class so I can call the transport methods from a wxPython button event. How can I make this accessible outside of the class itself? I seen that ClientCreator could be used for this, but I can’t find an example of using the instance outside of itself. Anyone able to help? chat = ClientCreator(reactor, ForemClient) d = chat.… [View More]

2 2

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com Feb. 11, 2007

Feb. 11, 2007

1 0

[Twisted-Python] wxreactor.install() issues
by Lee Connell Feb. 10, 2007

Feb. 10, 2007

When using wxreactor.install() on GUI apps it prevents the wx.xrc classes from working right. In my case I am subclassing the HtmlWindow class in my .xrc file created with XRCed. What happens here is it prevents wx.xrc from recognizing whatever my subclass is. If I take the wxreactor.install() out it works just fine. -- No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.441 / Virus Database: 268.17.33/678 - Release Date: 2/9/2007 4:06 PM

1 0

[Twisted-Python] wxReactor and twisted question
by Lee Connell Feb. 10, 2007

Feb. 10, 2007

I want to access protocol and transport from within my wxPython app. How do I do this? Since the ClientFactory is not an instance I can’t call the sendLine() methods on it. I’m not sure how to access protocol and factory from within a wx.App class. I’ve attached my code. -Lee -- No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.441 / Virus Database: 268.17.33/678 - Release Date: 2/9/2007 4:06 PM

1 0

[Twisted-Python] Using twisted.trial with nose unittest system
by Allen Bierbaum Feb. 9, 2007

Feb. 9, 2007

Has anyone tried/succeded at using twisted.trial with the nose unittest system? The twisted.trial system works well for pure twisted testing but I would like to get some of the advaned capabilities of nose in there as well. Any advice would be greatly appreciated. Thanks, Allen

4 9

[Twisted-Python] Something strange about cred
by Stephen Waterbury Feb. 9, 2007

Feb. 9, 2007

I think I've found the problem with trying to use my UserDbCredChecker with the web2 auth example. [The reason I'm posting this to the twisted list rather than twisted-web is because I think it points to a possible problem with cred (or at least some confusing names), which is not specifically web.] I believe the problem is with ICredentials. Its interface docstring says "I check credentials." -- first of all, this is counter-intuitive to me. IMO should either say "I *am* credentials", or … [View More]

5 11

[Twisted-Python] Question about Foolscap Slicers and Unslicers.
by kgi Feb. 9, 2007

Feb. 9, 2007

Hi all (and Brian in particular); I've got a few questions about Foolscap Slicers and Unslicers. The documentation I'm reading is at: http://twistedmatrix.com/~warner/Foolscap/using-pb.html In it, a code fragment of custom slicing is given: class ListSlicer(BaseSlicer): opentype = ("list",) slices = list The docs then say in the next paragraph: """ Slicer registration can be either explicit or implicit. In this example, an implicit registration is used: by setting … [View More]the slices attribute to the list type, the BaseSlicer's metaclass automatically registers the mapping from list to ListSlicer. To explicitly register a slicer, just leave opentype set to None (to disable auto-registration), and then register the slicer manually. """ ... and then quote an example of this: class TupleSlicer(BaseSlicer): opentype = ("tuple",) slices = None ... registerAdapter(TupleSlicer, tuple, pb.ISlicer) The problem is that the code sets *slices* to None, but the text talks about setting *opentype* to None. I'd be inclined to think the code is right, except the text says the same sort of thing happens later on when talking about Unslicers: """ If the Unslicer has a non-None class attribute named opentype, then it is automatically registered. If it does not have this attribute (or if it is set to None), then no registration is performed, and the Unslicer must be manually registered: """ Which is it? Actually, my real question is: what are the exact uses of "opentype" and "slices" respectively? I suspect that "slices" refers to the type being sliced, and "opentype" is something low-level to do with the slicing process (maybe the symbol inserted in the output stream?). Why is is (seemingly always) a 1-tuple? Lastly (secondly?) there is some text in the document: http://twistedmatrix.com/~warner/Foolscap/specifications/pb.html under the paragraph heading, "Arbitrary Instances are NOT serialized" that says: """ Both ends must be willing to transport the object. The sending side expresses this by marking the class (subclassing Copyable, or registering an ISlicer adapter). """ To me this appears to imply that each of the various ways of transporting a non-fundamental type is as good as any other: if I have a subclassed Copyable then I wouldn't need an ISlicer adapter, and vice versa. Is this true? Does this mutual relationship hold true for ISlicer-registered types and types making use of foolscap.registerRemoteCopyFactory()? I'm asking because I have some types for which I have called registerRemoteCopyFactory() yet for which I get an exception saying that the object is not sliceable (implying that I need to take the ISlicer approach and that the registerRemoteCopyFactory() approach is no longer good enough). I'm using Python 2.4, Twisted 2.5.0 and head-of-SVN Foolscap. Cheers, Ricky [View Less]

1 0

[Twisted-Python] Re: [Twisted-commits] r19592 - Author: therve
by Itamar Shtull-Trauring Feb. 9, 2007

Feb. 9, 2007

On Fri, 2007-02-09 at 08:09 -0700, Thomas Herve wrote: > + # If the test failed the process may already be dead > + # The error here is only noise > + pass Actually it's the other way around, I think...

2 1

[Twisted-Python] Re: [Twisted-commits] r19594 - Initial observer
by Itamar Shtull-Trauring Feb. 9, 2007

Feb. 9, 2007

As long as you're at it, all the horrible code in emit ideally should be factored out into a utility function, instead of being duplicated.

1 0

Re: [Twisted-Python] questions about large db queries and memory leak
by slowtech chen Feb. 9, 2007

Feb. 9, 2007

From: Mark Leonard <mwl(a)point45.com> >If you're not running Python >= 2.5.0 this might be relevant: >http://evanjones.ca/python-memory.html Yes, I am using Python 2.4., I'll dig into it, thanks for the pointing regards, Chen ____________________________________________________________________________________ Sucker-punch spam with award-winning protection. Try the free Yahoo! Mail Beta. http://advision.webevents.yahoo.com/mailbeta/features_spam.html

1 0

Re: [Twisted-Python] questions about large db queries and memory leak
by slowtech chen Feb. 9, 2007

Feb. 9, 2007

From: Thomas Hervé <therve(a)free.fr> >I guess you use adbapi ? The performance are generally not a problem with db >queries because most of the job is done on the DB, not on the client. I've got >servers that makes hundreds requests against Postgres/MySQL/sqlite without >problems. Yes, I will use adbapi and MySQL, good to hear that. regards, Chen ____________________________________________________________________________________ Do you Yahoo!? Everyone is raving … [View More]

1 0

[Twisted-Python] Support for ICMP ping?
by Nicolas D. Cesar Feb. 8, 2007

Feb. 8, 2007

I've been googling if there is any 'ICMP ping' support in Twisted. I've encounter ancient replies: http://twistedmatrix.com/pipermail/twisted-python/2003-August/005542.html I wonder if today is any ICMP support. I've tried to search the source tree[1], and doesn't seem. My actual needs is creating a DeferredList with "ping-testers" for different IPs, just to check if there up or not. I know I can end up using twisted.internet.utils.getProcessOutput and calling ping, as I would normally … [View More]

5 7

Re: [Twisted-Python] Something strange about cred
by glyph＠divmod.com Feb. 8, 2007

Feb. 8, 2007

On 03:16 pm, stephen.c.waterbury(a)nasa.gov wrote: >P.S. Sorry I can't irc from work -- NASA/GSFC IT policy >doesn't allow that. :( Clearly you're allowed to exchange messages with dangerous subversives like us, so would it help if we wrote an IRC-via-SMTP proxy? ;-)

3 2

[Twisted-Python] startLogging
by Martin Evans Feb. 8, 2007

Feb. 8, 2007

Are there any samples on how best to interact with logging? My server needs to log quite a few items, as such the log file is growing quite quickly and I would like to be able to switch file names on a daily basis. I would also probably then wish to delete logs older than 14 days. I'm not sure how safe it would be to just keep calling startLogging() with a different file name mid-session. I realise there has been some discussion about this area recently. Thanks, Martin

6 5

[Twisted-Python] wxreactor, serialport, and Windows
by Andy.Henshaw＠gtri.gatech.edu Feb. 8, 2007

Feb. 8, 2007

I have some twisted code that supports forwarding serial port data to a tcp socket. The code needs to run on Windows, so I'm using the win32eventreactor, as is required by the twisted.internet.serialport code. Now, I need to marry it to a wxPython GUI. Is there any reasonable way to support the twisted.internet.serialport code using wxreactor?

5 6

[Twisted-Python] questions about large db queries and memory leak
by slowtech chen Feb. 8, 2007

Feb. 8, 2007

Hey guys, I've been using twisted for a couple days, I like it very much. And there are some stuffs I 'm still not quite get: - I like the asyn way twisted provides, but when using RDBMS, I have to spawn other threads out of the main event loop. this seems weird and I 'm wondering how the performance would be when you've got a lot of concurrent db queries. - Did anyone come into memory leak on twisted server? 'cause when I tested our twisted server today ,the memory usage became 75% … [View More]

3 2

Re: [Twisted-Python] Re: Using twisted.trial with nose unittest system
by glyph＠divmod.com Feb. 8, 2007

Feb. 8, 2007

On 05:36 pm, antoine.pitrou(a)wengo.com wrote: >> More serious than the process-running issue, from my point of view, is >> the fact that if you forget the "@deferred" decorator on a test that >> uses any reactor API, or code that internally _uses_ any reactor API, >> you will put your tests into a non-deterministic state, and although >> they'll pass _most_ of the time, they will die depending on the load >> characteristics of your machine at the time and (… [View More]

3 2

Re: [Twisted-Python] amptypes 0.1
by glyph＠divmod.com Feb. 8, 2007

Feb. 8, 2007

On 07:58 pm, thostrup(a)gmail.com wrote: >Hi > >I've created a couple of extension types for the AMP protocol. Thanks! Would you consider contributing these to Twisted proper? Aside from a few very minor cleanups (test naming convention, a few missing docstrings) these look great.

2 1

Re: [Twisted-Python] Re: Using twisted.trial with nose unittest system
by glyph＠divmod.com Feb. 7, 2007

Feb. 7, 2007

On 09:53 pm, mithrandi-twisted-python(a)mithrandi.za.net wrote: >* glyph(a)divmod.com <glyph(a)divmod.com> [2007-02-07 21:24:18 -0000]: > >> ... and nose doesn't yet support being apt-get installed ;-) > >mithrandi@elvardein:~> sudo apt-get install python-nose Well! Egg on my face, there. Where's the apt line?

2 1

Re: [Twisted-Python] Re: Using twisted.trial with nose unittest system
by glyph＠divmod.com Feb. 7, 2007

Feb. 7, 2007

On 03:32 pm, antoine.pitrou(a)wengo.com wrote: > >Hi Jean-Paul, > >> The one practical problem which this method of integration has is that >> it will not allow unit tests to run child processes. So, one wouldn't >> be able to run Twisted's test suite with nose using this. Of course, >> if one has no interest in running tests which run child processes, then >> this may not be a big deal. > >Do you mean because the reactor does not receive signals? … [View More]Yes. Also, it's highly likely that the tests won't stop cleanly on ^C. More serious than the process-running issue, from my point of view, is the fact that if you forget the "@deferred" decorator on a test that uses any reactor API, or code that internally _uses_ any reactor API, you will put your tests into a non-deterministic state, and although they'll pass _most_ of the time, they will die depending on the load characteristics of your machine at the time and (insert long-winded rant about the evil things threads do to your code here). Tests are exactly the place you never want this to happen :). The documentation for this module should be clear on the fact that Twisted-using tests are _absolutely required_ to use the decorator, even if they don't need to wait on a deferred. Of course, that implies that the "you must return a twisted Deferred" message should probably be removed and that case dealt with. Also, setUp and tearDown methods also need the decorator applied, I think, not just test methods. All in all it seems like it would be simpler to just use trials' TestCase class with nose. Is there any reason not to? >> >Let me give a few points as for nose vs. Trial : You are welcome to use nose, of course, but some of these reasons sounded kind of flimsy to me. >> >- nose does not depend on Twisted. Unless all your Python projects make >> >use of Twisted, you certainly don't like having to use a different >> >testing tool depending on the project. Trial doesn't force your code to make use of Twisted, and as Mr. Lange has declared previously, it goes to some lengths to be compatible with stdlib unit tests. It can run and discover stdlib tests, as well as being run by the stdlib runner, and I've used it to test tiny projects which do not use Twisted code anywhere. So, Trial only requires Twisted insofar as Nose requires Nose. It's part of its implementation. If you use Twisted for _any_ of your development, it's already installed. >> >- nose has nice features, including the ability to write tests as >> >functions without having to write classes This just sounds like TIMTOWTDI to me. I *like* the fact that all test methods look the same ;). >> >- nose has a plugin system which already provides several extensions In the spirit of completeness, see trial's --help-reporters and --reporter option. These are discovered using plugins. Please do not take this argument seriously though. :) There is widespread consensus that this plugin API is not very good and it is likely to change. Still, it exists and you can use it. See: http://twistedmatrix.com/trac/browser/sandbox/exarkun/merit/trunk/twisted/p… Although, perhaps the utility of the plugin system is decreased more by the fact that nobody knows about it than by its sub-optimal API, which leads into your next point... >> >- nose is documented This is a very, very good point. Trial's documentation is extremely weak. Does anyone (and by "anyone" I mean "anyone but JML, who has already done more work on trial than any reasonable person ever would") want to volunteer to write a "test driven development with Twisted" lore document? I've introduced many people to Twisted in recent weeks, and each time I ended up having to do a live demonstration of how to write a test module, how to run the trial command line, and (for those lucky enough to use emacs) how to get twisted-dev.el loaded so that f9 will do the right thing. This stuff isn't clear even to people already familiar with Python and unit testing, let alone to people who are learning TDD for the first time with trial. [View Less]

4 3