Mailman 3 October 2002 - Twisted

[Twisted-Python] New UDP API
by Itamar Shtull-Trauring Oct. 30, 2002

Oct. 30, 2002

I just checked in a refactored UDP API into CVS. Please take a look and comment. -- Itamar Shtull-Trauring http://itamarst.org/ Available for Python, Twisted, Zope and Java consulting

1 1

[Twisted-Python] addWriter
by Scherbina, Alexander (ASCHERBI) Oct. 30, 2002

Oct. 30, 2002

Hello Everyone! I have a server that queues messages for clients. The Queue object has a callback from the ConnectionFactory, which deals with output formatting and holds the Protocol object. As soon as a client connects, the ConnectionFactory peeks in the Queue for messages to be sent. And if there are any, it will send and dequeue and peek again until the Queue is exhausted. Once it's exhausted, the ConnectionFactory will be called (using the callback) by the Queue when the next message is enqueued by the Deliver module. So far, this mechanism works well. But one of its flaws is the partial write situation. If output buffer overflow occurred, I would like to continue doing other things and get called back by the Reactor when the socket is writable again. Moreover, I would like to break the direct association between the Queue and the ConnectionFactory. Instead, I would like to tie them through some kind of a notification strategy (like in ACE), where my ConnectionFactory would be notifed by the Reactor when the socket is writable, then the ConnectionFactory could peek, send, dequeue and wait for the next notification. I thought, addWriter/doWrite is what I need to use. When I used them, my ConnectionFactory's doWrite was never called after a client connected. Is addWriter/doWrite approach correct? Or am I going in a totally wrong direction? Please, help, if you can. Thank you, Alex Scherbina

3 2

[Twisted-Python] Logo usage at websites?
by kkennedy＠kenzoid.com Oct. 30, 2002

Oct. 30, 2002

Couldn't find any info at the site, CVS, or my saved list msgs...is there an official logo that's available for use by sites running Twisted? I'm poking about in the images dir at twistedmatrix.com; images/TwistedLogo.png looks good, and it's only 2086 bytes. I'm looking forward to sticking a "Powered by Twisted" logo in my footers...*grin*. -- Ken Kennedy | http://www.kenzoid.com | kenzoid(a)io.com

5 5

Re: [Twisted-Python] Pynfo (I'm back)
by Maniac - Oct. 30, 2002

Oct. 30, 2002

I'm still interested in an IRC (or jabber) bot based on the twisted framework. I dont want to mess with an existing code base because of how bad a programmer I am (hence the desire for plug-in functionality) A common way seems to have plugins respond to IRC events via handlers. How to do this? /me shrugs The one i'm using now is pybot.sourceforge.net -M > On Wed, Oct 23, 2002 at 10:30:18PM -0500, Maniac - wrote: >> Dont really know where to broach this but: >> >> I've been looking at the code for pynfo and there's some >> functionality i'd like to wedge in there i.e. logging to a database >> (for example) but i'd like to be able to do it without affecting the >> main code. Is there a reasonable way to create an external plugin >> that could be inserted at runtime? >> > > (I don't know if you've already figured this out or not; I'm > posting > anyway on the off-chance you haven't and are still interested in using > the code-base, or someone else has taken an interest in the topic) > > I'm a little ashamed to say that Pynfo is a big, stinky hack. > There's > no > kind of modularity, and only a half-hearted attempt at any kind of > "plugin" interface. The freshmeat (non-functional) and google > capabilities would be the best example of how to go about this, but > they're not done in such a way as to allow you to not affect the main > code with your desired additions. > > Perhaps a good course of action would be for you to just hack what > you > want into the main code and send me a patch, then I can try to > refactor both of our "plugins" into something that resembles an actual > plugin interface. > > Jp > > -- > "One World, one Web, one Program." - Microsoft(R) promotional ad "Ein > Volk, ein Reich, ein Fuhrer." - Adolf Hitler > -- > 7:00pm up 161 days, 20:59, 2 users, load average: 0.06, 0.06, 0.02

1 0

[Twisted-Python] crasher
by Glyph Lefkowitz Oct. 30, 2002

Oct. 30, 2002

Okay, I've discovered a _very very_ odd bug in Twisted. In trying to get this stupid web/issues conduit thing working on Mac IE, I was trying all kinds of crazy nonsense. In particular there was one bit where I tried to make issueconduit close the connection after the server sent each message, so it would be immediately displayed, and then have the browser re-open the connection after a second to retrieve any new messages. (Mac IE doesn't allow you to modify pages with Javascript that haven't been fully loaded for some reason.) I did this using js timeouts and setting the src attribute on a hidden iframe. What happened next was not what I expected at all. First, the server started sending me the welcome message in a loop. (This is probably just a bug in the conduit code, nothing serious.) However, when I entered something in the text field and hit "enter", twistd _locked up hard_. I couldn't even send it a SIGTERM. So I killed it and tried again a few times. It would reliably lock up after trying to send a message. Best of all, this does not normally happen: it is quite possible to interact with the server using the default js (with some trivial changes); the only problem is that the updates won't show up until the connection is finished. The only thing I could think of that would be useful for debugging info is strace, since it was wedged so hard and I didn't know where. Here's what I got: ... munmap(0x4001b000, 4096) = 0 close(9) = 0 gettimeofday({1035895791, 342136}, NULL) = 0 send(6, "HTTP/1.1 200 OK\r\nTransfer-encodi"..., 136, 0) = 136 send(6, "c3\r\n<IssueBot> A SUPPORT R"..., 201, 0) = 201 send(6, "0\r\n\r\n", 5, 0) = 5 gettimeofday({1035895791, 345729}, NULL) = 0 gettimeofday({1035895791, 346897}, NULL) = 0 write(1, "29/10/2002 06:49 [HTTPChannel,0,"..., 20529/10/2002 06:49 [HTTPChannel,0,64.123.27.109] 64.123.27.109 - - [29/Oct/2002:12:49:50 +0000] "<GET /issues.rpy/conduit?output=135 HTTP/1.1>" 200 195 "-" "Mozilla/4.0 (compatible; MSIE 5.14; Mac_PowerPC)" ) = 205 brk(0x846d000) = 0x846d000 old_mmap(NULL, 245760, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x4035b000 brk(0x8433000) = 0x8433000 mremap(0x4035b000, 245760, 245760, MREMAP_MAYMOVE) = 0x4035b000 mremap(0x4035b000, 245760, 245760, MREMAP_MAYMOVE) = 0x4035b000 mremap(0x4035b000, 245760, 245760, MREMAP_MAYMOVE) = 0x4035b000 mremap(0x4035b000, 245760, 245760, MREMAP_MAYMOVE) = 0x4035b000 ... It then repeats "mremap" basically forever, and the various numbers there increase very gradually. So for some reason, Twisted is trying to allocate some huuuge chunk of memory. Is there a way to get gdb to tell me where in python this is happening? I am going out of my mind trying to figure out a way to debug this, so extra eyes are helpful, but I don't think this bug can be found through normal bughunting; you'd have to be pretty familiar with whatever code is causing the problem. I figure it might be either woven, twisted.protocols.http or twisted.internet. Help? :-) -- | <`'> | Glyph Lefkowitz: Traveling Sorcerer | | < _/ > | Lead Developer, the Twisted project | | < ___/ > | http://www.twistedmatrix.com |

2 3

[Twisted-Python] row howto patch
by Jonathan Lange Oct. 28, 2002

Oct. 28, 2002

The row howto has a syntax error in the bit about rowForeignKeys. "[(tableName, [(columnName, columnType)], containerMethodName, autoLoad]" I had a look at the source code, and the error appears to be a little deeper, in that there should be two lists of columns, one for parent columns, one for child columns. Patch below, sorry if formatting is poor, I'm on Outlook web access. jml Index: doc/howto/row.html =================================================================== RCS file: /cvs/Twisted/doc/howto/row.html,v retrieving revision 1.17 diff -u -r1.17 row.html --- doc/howto/row.html 27 Oct 2002 20:46:24 -0000 1.17 +++ doc/howto/row.html 28 Oct 2002 08:33:54 -0000 @@ -48,8 +48,8 @@ <ul> <li>rowForeignKeys - list of foreign keys to other database tables - in the form: [(tableName, [(columnName, columnType)], containerMethodName, - autoLoad]</li> + in the form: [(tableName, [(childColumnName, childColumnType)], + [(parentColumnName, parentColumnType)], containerMethodName, autoLoad]</li> <li>rowFactoryMethod - a method that creates instances of this class</li> </ul>

2 1

[Twisted-Python] Asynchronous unit tests
by Jonathan Lange Oct. 28, 2002

Oct. 28, 2002

Attached is an asynchronous unit testing framework. If you inherit from deferunittest.DeferredTestCase instead of inheriting from unittest.TestCase, then test methods can return a Deferred, which should be handled appropriately by the framework. An example test suite is also attached. Note that this required some modifications to the pyunit.unittest, in order to make things accessible to the subclass. A patch to the unittest.py currently in twisted cvs is attached. I'm not feeling too sure about this whole thing, so feedback is highly appreciated. cheers, jml

1 0

[Twisted-Python] suggestion: t.enterprise.reflector populated errback
by Jonathan Lange Oct. 28, 2002

Oct. 28, 2002

In twisted.enterprise.reflector, the Reflector constructor takes a populatedCallback argument. In SQLReflector, this is called after the reflector instance is successfully populated. Surely, if it's possible to specify a callback, it should be possible to specify errback? cheers, jml

1 0

[Twisted-Python] Quixote ???
by lals;dfjsd Oct. 28, 2002

Oct. 28, 2002

Dear People, can anyone tell me if quixote has been sucessfully been integrated into twisted matrix and can someone pls show me how get my box ( windows 98 ) with quixote working together with twisted matrix ??

1 0

[Twisted-Python] mktap web --index patch
by Mike Snitzer Oct. 27, 2002

Oct. 27, 2002

All, It would appear that a twisted web server can't be easily configured (via mktap web --index) to use both index.html _and_ index.php (or any other combination) as directory indexes. mktap2.1 web --help ... -i, --index= Add the name of a file used to check for directory indexes. [default: index, index.html] SO.. I tried: 1) mktap2.1 web --path ~/public_html/ --index index.php and my php indexed directories work; but index.html indexed dirs do not 2) mktap2.1 web --path ~/public_html/ --index index.html,index.php and get the mktap web usage I've got to believe what I'm looking to do is something others would want to be able to configure too. However, the relevant twisted/tap/web.py code will only allow the user to add a single directory index; pretty strange limitation... Here's a patch to enable a user to specify multiple directory indexes to the web server via mktap (i.e. like #2 above): --- Twisted.orig/twisted/tap/web.py Wed Oct 23 07:56:52 2002 +++ Twisted/twisted/tap/web.py Sun Oct 27 13:35:34 2002 @@ -54,10 +54,11 @@ self.opts['root'] = None def opt_index(self, indexName): - """Add the name of a file used to check for directory indexes. + """Add the name of a file(s) used to check for directory indexes. [default: index, index.html] """ - self.opts['indexes'].append(indexName) + for index in string.split(indexName,','): + self.opts['indexes'].append(index) opt_i = opt_index

2 2