Mailman 3 April 2004 - Twisted-web

Twisted & PythonWin IDE
by Adam 17 Apr '04

17 Apr '04

Hi all, A quick (and probably stupid) question from a newb. I'd like to find a better way to quickly debug twisted scripts under pythonwin. I've no problem running stand-alone scripts from the command line, but under pythonwin they lock up, and after testing I'm forced to terminate it from the task manager, reopen pythonwin, etc... If someone could point me in the right direction I'd be greatly appreciative. Thanks, Adam

1 0

On splitting Twisted into subprojects
by Mary Gardiner 17 Apr '04

17 Apr '04

Note: Cross-posted to twisted-web and twisted-python. Decide between them for your follow-ups please :) This is intended to spark a little more discussion on splitting Twisted into subprojects, as discussed on Aussie-time on IRC (Jerub, jml, spiv and myself). It seems like the twisted-web project are planning to split off fairly soon: see http://twistedmatrix.com/pipermail/twisted-web/2004-April/000312.html It's pretty likely that this split will go ahead without any kind of imposed-from-above decisions about where the website will go, what the release cycle will look like, where the docs will move to, what the status of shared docs will be (I tend to focus on docs...) The nightmare scenario for splitting twisted into subprojects is that every subproject develops its own release code, release procedures, testing framework, website, documentation style, community, policies... etc etc. And shortly after that we all spiral into the sun or something. There appeared to us to be three possible ways of avoiding this: 1. Luck 2. Release code, release procedures, testing framework, website, documentation style, community, policies... imposed from above 3. Twisted Web (or whatever other project splits first) acting as a "model split": evolving release mechanisms, policy etc etc that are fundamentally sane and wonderful so that noone would think of doing things any other way. Since 3 looks like being the most achievable, this is basically an appeal to the twisted-web folk to keep in mind that they should, where possible, try and make twisted-web the Model of a Modern Twisted Subproject. And make it as easy as possible for other subprojects to copy whatever it is that they're going to do. I personally would like to offer my help in documenting subproject procedures as they evolve, and storing that documentation in some kind of prominent place. -Mary

1 0

Flamebait
by Jonathan Vanasco 16 Apr '04

16 Apr '04

I couldn't think of a better title for this question... Does anyone have any benchmarking stats on Twisted/TwistedWeb/Nevow in comparison to Apache's mod_perl, mod_python or (gasp) php for general tasks? You know, basic stuff like serving static pages, generating dynamic pages out of thin air, and generating dynamic pages off of parsed templates. I haven't seen comparison figures anywhere. I assume twisted stacks up impressively -- when I noticed template files being read each page generation, I started to think about efficiency, disk access and caching -- and hoped there were some numbers that could educate me.

5 7

Re: [Twisted-web] Performance of twisted web with HTTP/1.1 vs. HTTP/1.0
by Andrew Bennetts 15 Apr '04

15 Apr '04

On Mon, Apr 05, 2004 at 12:32:37PM -0500, Jason E. Sibre wrote: > ACT is part of the Microsoft Visual Studio .NET. It stands for Application > Center Test. The reason I tried it is that it allows the person setting up > the test to control which headers are sent to the server. In fact, the test > is actually controlled programmatically via VBScript (it hooks into Internet > Explorer to 'record' the test, if you don't want to create it from scratch, > which would be very tedious). Ah, ok. I've played with an older version of it a couple of years ago I think, back when I was still working for a company that used windows :) I think it was called "WAST" (Web Application Stress Tool) or something at the time, I guess ACT is probably the new version of that :) Anyway, that explains why I couldn't find it on google :) > If there's an open source tester that you'd rather I use for this > discussion, please let me know about it, and I'll chase it down. Well, any open source tester, even a simple dodgy one you write yourself -- I don't have any strong preference, but it would be nice to be able to reproduce your results :) > In the meantime, I'm attaching the test script that is being used > (test.vbs). It's written in VBScript, but it can't be run standalone, as > the "Test" object won't exist unless it's being run from the ACT. It is > easy to read however, so you can see what's going on. Yeah, nothing usual, certainly nothing that looks problematic... > I've modified a portion of the script that ties Quixote to Twisted, so that > I can 'peek' at the HTTP headers going into/coming out of Quixote. Here are > the headers when things are running fast: > > INBOUND header GATEWAY_INTERFACE: CGI/1.1 [..some headers..] > INBOUND header SERVER_PROTOCOL: HTTP/1.0 > INBOUND header SERVER_SOFTWARE: TwistedWeb/1.2.0 > > > And here they are when things are running slow: > > INBOUND header GATEWAY_INTERFACE: CGI/1.1 [..identical headers..] > INBOUND header SERVER_PROTOCOL: HTTP/1.1 > INBOUND header SERVER_SOFTWARE: TwistedWeb/1.2.0 > > I only note two differences, the HTTP/1.0 vs. HTTP/1.1 and the REMOTE_PORT > 1308 vs. 1445, so, one significant difference. > > Not much help, I guess, but does it give you any clues? Not really. I've read through the code in twisted/protocols/http.py, and I simply don't see any significant differences in the code paths for serving HTTP/1.0 and HTTP/1.1. > (I've joined the Twisted-web list for the duration of this conversation, at > least) I've CC'd the list. I can't think of what else to suggest, except for running the server in the Python profiler (the -p=profile.log switch to twistd, if you're using it), and seeing if that reveals where the extra time is being spent. Maybe you could insert a "print repr(line)" into HTTPChannel's lineReceiver handler (see twisted/protocols/http.py) to get a more raw dump of the request, and double-check that there's no significant differences in the HTTP/1.0 vs. HTTP/1.1 requests, but I'm doubtful... Also, to eliminate another difference between your environment and mine, is it possible to run your tester against a Twisted server on a linux box, and verify that it still gives the same behaviour? If for some bizarre reason it turns out to be a windows-only issue, it'd be good to know before I waste too much time trying to reproduce it on Linux :) Also, I'm losing track of what you have and haven't tried... it might be time we opened a bug report for this, so we can track this properly. -Andrew.

2 2

operating on literals in nevow html templates
by Joe Bowers 13 Apr '04

13 Apr '04

I'm using Nevow along with designers who use a WYSIWYG HTML editor, and it's working like a dream! However, I've run into an interesting scenario, and I was wondering if anyone has any advice or best practices to recommend. I would like to perform a transformation something like the following in my completed code: <a href="GUI_GENERATED_CALL(garbage, 'WindowName', 'WindowParams')" >Click here for a popup</a> to <a href="dynamicCall('dynamicData', 'WindowName', 'WindowParams')" >Click here for a popup</a> It's acceptable for me to bend, fold, or otherwise mutilate the designer-provided tag to some degree, so something like: <a href="GUI_GENERATED_CALL(garbage, 'WindowName', 'WindowParams')" nevow:data="{'name' : 'WindowName', 'params' : 'WindowParams'}" nevow:render="dynamicPopup" >Click here for a popup</a> would be fine- but the literal parameters I need to preserve need to be under the control of the designers and present in the template rather than in the code. Any advice or pointers on how this sort of thing should be handled? Thanks for your help! -------------------- Joe Bowers Technical Director Seventy-two dpi 828.252.2408 [x308] joe(a)seventytwodpi.com http://www.seventytwodpi.com

3 2

twcgi.py changes
by Stephen Thorne 13 Apr '04

13 Apr '04

Hi, I had a change I made to twcgi ages ago which I've just recently revised: Old Issue: http://www.twistedmatrix.com/users/roundup.twistd/twisted/issue516 New Patch: --------------------------------------------------------------------------- --- twisted/web/twcgi.py (revision 10536) +++ twisted/web/twcgi.py (working copy) @@ -154,11 +154,20 @@ class PHPScript(FilteredScript): """I am a FilteredScript that uses the PHP command on most systems. Sometimes, php wants the path to itself as argv[0]. This is that time. + + To run as cgi, I require the following configuration options in php.ini be set: + cgi.fix_pathinfo = 1 + cgi.force_redirect = 0 """ filter = '/usr/bin/php4' +class DebianPHPScript(PHPScript): + """PHP binary is in a different place in Debian""" + filter = '/usr/lib/cgi-bin/php4' + + class CGIProcessProtocol(protocol.ProcessProtocol, pb.Viewable): handling_headers = 1 headers_written = 0 --------------------------------------------------------------------------- The doc changes are required imho, but I don't really like the subclass for Debian. Frankly, I think it sucks, but can anyone see a cleaner way of doing this? It almost feels like something that should be configured on runtime - there are too many places the php4 variable could be (and we can't exactly do a $PATH lookup, becuase php4-cli doesn't have all the cgi stuff in it, and is in /usr/bin/php4 under debian systems). Regards, Stephen Thorne

2 1

Nevow Templating question
by jonathan vanasco 13 Apr '04

13 Apr '04

This works, but I think the approach might be wrong. (the output is what I want it to be, but I think I may have implemented things counter to the way nevow was designed) Can someone please offer their input? template.html ------------------- <tr> <td valign="top"> pick a city</td> <td> <select name="city"> <span nevow:data="citiesList" nevow:render="city"></span> </select> </td> </tr> testing.py ------------------- def data_citiesList(self, context, data): return {"New York":'1', "Los Angeles":'2'} def render_city(self, context, data): """Example of using stan to render a page. """ return rend.stan( [ T.option(value=v)[k] for (k,v) in data.items() ] ) Output.html ---------------- <tr> <td valign="top"> pick a city</td> <td> <select name="city"> <option value=1>New York</option> <option value=2>Los Angeles</option> </select> </td> </tr>

4 4

choosing between nodes
by Ellers 13 Apr '04

13 Apr '04

Hi all, I'm learning nevow by building yet a simple view-edit-save kind of app. Its going ok and is a good learning experience. I've refactored so that I can specify all the layout in separate html files, with as little coded html as possible. I'm stuck because I want the code to choose between displaying html fragments from the template that either display the page, edit it or save it. The relevant html fragment looks like this - and I know its really wrong :) - <div id="content"> <span nevow:data="display" nevow:render="xml"/> <span nevow:data="edit" nevow:render="xml"> <form>this is edit: more will go in here...</form> </span> <span nevow:data="save" nevow:render="xml/> <p>you have saved: <span nevow:data="saved_data" nevow:render="xml/> </span> </div> What is the right way to tell Nevow to use one node and not another? Thanks again! Ellers PS am I right that Nevow stands for NEw Version Of Woven ?

3 3

nevow tags and class attribute
by Ellers 12 Apr '04

12 Apr '04

Hey guys, A harder question this time (well... maybe!) Using nevow.tags I want to emit a paragraph such as: <p class="dirItem">blah</p> Problem is, "class" is naturally a keyword so python won't let me do this: return T.p("class"=paraClass)[ T.a(href=url)[resourceName] ] but this is fine return T.p("id"=paraClass)[ T.a(href=url)[resourceName] ] its probably easy... any ideas? Thanks Ellers

4 4

more vhost.NameVirtualHost implementation for nevow
by David Reid 10 Apr '04

10 Apr '04

Added a few features: * Nesting vhost.NameVirtualHost instances * Listing hosts if default == None and listHosts == True * default, and listHosts can be passed to the constructor with default values of None, and True respectively. * return rend.NotFound[0] if both default and listHosts are None

1 0