Mailman 3 March 2005 - Twisted-web

LivePage client.set()
by Dave Cook 22 Mar '05

22 Mar '05

I'd like to set the <option>s in on <select> based on user input from another (using Nevow 0.3). I tried something like client.set("mySelect", [tags.option[optionText] for optionText in myListOfStrings]) in my handler. This works great for Safari, but Firefox seems to ignore the <option> tags and just inserts text into the DOM at that point. *Should* the above work generally, or was I just lucky with Safari? Thanks, Dave Cook

2 3

does Nevow work with Twisted 2.x ?
by jarrod roberson 19 Mar '05

19 Mar '05

I guess the subject says it all, I have the latest Twisted from svn and the latest Nevow from svn and I get lots of deprecation warnings and can't get any of the examples actually work

5 6

Re: [Twisted-web] pgasync (was: /freeform_post!!random causes exceptions)
by J Turner 17 Mar '05

17 Mar '05

Andrea, Thanks for your suggestions; sorry I've taken so long to get back to them, but I haven't had time to work on pgasync until now... On Thu, Jan 20, 2005 at 02:15:36AM +0100, Andrea Arcangeli wrote: > Next thing I had to fix to be able to login has been to add this: [snip bool patch] I've patched that in, thanks. > With the above a good part of my app started working. But it's not enough. > > Here a list of the remaining issues (which I believe aren't related anymore to > the API, as far as I'm concerned the current adbapi wrapper is all I need ;). > > 1) the '%(xx)d' format for integeres/logs insn't recognized. I'd like to use > "%(xx)d" to be strict for integers. This is fixed. > btw, is there any difference in python between %u and %d at all? Nope, I don't think so. > 2) it cannot handle a ";" at the end of the sql string. so I deleted all the > finals ";" and I left only the intermediate ones. This is fixed as well. > 3) it doesn't print the nevow url type, note that such parameter is just > incidentally passed down to the sql query, and pgasync should ignore it > instead of complaining since it never gets resolved It's not trival to determine whether or not something gets resolved. If it's a keyword argument situation, then I need to search the format string for some variation of %(keyword)s. If it's just tuple-style, then I need to count the number of %s/d/whatevers and determine whether or not it's beyond the limit. This seems ugly, and needlessly expensive for a corner case; I think the right answer is, only pass things to format() that are intended to be formatted and made safe for insertion into SQL. But, then again, maybe I'm misunderstanding you. - Jamie

4 6

Re: [Twisted-web] web2
by Lenny G Arbage 17 Mar '05

17 Mar '05

--- James Y Knight <foom(a)fuhm.net> wrote: > > But as for improvements it's supposed to bring: > - streaming upload data > - multiple headers of the same name > - better factoring of lowlevel HTTP vs highlevel > request handling, to > allow other transports (e.g. CGI) to be more easily > plugged in > - IResource interface improvements from Nevow > - more versatile outgoing data streaming API. > - header parsing correctness > - full HTTP1.1 support > - output filters (e.g. HTTP range support done in a > generic fashion) > - I dunno, probably some more stuff I forgot at the > moment. > > It's not done enough yet for me to recommend using > it in production, web2 sounds like it will be fabulous. I hope you don't mind me asking for a bit more advice-- suppose I do need to fix the streaming file upload problem* right away (or at least fairly soon). Do I use nevow instead of web? Do I use web2 from svn? What other options do I have before me? Which of these paths will allow me to bring my webserver back to web2 with the least resistence when web2 is released? -- thanks, Lenny G * btw, isn't this a security hole for any webserver running off of twisted-web.resource.Resource -based websites -- if a client does a post with multipart/form-data and then just streams data endlessly, the server process mushrooms to fill all available memory and swap? __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

2 1

liveevil.py import breaks py2exe
by Cory Dodt 16 Mar '05

16 Mar '05

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The following patch is the quickest hack I could think of to make liveevil import successfully (albeit non-usefully) in an app that bundles nevow with py2exe. Liveevil won't *work* under these conditions, so someone needs to think of a way to tell it how to find liveevil.js if they want py2exe + liveevil. This should permit non-liveevil nevow apps work ok though, which currently they don't. Without this patch you get an error along the lines of IOError: No such file "C:\...\library.zip\nevow\liveevil.js". C Index: liveevil.py =================================================================== - --- liveevil.py (revision 1334) +++ liveevil.py (working copy) @@ -294,16 +294,20 @@ ~ return os.path.join(dirname, 'liveevil.js') - -_glueJS = _locateGlueJS() +try: + _glueJS = _locateGlueJS() - -# A static.File resource that can be used from a <link> - -glueJS = static.File(_glueJS, 'text/javascript') + # A static.File resource that can be used from a <link> + glueJS = static.File(_glueJS, 'text/javascript') - -# Inline JavaScript glue. TODO: deprecate this. - -glue = tags.inlineJS(open(_glueJS).read()) + # Inline JavaScript glue. TODO: deprecate this. + glue = tags.inlineJS(open(_glueJS).read()) - -# Glue which tells livepage to only allow clientToServer events, not async serverToClient events - -inputOnlyGlue = tags.inlineJS("var auto_open = false; var liveevil_unload = true;\n" + ''.join(open(_glueJS).readlines()[1:])) + # Glue which tells livepage to only allow clientToServer events, not async serverToClient events + inputOnlyGlue = tags.inlineJS("var auto_open = false; var liveevil_unload = true;\n" + ''.join(open(_glueJS).readlines()[1:])) +except EnvironmentError: + glueJS = inputOnlyGlue = glue = None + warnings.warn("Could not open liveevil.js") ~ ctsTemplate = "nevow_clientToServerEvent('%s',this%s);%s" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCOM8+3A5SrXAiHQcRAhfiAJ0RsKqQ7ocEDjvX1ha1LSqBZZEb6gCfafkP OPfCUxJ9gF6HZmSOA4ki1i0= =RwLw -----END PGP SIGNATURE-----

1 1

Pastebin behind a ReverseProxyResource
by Jason Mobarak 15 Mar '05

15 Mar '05

Hi -- I'm trying to set up the pastebin example from Nevow SVN behind a ReverseProxyResource. I have the following tac file [1] setting everything up. The doc strings for VHostMonsterResource state that the paths on the main site and the proxy site should be the same. For example something like "http://foo.com/bar" would be written to "http://foo.com:8080/bar", however everything seems to be rewritten incorrectly. You can see how everything comes up here [2]. 1: http://deadbeefbabe.org/dbb.tac.txt 2: http://deadbeefbabe.org/paste Thanks ,,Jason

2 1

web2
by Lenny G Arbage 15 Mar '05

15 Mar '05

Looking through the archives, I saw a lot of discussion about web2 in September, but not much since then. Anyone care to comment on status? I'm really looking forward web2 for a couple of reasons, the most pressing being that I need to handle file uploads from multipart/form-data. In twisted.web this means holding the entire request in memory (as you know), which isn't so good when large files are sent. I'd also love to see a new client get in there (is this being worked on as well)? Right now, I'm using httplib logic spun off in a deferToThread because that was the only way I could figure out how to do client file upload via mulitpart/form-data efficiently (same problem as above -- large requests generated). I did download a 0.1.0 version of web2, but haven't had time to upgrade to python2.4 yet to try it out. I am considering moving forward with web2, since I know I'll need it in production -- am I early in doing this (is the API still really unstable, etc.)? Should I wait? Thanks in advance for any guidance / info, -- Lenny G. __________________________________ Do you Yahoo!? Yahoo! Small Business - Try our new resources site! http://smallbusiness.yahoo.com/resources/

3 3

leightweight CMS
by Tim Terlegård 14 Mar '05

14 Mar '05

Is there an Open Source leightweight CMS or web system of any kind that uses twisted and nevow and that stores content (atleast articles) as files? Tim

4 5

nevow:attr problem and patch
by Joe Halliwell 13 Mar '05

13 Mar '05

Hullo, I recently encountered a problem with the following XML snippet: <input type="checkbox" n:data="m_friend" n:render="if"> <n:attr name="checked">true</n:attr> </input> where the page defines: def render_if(self, ctx, data): if data: return self.tag else: return self.tag.clear() The problem is that due to the way nevow:attr is parsed the <input> ends up with an unwanted checked attribute. One way to fix this is to clear Tag valued attributes when a tag is clear()'d. The type test in the following patch is possibly a bit too hacky, but I'm hoping someone will be able to improve on it :) Cheers, Joe Index: stan.py =================================================================== --- stan.py (revision 1346) +++ stan.py (working copy) @@ -352,6 +352,9 @@ """Clear any existing children from this tag. """ self._specials = {} + for (a,v) in self.attributes.items(): + if type(v)!=unicode: + del self.attributes[a] self.children = [] return self

1 0

feedback on svn updates
by Andrea Arcangeli 11 Mar '05

11 Mar '05

1) The cached branch on top of svn trunk generates an exception in CachedSerializer, unfortunately I didn't save the exception. Since I don't strictly need the tags.cached, I left only the rend.Page cache below in my tree: Index: Nevow/nevow/rend.py =================================================================== --- Nevow/nevow/rend.py (revision 1334) +++ Nevow/nevow/rend.py (working copy) @@ -30,6 +30,7 @@ from nevow import flat from nevow.util import log from nevow import util +from nevow import url import formless from formless import iformless @@ -381,6 +382,8 @@ self.children[name] = child +_CACHE = {} + class Page(Fragment, ConfigurableFactory, ChildLookupMixin): """A page is the main Nevow resource and renders a document loaded via the document factory (docFactory). @@ -394,8 +397,37 @@ afterRender = None addSlash = None + cache = False + lifetime = -1 + __lastCacheRendering = 0 + flattenFactory = lambda self, *args: flat.flattenFactory(*args) + def hasCache(self, ctx): + if not self.cache: + return + + _now = now() # run gettimeofday only once + timeout = _now > self.__lastCacheRendering + self.lifetime and \ + self.lifetime >= 0 + c = self.lookupCache(ctx) + if timeout or c is None: + # stop other renders + self.__lastCacheRendering = _now + c = None + return c + def cacheRendered(self, ctx, c): + if not self.cache: + return + # overwrite the deferred with the data + self.storeCache(ctx, c) + def cacheIDX(self, ctx): + return str(url.URL.fromContext(ctx)) + def storeCache(self, ctx, c): + _CACHE[self.cacheIDX(ctx)] = c + def lookupCache(self, ctx): + return _CACHE.get(self.cacheIDX(ctx)) + def renderHTTP(self, ctx): if self.beforeRender is not None: return util.maybeDeferred(self.beforeRender,ctx).addCallback( @@ -421,11 +453,18 @@ if self.afterRender is not None: return util.maybeDeferred(self.afterRender,ctx) - if self.buffered: + c = self.hasCache(ctx) + if c is not None: + finishRequest() + return c + + if self.buffered or self.cache: io = StringIO() writer = io.write def finisher(result): - request.write(io.getvalue()) + c = io.getvalue() + self.cacheRendered(ctx, c) + request.write(c) return util.maybeDeferred(finishRequest).addCallback(lambda r: result) else: writer = request.write @@ -507,7 +546,6 @@ else: ## Use the redirectAfterPost url ref = str(redirectAfterPost) - from nevow import url refpath = url.URL.fromString(ref) magicCookie = '%s%s%s' % (now(),request.getClientIP(),random.random()) refpath = refpath.replace('_nevow_carryover_', magicCookie) 2) self.locateConfigurable returns a deferred, so I changed my code to get the retval via addCallback, so this is fine. 3) The renderForms has changed layout with <legend>. You can see the layout of the new code (already online) here https://www.cpushare.com/verify_email/. Now I don't dislike this change but I would like to keep the legend at the center of the page (not on the left), is that possible with some css tweak? I tried to do that in the fieldset but that screwed the alignment of everything else too. I only want the legend to be centered instead. Hints? Thanks and keep up the great work.

1 0