Mailman 3 March 2006 - Twisted-web

Test
by Philippe Lafoucrière Aug. 5, 2021

Aug. 5, 2021

Hi all just a test

3 2

Parameters for data_/render_
by Stumpe, Werner March 31, 2006

March 31, 2006

Hi, I am working on a project (nevow + twisted) where lots of statistical computing is done using "R", interfaced by rpy.py. It works very well. To be able to parameterize the computing, I defined an additional namespace and put the parameters with this namespace inside the nevow templates. It looks like: <html xmlns:nevow="http://nevow.com/ns/nevow/0.1" xmlns:new_namespace="http://new_namespace.de/ns/0.1" xmlns="http://www.w3.org/1999/xhtml" xml:lang="de" lang="de"> <head> <meta content="text/html; charset=ISO-8859-1" http-equiv="content-type" /> </head> <body> <img new_namespace:title="Fehlerklasse 2 (letzte 50)" new_namespace:table="defect" new_namespace:fields="measurement_id gravity" new_namespace:reorder_x="1" new_namespace:reverse_x="1" new_namespace:sql="class = 2 ORDER BY _id DESC LIMIT 50" new_namespace:function="errorplot" new_namespace:smooth="2" nevow:data="Measurement" nevow:render="Plot"> </body> </html> The parameters are extracted like this: def data_Measurement (self, context, data): """Extracts the parameters from the attribute-list.". self.html_params = {} self.script_params = None todelete = [] for theKey in context.tag.attributes: keyFound = False if type(theKey) is tuple: if len(theKey) == 2: ns = theKey[0] tag = theKey[1] if ns == u'http:// new_namespace.de/ns/0.1' : name = tag value = context.tag.attributes.get(theKey) self.script_params[name] = value ## ## Append the key to the list of keys to remove later. ## Unfortunately the parameters must be cleared, so that only valid attributes ## according the html-element are present in the rendering step. ## todelete.append(theKey) ## ## Delete the param-keys from the attribule-list. ## Otherwise the attributes would be present in the rendering and this is for the birds. ## for theKey in todelete: del context.tag.attributes[theKey] In the function render_measurement() the function is called with the parameters (in this case "errorplot") and the resulting image is rendered. This also works very well. My question is: Is there a better and simpler way to do that? And if not, why do I have to remove the additional attributes, because later on nevow gets confused about this attributes and produces a nice stack-trace? The next question is: In the render_whatever() functions an image is produced, and I want to write the image directly with perhaps request.write(). How can this be done using nevow? Thanks, Werner

1 0

cookielib and http client
by Frédéric Gobry March 30, 2006

March 30, 2006

Hi, Enclosed is a simple implementation of a subclass of t.web.client's HTTPClientFactory which uses the cookielib module from python2.4. This makes it possible to tune the way cookies are handled while getting web pages in twisted. I had in mind to work on a more complete port of mechanize <http://wwwsearch.sourceforge.net/mechanize/> to twisted, but had to switch to something else in the meantime. Hope it might be useful to someone. Frédéric

1 0

forms has been renamed to formal
by Tommi Virtanen March 29, 2006

March 29, 2006

[resending because mailman and its admins hate me] Hi! I've just committed 3 changes to the forms SVN trunk that change the package from "forms" to "formal", as agreed with Matt earlier. Now, I'd like to get a release done, and a debian package made of it, then I can start using it for real. Matt, do you want to handle the release or should I? What version number should it get?

2 1

static.File.childNotFound gone walkabout?
by Jeff Grimmett March 21, 2006

March 21, 2006

In twisted.web.static.File we had support for a default "not found" page in the form of the attribute childNotFound. I notice that in web2 we just punt it. Was something niftier substituted or was it just dropped? (also, if the latter, you are still calling it in t.w2.twcgi.py around line 328 or so, but that seems to be the only place) -- "Ladies and gentlemen, there's nothing to worry about ... but please keep your heads down." - The Muppet Show Best, Jeff

2 2

NameVirtualHost and web2
by Jeff Grimmett March 21, 2006

March 21, 2006

I've a working NameVirtualHost setup that I am trying to convert over to web2 and I've hit a speedbump. Here's the code, more or less: =========================== from twisted.web2 import server, http, channel, vhost from twisted.web2 import static root = vhost.NameVirtualHost() site1 = server.Site(static.File("d:sites\site1")) site2 = server.Site(static.File("d:sites\site2")) root.addHost('www.grimmlabs.com', site1) root.addHost('www.g-labs.com', site2) site = server.Site(root) # Standard twisted application Boilerplate from twisted.application import strports, service from twisted.internet import reactor application = service.Application("Grimmlabs") s = strports.service('tcp:8080', channel.HTTPFactory(site)) s.setServiceParent(application) =========================== Run using twistd -ny file.py Starts up, no probs. When I go to load a page, though, I see this traceback: =========================== File "E:\Python\Lib\site-packages\twisted\web2\server.py", line 263, in process d = self._getChild(self.site.resource, self.postpath) File "E:\Python\Lib\site-packages\twisted\web2\server.py", line 290, in _getChild return defer.maybeDeferred( File "E:\Python\Lib\site-packages\twisted\internet\defer.py", line 191, in addCallbac k callbackKeywords=kw) File "E:\Python\Lib\site-packages\twisted\internet\defer.py", line 182, in addCallbac ks self._runCallbacks() --- <exception caught here> --- File "E:\Python\Lib\site-packages\twisted\internet\defer.py", line 307, in _runCallba cks self.result = callback(self.result, *args, **kw) File "E:\Python\Lib\site-packages\twisted\web2\server.py", line 317, in _handleSegmen t newres = iweb.IResource(newres) File "E:\Python\lib\site-packages\zope\interface\interface.py", line 703, in __call__ raise TypeError("Could not adapt", obj, self) exceptions.TypeError: ('Could not adapt', <twisted.web2.server.Siteobject at 0x00D9157 0>, <SpecialAdaptInterfaceClass twisted.web2.iweb.IResource>) =========================== (sorry about the formatting) I've tried a few variations with more or less the same results. Note that the sites I am trying to add all work just fine in web2 without the NameVirtualHost in the mix. I've looked over the examples and what docs we have here, and haven't come up with any inspiration. Help me Obi-wan Kenobi, you're my only hope... -- "Ladies and gentlemen, there's nothing to worry about ... but please keep your heads down." - The Muppet Show Best, Jeff

2 3

How to fill slots in sub-pattern
by Paul Reznicek March 18, 2006

March 18, 2006

Hi all, I've one page template and would like to use different pattern in different Page subclasses. A snipped of the template: # ---------------------------------------------- <td class="main"> <n:invisible n:render="contentMain" n:data="contentData"> <table n:pattern="contentTable" n:render="sequence"> <tr n:pattern="header"> <th id="firstHeader">First Column</th> <th id="secondHeader">Second Column</th></tr> <tr n:pattern="item" n:render="row"> <td><n:slot name="first_column" />data1</td> <td><n:slot name="second_column" />data2</td> </tr> </table> <table n:pattern="otherTableData" n:render="sequence"> <tr n:pattern="header"> <th id="firstHeader">Col 1</th> <th id="secondHeader">Col 2</th></tr> <th id="thirdHeader">Col 3</th></tr> <tr n:pattern="item" n:render="row"> <td><n:slot name="first_column" />data1</td> <td><n:slot name="second_column" />data2</td> <td><n:slot name="third_column" />data3</td> </tr> </table> </n:invisible> </td> # ---------------------------------------------- The renderer should work like this: # ---------------------------------------------- def render_contentMain(self, ctx, data): patternHere = inevow.IQ(ctx).onePattern('contentTable') patternHere.fillSlots('first_column', data[0]) patternHere.fillSlots('second_column', data[1]) return patternHere.tag # ---------------------------------------------- But this does not work ... Can somebody help me? Thanks in advance, Paul

1 1

Trac via twisted.web2.wsgi
by Ed Suominen March 16, 2006

March 16, 2006

I've implemented a twisted.web2 resource for accessing Trac via WSGI. You can see both a working example and the code at http://foss.eepatents.com/DynamicSite/browser/branches/kiss-web2/dynamicsit… There's a StanResource class there that I'm using and think is kind of cool, too. I use the following python code to provide my root resource for the foss.eepatents.com site. (A copy is at http://deadbeefbabe.org/paste/34 in case the email version is too mangled to be useful.) Obviously, you'll want to personalize it for your own use and not call the home page "Ed Suominen's Free & Open Source Software Projects." This will all be part of an upcoming release of DynamicSite, a flexible, reasonably user-friendly vhost implementation of twisted.web2. Hopefully I will remain inspired to package it all up now that I've scratched my particular itch. Since I believe in generous usage of docstrings (hint, hint to the Twisted devs), the code in the kiss-web2 branch should be fairly easy to use even in its current raw form. Those interested in what can be (over)done with Nevow, dynamic image generation, intelligent caching, etc. might want to browse through the current revision (SVN:47) of trunk before I replace it with the "keep it simple stupid" twisted.web2 branch. Best regards, Ed Suominen > # DynamicSite: > # A virtual hosting twisted.web2 HTTP server that uses subdirectories for > # virtual host content. Subdirectories can be python packages providing dynamic > # content with a root resource object, or sources of static content. > # > # Copyright (C) 2006 by Edwin A. Suominen, http://www.eepatents.com > # > # This program is free software; you can redistribute it and/or modify it under > # the terms of the GNU General Public License as published by the Free Software > # Foundation; either version 2 of the License, or (at your option) any later > # version. > # > # This program is distributed in the hope that it will be useful, but WITHOUT > # ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS > # FOR A PARTICULAR PURPOSE. See the file COPYING for more details. > # > # You should have received a copy of the GNU General Public License along with > # this program; if not, write to the Free Software Foundation, Inc., 51 > # Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA > > """ > Provides a Trac resource via an WSGI gateway. > > """ > > from dynamicsite.external import TracResource, StanResource > > > class HomePage(StanResource): > """ > A home page for all of the trac project names and paths supplied in the > I{projects} dict > """ > def __init__(self, projects): > self.projects = projects > > def render(self, request): > title = "Ed Suominen's Free & Open Source Software Projects" > body = [self.h2[title]] > for projectName in self.projects.iterkeys(): > projectDescription = " ".join(self.projects[projectName][1:]) > body.append(self.p[self.a(href=projectName)[projectName], > ": %s" % projectDescription]) > > return [self.html[ > self.head[self.title[title]], > self.body[body]]] > > def locateChild(self, request, segments): > projectName = segments[0] > if projectName in self.projects: > projectPath = self.projects[projectName][0] > return TracResource(projectPath), segments[1:] > else: > return self, () > > > projects = {"pNetworkX":("/var/trac/pnetworkx", > "An enhancement to the NetworkX package that provides", > "database persistency of underlying data in graph", > "objects"), > > "DynamicSite":("/var/trac/dynamicsite", > "A virtual hosting twisted.web2 HTTP server that", > "uses subdirectories for virtual host content") > } > > > resource = HomePage(projects)

1 0

Lingering HTTP Channel in web2 when testing with trial
by Henrik Thostrup Jensen March 13, 2006

March 13, 2006

Hi I have an application which uses web2. In good twisted style I'm writing tests for it, and using trial. When performing some rather simple page retrievals a get a lingering http channel. Setting twisted.internet.base.DelayedCall.debug = True I get this trace: File "/usr/lib/python2.4/site-packages/twisted/trial/util.py", line 131, in _dispatch getattr(self, "do_%s" % attr)() File "/usr/lib/python2.4/site-packages/twisted/trial/util.py", line 173, in do_cleanPending raise PendingTimedCallsError(s) twisted.trial.util.PendingTimedCallsError: pendingTimedCalls still pending (consider setting twisted.internet.base.DelayedCall.debug = True): <DelayedCall 1083946540 [19.9427890778s] called=0 cancelled=0 HTTPChannel._lingerClose() traceback at creation: File "/usr/bin/trial", line 24, in ? run() File "/usr/lib/python2.4/site-packages/twisted/scripts/trial.py", line 676, in run suite = reallyRun(config) File "/usr/lib/python2.4/site-packages/twisted/scripts/trial.py", line 657, in reallyRun suite.run(config['random']) File "/usr/lib/python2.4/site-packages/twisted/trial/runner.py", line 250, in run tr.runTests(randomize=(seed is not None)) File "/usr/lib/python2.4/site-packages/twisted/trial/runner.py", line 496, in runTests runner.runTests(randomize) File "/usr/lib/python2.4/site-packages/twisted/trial/runner.py", line 601, in runTests self._apply(_runTestMethod) File "/usr/lib/python2.4/site-packages/twisted/trial/runner.py", line 543, in _apply f(tm) File "/usr/lib/python2.4/site-packages/twisted/trial/runner.py", line 597, in _runTestMethod testMethod.run(tci) File "/usr/lib/python2.4/site-packages/twisted/trial/runner.py", line 849, in run orig(tci) File "/usr/lib/python2.4/site-packages/twisted/trial/runner.py", line 332, in __call__ lambda :util.wait(defer.maybeDeferred(self.original, *a, **kw), File "/usr/lib/python2.4/site-packages/twisted/trial/runner.py", line 409, in _runWithWarningFilters return f(*a, **kw) File "/usr/lib/python2.4/site-packages/twisted/trial/runner.py", line 333, in <lambda> timeout, useWaitError=True)) File "/usr/lib/python2.4/site-packages/twisted/trial/util.py", line 325, in wait r = _Wait.wait(d, timeout) File "/usr/lib/python2.4/site-packages/twisted/trial/util.py", line 269, in wait reactor.iterate(0.01) File "/usr/lib/python2.4/site-packages/twisted/internet/base.py", line 360, in iterate self.doIteration(delay) File "/usr/lib/python2.4/site-packages/twisted/internet/selectreactor.py", line 133, in doSelect _logrun(selectable, _drdw, selectable, method, dict) File "/usr/lib/python2.4/site-packages/twisted/python/log.py", line 56, in callWithLogger return callWithContext({"system": lp}, func, *args, **kw) File "/usr/lib/python2.4/site-packages/twisted/python/log.py", line 41, in callWithContext return context.call({ILogContext: newCtx}, func, *args, **kw) File "/usr/lib/python2.4/site-packages/twisted/python/context.py", line 52, in callWithContext return self.currentContext().callWithContext(ctx, func, *args, **kw) File "/usr/lib/python2.4/site-packages/twisted/python/context.py", line 31, in callWithContext return func(*args,**kw) File "/usr/lib/python2.4/site-packages/twisted/internet/selectreactor.py", line 139, in _doReadOrWrite why = getattr(selectable, method)() File "/usr/lib/python2.4/site-packages/twisted/internet/abstract.py", line 134, in doWrite result = self._closeWriteConnection() File "/usr/lib/python2.4/site-packages/twisted/internet/tcp.py", line 376, in _closeWriteConnection p.writeConnectionLost() File "/usr/lib/python2.4/site-packages/twisted/web2/channel/http.py", line 788, in writeConnectionLost self._lingerTimer = reactor.callLater(20, self._lingerClose) > This if course makes sense, especially if the server lost its connection. I am doing cleanup in tearDown (calling stopListening() on the port), but trial still complains. Canceling the call, and calling it manually in tearDown, doesn't appear to help either. How do I make it shut it up in a proper way? PS. I'm rather pleased with the web2 framework, especially the stream framework (once I got my head wrapped around it), but it is hard to get an overview of the internals. A brief description of the design, philosophy, what was wrong with web(1), etc. would be very nice (I do realize that web2 is a moving target). -- - Henrik

1 1

Error using getPage
by Richard Townsend March 12, 2006

March 12, 2006

I was testing accessing url "http://newsrss.bbc.co.uk/rss/newsonline_uk_edition/front_page/rss.xml" using getPage() which was working fine until I deliberately changed the url to "http://newsrss.bbc.co.uk/rss/newsonline_uk_edition/front_page/rssZZ.xml" to test error handling. Instead of calling my errback, it gave: Traceback (most recent call last): File "/usr/local/lib/python2.4/site-packages/twisted/python/log.py", line 53, in callWithLogger return callWithContext({"system": lp}, func, *args, **kw) File "/usr/local/lib/python2.4/site-packages/twisted/python/log.py", line 38, in callWithContext return context.call({ILogContext: newCtx}, func, *args, **kw) File "/usr/local/lib/python2.4/site-packages/twisted/python/context.py", line 59, in callWithContext return self.currentContext().callWithContext(ctx, func, *args, **kw) File "/usr/local/lib/python2.4/site-packages/twisted/python/context.py", line 37, in callWithContext return func(*args,**kw) --- <exception caught here> --- File "/usr/local/lib/python2.4/site-packages/twisted/internet/selectreactor.py", line 139, in _doReadOrWrite why = getattr(selectable, method)() File "/usr/local/lib/python2.4/site-packages/twisted/internet/tcp.py", line 349, in doRead return self.protocol.dataReceived(data) File "/usr/local/lib/python2.4/site-packages/twisted/protocols/basic.py", line 232, in dataReceived why = self.lineReceived(line) File "/usr/local/lib/python2.4/site-packages/twisted/web/http.py", line 341, in lineReceived key, val = line.split(':', 1) exceptions.ValueError: need more than 1 value to unpack ------------------- Code: from twisted.internet import reactor from twisted.web.client import getPage def handleCallback(response): print 'response: %s' % response reactor.stop() def handleErrback(failure): print 'error: %s' % failure.getErrorMessage() reactor.stop() url = "http://newsrss.bbc.co.uk/rss/newsonline_uk_edition/front_page/rssZZ.xml" deferred = getPage(url) deferred.addCallbacks(handleCallback, handleErrback) reactor.run() ------------------- Is there a fix for this problem ? I am using Twisted 2.2.0/Twisted-web 0.5.0 with Python 2.4.1 on SUSE 9.3 regards, Richard Townsend

1 0