Mailman 3 December 2010 - Twisted-web

Test
by Philippe Lafoucrière 05 Aug '21

05 Aug '21

Hi all just a test

3 2

render_GET and memory consumption
by Pedro I. Sanchez 24 Dec '10

24 Dec '10

Hello, Here's a demo HTTP server that returns 10 MB of random data each time a client connects. import os from twisted.internet import reactor from twisted.web.server import Site from twisted.web.resource import Resource data = os.urandom(10*1024*1024) class TestPage(Resource): isLeaf = True def render_GET(self, request): return data root = Resource() root.putChild('test', TestPage()) reactor.listenTCP(8880, Site(root)) reactor.run() Now, when I run N clients simultaneously from a different host I see that the server's memory consumption increases by N*10 MB. I can't reproduce this example when running the clients from the same host as the server; the test goes so fast that I can't gather any useful data. I run the test using the following httperf command on a different host and looking at the Gnome system monitor in the server (top will do as well). httperf --server 192.168.1.10 --port 8880 --uri /test \ --rate 10 --num-conn 10 When the server is idle memory consumption is 17.1 MB, but during the test it jumps to 117.2 MB. My questions are then: 1. Given that 'data' is a global variable, eventually read-only as well, why is it replicated for each request? And who is replicating it? 2, What would be the proper way to re-write this example so that there is one and only one 'data' structure at any time? Thank you, -- Pedro

4 14

Re: [Twisted-web] Status of divmod-dev list?
by exarkun＠twistedmatrix.com 23 Dec '10

23 Dec '10

On 15 Dec, 04:28 pm, werner(a)thieprojects.ch wrote: >Hi all > >coming back to this thread to check if by any chance it was possible to >find the culprit for the disappearing messages. > >Of course all the time is sucked into the Xmas vortex... The server hosting divmod.org is now more or less defunct. The content will reappear at some point, but I'm not ready to predict exactly where or when. Hopefully the divmod-dev will re-appear at some point, but not necessarily in its previous form (it may be a launchpad mailing list, for example). Jean-Paul

8 20

Re: [Twisted-web] Copying Nevow features into Twisted Web (was Re: Status of divmod-dev list?)
by Werner Thie 21 Dec '10

21 Dec '10

On 12/20/10 4:19 PM, Colin Alston wrote: > On Mon, Dec 20, 2010 at 5:01 PM, Werner Thie <werner(a)thieprojects.ch > <mailto:werner@thieprojects.ch>> wrote: > > Hi Colin > > off list just for my information, what version of nevow/athena do > have you have included in enamel. The latest fixes I sent back to > the divmod list solved bugs server and client side when detaching > Live Elements from a page, which I do habitually very often. > > > Enamel works on pretty much any version, but doesn't work with > contextless Page and other stuff. > > The motivator for it's creation was to increase dev speed with people > who were slightly useless, and to act as a wrapper to make code trees > that could survive Freeze. > > > What do you see as important areas where nevow/athena should be > improved? > > > Primarily there is a great deal of bootstrapping. Just create a simple > web-app (without something like Methanal or Mantissa, which I can't even > understand) that does Athena and see how much code you're rewriting > every time, it's quite insane. My boilerplate (me working with guys mostly doing PHP and MySQL) let's me start up a new project in less than an hour. Doing this for a living I see the problem not really in starting up projects fast, but in finishing them fast, because only finished projects are paying... > Also if you're not using Twisted plugins (which there are many reasons > not to want to, like using shared state reactors with multiple TCP > services, or again Freeze) the pain goes up double. I use only a single plugin in nevow letting me bootstrap easily and providing a clean mechanism to switch automagically between source/compressed deployment version. All the deployment is handled via SVN. > Essentially boiling Athena down to a page mixin class with standard js > bootstraps, and/or separate fragment mixin and making all pages derive > the necessary Athena object triggers or even putting that into flatten. Might be that there's need for a 'kiddy' version, letting the average interested user who does not have the time to look into a framework and its concepts and wants to whip up a page in less than 30 seconds. > You can see what I do here to try simplify things for the way I work, > essentially I just stick an elements class dict in and map fragments to > automatically created renderers and stuff works magically. > http://open.thusa.net/enamel/browser/trunk/enamel/pages.py#L126 I see the basic idea, no objection, but why Fragments and not Elements? > There's also issues with the current model, like your root resource > can't be an Athena page very easily. I don't understand this point, I usually work root only, with not a standard page change, but doing everything by attaching/detaching live elements (see http;//www.thieprojects.ch for work in progress for a simple Desktop like RIA) Werner

3 3

Disable verbose logging in getPage
by David 20 Dec '10

20 Dec '10

Hi, I have written a small script which uses getPage, and I would like to disable the verbose getPage output ([HTTPPageGetter,client] Starting factory / [HTTPPageGetter,client] Stoping factory pairs). Is there a simple way to do so ? cheers, David

2 1

Status of divmod-dev list?
by Werner Thie 15 Dec '10

15 Dec '10

Hi all maybe somebody around here can enlighten me why my recent post to the divmod-dev mailing list didn't show up. The website seems to be up, the mailing list shows nothing but eerie silence. Mahalo, Werner

3 5