Mailman 3 July 2009 - Twisted-web

Test
by Philippe Lafoucrière 05 Aug '21

05 Aug '21

Hi all just a test

3 2

[Athena] Is ReliableMessageDelivery really necessary?
by Paul Thomas 08 Dec '09

08 Dec '09

Hi, I've hit a problem as my app has got bigger (about 30-40 widgets now, all chattering roughly once every 2 seconds) where the reliable message delivery mechanism is spiralling out of control. It seems that the constant back and forth means that large 'baskets' of messages are resent. The more this happens, the busier everything gets until the browser becomes unresponsive. There's a fix for it: [Divmod-dev] athena duplicate messages issue but I'm slightly concerned about the potential for lost messages - and also confused about how this could happen. Given that HTTP is a reliable connection-oriented transport, where is the gap that messages can fall through? I think I can cope with lost messages in most cases, so would it be useful to add a kind of 'sendRemote' that was like 'callRemote' but didn't care about a response? Or maybe this already exists and I've missed it? Paul. P.S. this app is likely to get more noisy - is it likely that I'll have to abandon Athena for Orbited or similar? I mean, are there architectural differences that will prevent Athena scaling?

5 7

tab completion in manhole
by Dickon Reed 04 Aug '09

04 Aug '09

Is there any way to to get tab completion of Python expressions (i.e. like what Ipython does) in twisted manhole sessions? Specifically, I'm using a variant of twisted.conch.stdio, which I only discovered today but seems to be a much more sound approach than the nasty concoction of reactor.crash and restarting the reactor and Ipython which I've tried before. Thanks, Dickon

3 3

Intresting examples!
by Juanjo Conti 31 Jul '09

31 Jul '09

I've foudn this examples on the web http://fzzzy.livejournal.com/1214.html I wonder know how updated they are. I was thinking to print them. Would this be a waist of paper? Thanks! -- Juanjo Conti

2 2

Guard, LastPage Memory Leak?
by Federico Tomassini 30 Jul '09

30 Jul '09

Hello, I'm running a guarded app. Memory is not released on logout. I read carefully nevow.guard and I'm debugging widely with pdb and gc. I encountered the following problem. It sounds really strange. I discovered, using pdb and gc inside logoutPortal(), that visited pages remain alive. So, I created a WastingMemPage(rand.Page) class that, on __init__, allocates ton of mem (no external referrer, memroy is allocate inside the instance only). I will return it initializing each time: def locateChild(self, ctx, segs): return WastingMemPage(), segs Now, each time I hit one of this WastingMemPage, memory usage grows. When I logout ( portalLogout() ), memory is not released. Now: * Is a rend.Page() not deleted once rendered? * Altough the previous question, why pages remain linked from something after portalLogout()? What's happening? Am I making some mistake? Is there some limit on portalLogout()? py 2.5/2.4. Nevow 0.9.31. Please, help! -- efphe Today is Pungenday, the 62nd day of Confusion in the YOLD 3175

3 11

overriding locateChild
by Juanjo Conti 29 Jul '09

29 Jul '09

I've solved the question asked last week using chidlFactory; i've also tried to use locateChild, but each time I tried (in a LivePage) others things stopped to work (LivePage makes lots of ajax/comet calls via XMLHTTPRequest and that urls requested seems not to be handled propitiated). Are there something I should have in mind when overriding the method in this particular class? On the other hand, I've notice the "Sorry, but I couldn't find the object you requested." message when I ask (via url) for a page that's not in the hierarchy. Is this a 404 error message? How do I override it? How do I raise a 404 error from the code? Thanks! -- Juanjo Conti

2 1

Design for HTTP client form login and scraping
by David Bern 27 Jul '09

27 Jul '09

I want to make multiple HTTP requests using the same set of cookies. Should I call client.getPage a lot thus creating multiple factories to do this? Should I subclass the HTTPClientFactory and put logic in there? I am kinda lost on how to attack this. I want the program to login to a site and run some scraping on it. Regards, David Bern

2 3

Handling childs at Nevow
by Juanjo Conti 25 Jul '09

25 Jul '09

At the moment I have this URL working / /ter /graph I have an IndexPage(LivePage) with its def child_ter(self, ctx): return TerPage() def child_graph(self, ctx): return GraphPage() mehods. TerPage() an GraphPage() pick the firs element of a global list and show it in differents ways. I'd like now to enalble urls like /ter/1, /ter/2, /ter/n so the n element of the list is picked instead of the first one. How is the correct way to make that argument reach TerPage and GraphPage instances? Greets! -- Juanjo Conti

5 8

Fwd: Web-Based Proxy
by dave fowler 22 Jul '09

22 Jul '09

Ok, I've read the entire Twisted O'Reilly book and gone through many of the docs and tutorials but I still need a bit of direction. I'm trying to make a simple web-based proxy. Similar to the proxy in the Twisted book, but with a web interface. So I could go to http://asdf.com.MYPROXYSITE.com and see the contents of asdf.com. I have the following code that works well as a browser proxy, but I need to figure out how make it web based. My thoughts are that I need to make an HTTP server and then adjust the address in the protocol before finishing the proxy request. Am I on the right track? Does anyone have examples of this? Should I ditch the Proxy classes all together? Thanks for any input. Dave Fowler from twisted.web import proxy, http from twisted.python import log import sys log.startLogging(sys.stdout) class Proxy(proxy.Proxy): def __init__(self, *args): print "inside Proxy" proxy.Proxy.__init__(self, *args) print "Proxy: ", self.__dict__ print dir(self) class ProxyFactory(http.HTTPFactory): # Receive connections from the client """ Receives connections from the client """ def __init__(self): # This function only needed for printing input and stuff print "inside proxy factory" http.HTTPFactory.__init__(self) print self.__dict__ print dir(self) def buildProtocol(self, addr): protocol = Proxy() print "making protocol for addr", addr print "protocol:", protocol.__dict__ return protocol if __name__ == "__main__": PROXY_PORT = 8001 from twisted.internet import reactor reactor.listenTCP(PROXY_PORT, ProxyFactory()) reactor.run()

2 4

User authentication with Nevow (just asking)
by Juanjo Conti 20 Jul '09

20 Jul '09

Just asking, I don't need it ate the moment but I'll be thinking about it in the next weeks. Is there a common way for user authentication in Nevow? Thanks, -- Juanjo Conti

2 1

Twisted-web July 2009