Mailman 3 August 2009 - Twisted-web

Test
by Philippe Lafoucrière 05 Aug '21

05 Aug '21

Hi all just a test

3 2

[Athena] Is ReliableMessageDelivery really necessary?
by Paul Thomas 08 Dec '09

08 Dec '09

Hi, I've hit a problem as my app has got bigger (about 30-40 widgets now, all chattering roughly once every 2 seconds) where the reliable message delivery mechanism is spiralling out of control. It seems that the constant back and forth means that large 'baskets' of messages are resent. The more this happens, the busier everything gets until the browser becomes unresponsive. There's a fix for it: [Divmod-dev] athena duplicate messages issue but I'm slightly concerned about the potential for lost messages - and also confused about how this could happen. Given that HTTP is a reliable connection-oriented transport, where is the gap that messages can fall through? I think I can cope with lost messages in most cases, so would it be useful to add a kind of 'sendRemote' that was like 'callRemote' but didn't care about a response? Or maybe this already exists and I've missed it? Paul. P.S. this app is likely to get more noisy - is it likely that I'll have to abandon Athena for Orbited or similar? I mean, are there architectural differences that will prevent Athena scaling?

5 7

t.w.x.XMLRPC with Basic Auth
by Clay Gerrard 01 Sep '09

01 Sep '09

Hello, This example over-rides render (which I could probably do, but it seems like cheating): http://code.activestate.com/recipes/526625/ This example is over my head (my zope.interfaces foo is weak): http://twistedmatrix.com/pipermail/twisted-web/2007-May/003377.html and also possibly dated? twisted.web2.auth.wrapper.HTTPAuthResouce vs. twisted.web._auth.wrapper.HTTPAuthSessionWrapper Is anyone aware of any other examples I could consider? Clay Gerrard Office: 210-312-3443 Mobile: 210-788-9431 Confidentiality Notice: This e-mail message (including any attached or embedded documents) is intended for the exclusive and confidential use of the individual or entity to which this message is addressed, and unless otherwise expressly indicated, is confidential and privileged information of Rackspace. Any dissemination, distribution or copying of the enclosed material is prohibited. If you receive this transmission in error, please notify us immediately by e-mail at abuse(a)rackspace.com, and delete the original message. Your cooperation is appreciated.

2 1

Could you recommend me a good article about Nevow URL architecture?
by Juanjo Conti 28 Aug '09

28 Aug '09

Just that :) -- Juanjo Conti

2 2

Re: [Twisted-web] I feel like I have a path one-off error here somewhere...
by exarkun＠twistedmatrix.com 27 Aug '09

27 Aug '09

On 05:24 pm, markscottwright(a)gmail.com wrote: >I'm trying to set up a dynamic tree of resources - a list of resources >that drill-down into individual resources. But for some reason, >getChild never gets called on my root resource. The following code >will output a list of ids, but "/id" doesn't call getChild. What am I >doing wrong? > >from twisted.web import server, resource > >class Child(resource.Resource): > > def __init__(self, childid): > self.childid = childid > > def render_GET(self, request): > return "<h1>" + self.childid + "</h1>" > >class Root(resource.Resource): > > def render_GET(self, request): > pg = "" > for i in range(10): > pg += '<p><a href="/' + str(i) + '">' + str(i) + "</a></p>" > return pg > > def getChild(self, path, request): > return Child(path) > >if __name__ == "__main__": > from twisted.internet import reactor > > root = resource.Resource() > root.putChild('', Root()) With this resource hierarchy set up, here's what you should expect: - / will call root.getChild("") - /id will call root.getChild("id") - /foo/bar will call root.getChild("foo").getChild("bar") So, perhaps you want to make root an instance of Root instead of an instance of Resource with a "" child of a Root instance? Jean-Paul

1 0

I feel like I have a path one-off error here somewhere...
by Mark Wright 27 Aug '09

27 Aug '09

I'm trying to set up a dynamic tree of resources - a list of resources that drill-down into individual resources. But for some reason, getChild never gets called on my root resource. The following code will output a list of ids, but "/id" doesn't call getChild. What am I doing wrong? from twisted.web import server, resource class Child(resource.Resource): def __init__(self, childid): self.childid = childid def render_GET(self, request): return "<h1>" + self.childid + "</h1>" class Root(resource.Resource): def render_GET(self, request): pg = "" for i in range(10): pg += '<p><a href="/' + str(i) + '">' + str(i) + "</a></p>" return pg def getChild(self, path, request): return Child(path) if __name__ == "__main__": from twisted.internet import reactor root = resource.Resource() root.putChild('', Root()) site = server.Site(root) reactor.listenTCP(8080, site) reactor.run() -- Mark Wright markscottwright(a)gmail.com

1 0

What's the correct way to deal with render_GET and unicode?
by Mark Wright 27 Aug '09

27 Aug '09

If I return a unicode string from my Resource's render_GET, I get a 500 error that says "Request did not return a string". I guess that means I'm responsible for encoding the response, but do I then need to write a render_HEAD to set the charset for the message? Are there any examples of how to do this? --- Mark Wright markscottwright(a)gmail.com

3 2

Nevow + Athena: Unhandled error in Deferred
by Paul Reznicek 27 Aug '09

27 Aug '09

Hello, I get very often this output (application is using Twisted 8.2.0 + Nevow-0.9.33): Unhandled error in Deferred: Traceback (most recent call last): Failure: nevow.athena.ConnectionLost: Timeout But I can't find out, where and how to handle it. In most cases it happen, when users leave the site or close the browser, so I'd like to suppress this messages, because they only blow up the logs without real value for debugging. Can you give me some hints, please? Regards, Paul

2 1

Re: [Twisted-web] Trouble with flex file-uploading and twisted.web2 FileSaver
by exarkun＠twistedmatrix.com 21 Aug '09

21 Aug '09

On 03:20 pm, daniel.yang.zhenyu(a)gmail.com wrote: >Hi team, > >I've been trying to upload files to twisted.web2 backend(FileSaver) >with >Adobe Flex and I am always getting IOError. >(code see below) >After some sniffing work, I found the error messages returned by >twisted.web2: > >Unexpected data on same line as boundary: '--' This sounds like it may be related to this ticket: http://twistedmatrix.com/trac/ticket/2113 Or it may be another unrelated error. If you can try the patch attached to that ticket and comment if it works, that might be helpful. Development is not currently proceeding very rapidly on Twisted Web2, though. You may need to champion the ticket in order to get it resolved. Jean-Paul

1 0

Trouble with flex file-uploading and twisted.web2 FileSaver
by Daniel Yang 20 Aug '09

20 Aug '09

Hi team, I've been trying to upload files to twisted.web2 backend(FileSaver) with Adobe Flex and I am always getting IOError. (code see below) After some sniffing work, I found the error messages returned by twisted.web2: Unexpected data on same line as boundary: '--' I believe this flex app works with php backend. So this might be with twisted.web2 or flash player's malformed post data. It seems the twisted error comes from fileupload.py: (I added 2 prints) def _readBoundaryLine(self): print "_readBoundaryLine" line = self.stream.readline(size=1024) if isinstance(line, defer.Deferred): line = defer.waitForDeferred(line) yield line line = line.getResult() print line if line == "--\r\n": # THE END! yield False return elif line != "\r\n": raise MimeFormatError("Unexpected data on same line as boundary: %r" % (line,)) yield True return _readBoundaryLine = defer.deferredGenerator(_readBoundaryLine) with html uploading form, it outputs: 2009-08-20 23:06:08+0800 [-] _readBoundaryLine 2009-08-20 23:06:08+0800 [-] -- 2009-08-20 23:06:08+0800 [-] 2009-08-20 23:06:08+0800 [-] <POST /upload (1, 1)> -------- 2009-08-20 23:06:08+0800 [-] FileUpload but with flex uploading: 2009-08-20 23:06:27+0800 [-] _readBoundaryLine 2009-08-20 23:06:27+0800 [-] 2009-08-20 23:06:27+0800 [-] 2009-08-20 23:06:27+0800 [-] _readBoundaryLine 2009-08-20 23:06:27+0800 [-] 2009-08-20 23:06:27+0800 [-] 2009-08-20 23:06:27+0800 [-] _readBoundaryLine 2009-08-20 23:06:27+0800 [-] -- Same file, different posted data. Any ideas? Does this happen to be a bug, or is there any way to walk around this? My testing code: python code: from twisted.web2 import http_headers, resource, \ static, server, channel, http, responsecode from twisted.python import util FORMHTML = """ <html> <p>for test</p> <form action="/upload" method="post" enctype="multipart/form-data"> <input type="file" name="FileUpload" /> <input type="submit" value="Upload"/> </form> </html> """ class MyFileSaver(static.FileSaver): """for test only""" def render(self, req): print req, '--------' if req.files: for fieldName in req.files: print fieldName return http.Response(responsecode.OK, {}, stream='ok') class Toplevel(resource.Resource): addSlash = True def render(self, ctx): return http.Response(stream=FORMHTML) child_upload = MyFileSaver(util.sibpath(__file__, ''), expectedFields=['FileUpload'], allowedTypes=( http_headers.MimeType('image', 'jpeg'), http_headers.MimeType('image', 'png'), http_headers.MimeType('image', 'gif'), ) ) child_swf = static.File(util.sibpath(__file__, 'FileUpload.swf')) site = server.Site(Toplevel()) # Standard twisted application Boilerplate from twisted.application import service, strports application = service.Application("demoserver") s = strports.service('tcp:8080', channel.HTTPFactory(site)) s.setServiceParent(application) My flex code: <?xml version="1.0" encoding="utf-8"?> <!-- http://blog.flexexamples.com/2007/09/21/uploading-files-in-flex-using-the-f…> <mx:Application xmlns:mx="http://www.adobe.com/2006/mxml" layout="vertical" verticalAlign="middle" backgroundColor="white" creationComplete="init();"> <mx:Script> <![CDATA[ private var fileRef:FileReference; private const FILE_UPLOAD_URL:String = " http://127.0.0.1:8080/upload"; private function init():void { fileRef = new FileReference(); fileRef.addEventListener(Event.SELECT, fileRef_select); fileRef.addEventListener(ProgressEvent.PROGRESS, fileRef_progress); fileRef.addEventListener(Event.COMPLETE, fileRef_complete); fileRef.addEventListener(IOErrorEvent.IO_ERROR,ioErrorHandler); fileRef.addEventListener(SecurityErrorEvent.SECURITY_ERROR, onSec); } private function browseAndUpload():void { fileRef.browse(); message.text = ""; } private function ioErrorHandler(event:IOErrorEvent):void { trace(event); } private function onSec(event:SecurityErrorEvent):void{ trace(event); } private function fileRef_select(evt:Event):void { try { message.text = "size (bytes): " + numberFormatter.format(fileRef.size); var req:URLRequest = new URLRequest(); req.url = FILE_UPLOAD_URL; req.method = URLRequestMethod.POST; fileRef.upload(req, "FileUpload"); } catch (err:Error) { message.text = "ERROR: zero-byte file"; } } private function fileRef_progress(evt:ProgressEvent):void { progressBar.visible = true; } private function fileRef_complete(evt:Event):void { message.text += " (complete)"; progressBar.visible = false; } ]]> </mx:Script> <mx:NumberFormatter id="numberFormatter" /> <mx:Button label="Upload file" click="browseAndUpload();" /> <mx:Label id="message" /> <mx:ProgressBar id="progressBar" indeterminate="true" visible="false" /> </mx:Application> -- ----------------------------------------------- Yours Faithfully Daniel Yang

1 0

Twisted-web August 2009