Mailman 3 August 2008 - Twisted-web

Test
by Philippe Lafoucrière 05 Aug '21

05 Aug '21

Hi all just a test

3 2

Content-disposition and static.File
by tarjei 29 Aug '08

29 Aug '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I'm using static.File to return various pdf files to the user. The files are stored using the document ID, but I want the browser to return the correct filename. Usually I've done this(in PHP) by adding 'Content-Disposition: attachement;filename=foo.pdf', but I'm not getting this to work with twisted. Basicly I do: def locateChild(self, ctx): request = inevow.IRequest(ctx) request.setHeader("content-disposition" ,"attachment;filename=foo.pdf") return static.File(self.path_to_file) This works well (except I do not get to define the filename) if I do not add the content-disposition header, but when I do that twisted just explodes into an exception. My question is: Is this a bug or a missing feature? Also, am I doing something else wrong by setting the header before returning another page? Kind regards, Tarjei -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIt7CSYVRKCnSvzfIRApY+AKCcJF3V1F55eVQlbgNJ9mgnICjzewCcCgIr j6is0/veiuYvWuA2k9OVq1s= =Aet3 -----END PGP SIGNATURE-----

2 1

jamsratnam@gmail.com has sent you a message about IDrive.
by jamsratnam＠gmail.com 27 Aug '08

27 Aug '08

1 0

Session Based Security for PyAmf application
by Shawn Church 19 Aug '08

19 Aug '08

I want to store user data in t.w.s.Session to allow a persistent logon. As the login will be made with a PyAmf method call I do not think that t.w.w.Guard will work because it appears to process the login from POST data. It is trivial to store the user data in the session object with Request.getSession, but is this a secure method? Could someone guess the session key and use it to forge credentials? Is there a better way to do this? The PyAmf examples send the username and password with every method call. I would prefer to use the session because the user can log-on once for multiple windows/tabs. The twisted PB security model seems much more elegant then what is available for twisted.web. Am I missing something???? Thanks in advance and once again thank you for the fantastic work on twisted. Shawn Church I/S Consultant Shawn At SCchurchComputers.com

5 10

JSON "page" and nevow
by Vincent Bernat 18 Aug '08

18 Aug '08

Hi! There are several pages that I would like to serve as JSON page. Nevow include a JSON serializer but it seems there is no facility to send a page as JSON. Here is what I do: ,---- | class JsonPage(rend.Page): | | docFactory = loaders.stan ( T.div(render=T.directive("json"), | data=T.directive("json"))) | addSlash = True | flattenFactory = lambda self, *args: flat.flattenFactory(*args) | | def render_json(self, ctx, data): | """Render the given data in a proper JSON string""" | | def sanitize(data, d=None): | """Nevow JSON serializer is not able to handle some types. | | We convert those types in proper types: | - string to unicode string | - PgSQL result set into list | - handling of deferreds | """ | if type(data) in [list, tuple] or isinstance(data, PgSQL.PgResultSet): | return [sanitize(x, d) for x in data] | if type(data) == str: | return unicode(data) | if isinstance(data, rend.Fragment): | io = StringIO() | writer = io.write | finisher = lambda result: io.getvalue() | newctx = context.PageContext(parent=ctx, tag=data) | data.rememberStuff(newctx) | doc = data.docFactory.load() | newctx = context.WovenContext(newctx, T.invisible[doc]) | fl = self.flattenFactory(doc, newctx, writer, finisher) | fl.addCallback(sanitize, None) | d.append(fl) | return fl | if isinstance(data, defer.Deferred): | if data.called: | return sanitize(data.result) | return data | if isinstance(data, failure.Failure): | return unicode( | "<span class='error'>An error occured (%s)</span>" % data.getErrorMessage()) | return data | | def serialize(data): | return json.serialize(sanitize(data)) | | d = [] | data = sanitize(data, d) | d = defer.DeferredList(d) | d.addCallback(lambda x: serialize(data)) | return d | | | def beforeRender(self, ctx): | inevow.IRequest(ctx).setHeader("Content-Type", "application/json; charset=UTF-8") `---- I inherit of this class and just implement data_json. The main point is that I should be able what I do for regular web pages, including the use of deferred. There are several drawbacks: - I need to use deferred.called and deferred.result that is not part of the public API. I don't know how to avoid this. JSON serializer does not handle deferred (Fragments are rendered synchronously). - to render Fragment, I use some obscur tricks that I stole from rend.py. Not sure that this would survive. - for Fragment, serializers will turn "<" into "<". Therefore, I should turn them back as "<" on Javascript side. I did not found a way to avoid serializing twice. It seems that T.xml instead of T.div would do the trick but it does not support data and render attributes. - Nevow JSON serializer seems not te be extended to support more types. Is it some plans to allow this? Any tip to simplify or enhance the above code would be welcome. Thanks. -- Write and test a big program in small pieces. - The Elements of Programming Style (Kernighan & Plauger)

2 2

newbie question
by arun chhetri 18 Aug '08

18 Aug '08

hi, I have developed some twisted.web application. It connects to the other server (CalDav) and then it displays back using twisted.web. My problem is when a user logs into my website which is made using twisted.web there is some data fetched from CALDAV server. When another user logs into my website, even his data is downloaded from CalDav server but this data overwrites the data of previous server. I think I am not able to fork the process on each request. This is my just guess. The Code is given below from twisted.web import resource, static, server import vobject import calendarWebUtilities import Calendar import datetime import re,calendar import Month import Week import Day import socket class HomePage(resource.Resource): def render(self,request): return""" <html> <head> <title>VCalendar</title> </head> <body> <form action=/optional method="post"> User Name <input type="text" name="username"><br/> Pass Word <input type="password" name="pswd"><br/> ServerAdd <input type="text" name="server"><br/> <input type="submit" Value="Submit"><br/> </form> </body> </html>""" class Optional(resource.Resource): def __init__(self): resource.Resource.__init__(self) self.CalendarData = {} self.account = {} def render(self,request): user = request.args["username"] pswd = request.args["pswd"] server = request.args["server"] if user != None: if pswd != None: if server != None: CalendarSource = None CalendarSource = Calendar.CalendarObject(user[0],pswd[0],server[0]) todayDate = datetime.datetime.now() start = datetime.datetime((todayDate.year-1),01,01,00,00) end = datetime.datetime((todayDate.year+1),12,31,23,59,59) self.CalendarData['value'] = CalendarSource.readCalendarComponent(start,end) self.account['value'] = CalendarSource self.index = 1 request.redirect("/optional/Calendar") return " " def getChild(self,path,request): return MainCalendar(self.index,self.CalendarData,self.account) class MainCalendar(resource.Resource): def __init__(self,index,CalendarData,account): resource.Resource.__init__(self) self.index = index self.CalendarData = CalendarData self.account = account self.putChild('Add',AddCalendarComponent(self.CalendarData,self.account)) def render(self,request): global Calendarata global account if request.path == "/optional/Calendar" : request.redirect("/optional/Calendar/Month") return " " def getChild(self,path,request): if request.path == "/optional/Calendar/Month": return Month.month(self.CalendarData,self.index) elif request.path == "/optional/Calendar/Week": return Week.Week(self.CalendarData,self.index) elif request.path == "/optional/Calendar/Day": return Day.Day(self.CalendarData,self.index) class AddCalendarComponent(resource.Resource): def __init__(self,CalendarData,account): resource.Resource.__init__(self) self.CalendarData = CalendarData self.account = account def render (self,request): #if request.args != None: queryString = len(request.args) if queryString !=0: try : summary1 = request.args['summary'] location1 = request.args['location'] startDate1 = request.args['startDate'] endDate1 = request.args['endDate'] CalendarSource = self.account['value'] event = CalendarSource.convertToProperFormatAndAddToCalendar(summary1,location1,startDate1,endDate1) (self.CalendarData['value']).append(event) #CalendarData = {} #print "New Data Created" #print NewCalendar #CalendarData['value'] = NewCalendar request.redirect("/optional/Calendar") return " " except KeyError: request.args = {} request.redirect('/optional/Calendar/Month/Add') else: return""" <html> <head> </head> <body> <form action="/optional/Calendar/Add" method="post"> Summary = <INPUT type="text" name="summary"></br> Location = <input type="text" name="location"></br> Start Date = <input type="text" name="startDate">Should Be in format year/MM/date/HH/MM</br> End Date = <input type="text" name="endDate">Should Be in format year/MM/date/HH/MM</br> <input type="submit"> </form> </body> </html> """ if __name__ == "__main__": from twisted.internet import reactor root = resource.Resource() root.putChild('',HomePage()) root.putChild('optional',Optional()) site = server.Site(root) reactor.listenTCP(8000,site) reactor.run() I can guess there should be some method by which I can fork the root for different request,, Please help. Thanks

3 3

How to specify cach-control, Expires headers for the static files response
by Prajwala Manchikatla 13 Aug '08

13 Aug '08

Hi, I am using twisted.web2.static.File to serve my static files. I want to specify the Expires, Cache-control headers, so that the browser will not load this files every time. How can I specify these header? Thanks, Prajwala

2 2

linking javascript and CSS file
by arun chhetri 07 Aug '08

07 Aug '08

Hi, I tried this example class ColorPage(resource.Resource): def __init__(self, color): self.color = color def render(self, request): return """ <html> <head> <title>Color: %s</title> <DEFANGED_link type='text/css' href='/css/styles.css' rel='Stylesheet' /> </head> <body DEFANGED_STYLE='background-color: #%s'> <h1>This is #%s.</h1> <p DEFANGED_STYLE='background-color: white'> <a href='/colors/'>Back</a> </p> </body> </html> """ % (self.color, self.color, self.color) class ColorRoot(resource.Resource): def __init__(self): resource.Resource.__init__(self) self.requestedColors = [] self.putChild('', ColorIndexPage(self.requestedColors)) def render(self, request): # redirect /colors -> /colors/ request.redirect(request.path + '/') return "Please use /colors/ instead." def getChild(self, path, request): if path not in self.requestedColors: self.requestedColors.append(path) return ColorPage(path) class ColorIndexPage(resource.Resource): def __init__(self, requestedColorsList): resource.Resource.__init__(self) self.requestedColors = requestedColorsList def render(self, request): request.write(""" <html> <head> <title>Colors</title> <DEFANGED_link type='text/css' href='/css/styles.css' rel='Stylesheet' /> </head> <body> <h1>Colors</h1> To see a color, enter a url like <a href='ff0000'>/colors/ff0000</a>. <br /> Colors viewed so far: <ul>""") for color in self.requestedColors: request.write( "<li><a href='%s' DEFANGED_STYLE='color: #%s'>%s</a></li>" % ( color, color, color)) request.write(""" </ul> </body> </html> """) return "" class HomePage(resource.Resource): def render(self, request): return """ <html> <head> <title>Colors</title> <DEFANGED_link type='text/css' href='/css/styles.css' rel='Stylesheet' /> </head> <body> <h1>Colors Demo</h1> What's here: <ul> <li><a href='/colors'>Color viewer</a></li> </ul> </body> </html> """ if __name__ == "__main__": from twisted.internet import reactor root = resource.Resource() root.putChild('', HomePage()) root.putChild('colors', ColorRoot()) styles = resource.Resource() styles.putChild('styles.css', static.File('styles.css')) root.putChild('css', styles) site = server.Site(root) reactor.listenTCP(8000, site) reactor.run() with CSS code in external file styles.css, the code is like this body { font-family: Georgia, Times, serif; font-size: 11pt; } h1 { margin: 10px 0; padding: 5px; background-color: black; color: white; } a{ font-family: monospace; } p{ padding: 10px; } But, there is no results. Any pointer what I am doing wrong, I am using MAC OS leopard. Thanks dowell

1 0

Proxy CONNECT support
by Felix Ingram 07 Aug '08

07 Aug '08

Hello all, I'm looking into adding HTTPS support to the proxy module for some testing I'm doing. I'd like to be able to trap requests and responses as they go to and from the server, so proper CONNECT support is not really what I'm aiming for. I've come up with the following (quite long, apologies): """ from twisted.web import proxy, http from twisted.internet import reactor, ssl from twisted.python import log import sys import urlparse from OpenSSL import SSL as OSSL class MyProxyClient(proxy.ProxyClient): def handleEndHeaders(self): print "THOSE HEADERS DONE ENDED" self.father.transport.write("\r\n") def handleResponsePart(self, buffer): print "GOT SOME STUFF TO SEND TO THE BROWSER" self.father.transport.write(buffer) def dataReceived(self, data): print "To the Browser" print data # Data sent to the browser proxy.ProxyClient.dataReceived(self, data) def handleResponseEnd(self): print "losing connection..." self.transport.loseConnection() self.father.channel.transport.loseConnection() class MyProxyClientFactory(proxy.ProxyClientFactory): def buildProtocol(self, addr): client = proxy.ProxyClientFactory.buildProtocol(self, addr) client.__class__ = MyProxyClient return client class MySSLContext(ssl.ContextFactory): def getContext(self): ctx = OSSL.Context(OSSL.SSLv23_METHOD) ctx.use_certificate_file('server.cert') ctx.use_privatekey_file('server.pkey') return ctx class MyProxyRequest(proxy.ProxyRequest): protocols = { 'http': MyProxyClientFactory, 'https': MyProxyClientFactory } ports = { 'http': 80, 'https': 443 } def requestDone(self, request): """Called by first request in queue when it is done.""" print "REQUESTDONE DONE BE CALLED" if request != self.requests[0]: raise TypeError del self.requests[0] if self.persistent: # notify next request it can start writing if self.requests: self.requests[0].noLongerQueued() else: if self._savedTimeOut: self.setTimeout(self._savedTimeOut) else: print "lOSING CONNECTION" self.transport.loseConnection() def process(self): parsed = urlparse.urlparse(self.uri) protocol = parsed.scheme host = parsed.hostname doSSL = False if self.method.upper() == "CONNECT": self.transport.write("HTTP/1.1 200 Connection established\r\n\r\n") self.transport.startTLS(MySSLContext()) protocol = "https" self.host = parsed.scheme print "finished connect request" else: if self.isSecure(): headers = self.getAllHeaders().copy() host = headers["host"] protocol = "https" doSSL = True port = self.ports[protocol] if ':' in host: host, port = host.split(':') port = int(port) rest = urlparse.urlunparse(('', '') + parsed[2:]) if not rest: rest = rest + '/' class_ = self.protocols[protocol] headers = self.getAllHeaders().copy() if 'host' not in headers: headers['host'] = host self.content.seek(0, 0) s = self.content.read() clientFactory = class_(self.method, rest, self.clientproto, headers, s, self) if not doSSL: self.reactor.connectTCP(host, port, clientFactory) else: print "Connecting to SSL" self.reactor.connectSSL(host, port, clientFactory, ssl.ClientContextFactory()) class MyProxy(proxy.Proxy): def dataReceived(self, data): print "To the Server" print data # Data sent to the server proxy.Proxy.dataReceived(self, data) def requestFactory(self, *args): return MyProxyRequest(*args) class ProxyFactory(http.HTTPFactory): protocol = MyProxy reactor.listenTCP(8081, ProxyFactory()) log.startLogging(sys.stdout) # Log to the console reactor.run() """ Most of the magic is happening in the 'process' method. I've copied some of the other methods in for debugging. At the moment it's a bit hackish but it's almost working as expected. When a connect request is received then the SSL connection is set up as required (using transport.startTLS). This generates certificate mismatch errors in the browser, but this is expected and is what I'm looking for. The GET request is then received from the browser and forwarded on to the server. The server appears to be happy with this as it does pass the appropriate response back to the proxy. For some reason, however, the browser does not then get passed the response. Comparing identical requests for the HTTP and HTTPS versions of a site show that the only apparent difference is that the headers and body are sent in one go under HTTP and as two separate chunks under HTTPS. E.g. HTTPS: """ 2008-08-07 15:34:15+0100 [MyProxyClient,client] To the Browser 2008-08-07 15:34:15+0100 [MyProxyClient,client] HTTP/1.1 200 OK 2008-08-07 15:34:15+0100 [MyProxyClient,client] Date: Thu, 07 Aug 2008 14:34:15 GMT 2008-08-07 15:34:15+0100 [MyProxyClient,client] Server: Apache/2.2.9 (Win32) DAV/2 mod_ssl/2.2.9 Ope nSSL/0.9.8h mod_autoindex_color PHP/5.2.6 2008-08-07 15:34:15+0100 [MyProxyClient,client] X-Powered-By: PHP/5.2.6 2008-08-07 15:34:15+0100 [MyProxyClient,client] Content-Length: 1325 2008-08-07 15:34:15+0100 [MyProxyClient,client] Connection: close 2008-08-07 15:34:15+0100 [MyProxyClient,client] Content-Type: text/html 2008-08-07 15:34:15+0100 [MyProxyClient,client] 2008-08-07 15:34:15+0100 [MyProxyClient,client] 2008-08-07 15:34:15+0100 [MyProxyClient,client] THOSE HEADERS DONE ENDED 2008-08-07 15:34:15+0100 [MyProxyClient,client] To the Browser 2008-08-07 15:34:15+0100 [MyProxyClient,client] <html> 2008-08-07 15:34:15+0100 [MyProxyClient,client] <head><title>XAMPP</title> 2008-08-07 15:34:15+0100 [MyProxyClient,client] <link href="xampp.css" rel="stylesheet" type="text/c ... """ HTTP: """ 2008-08-07 15:34:01+0100 [MyProxyClient,client] To the Browser 2008-08-07 15:34:01+0100 [MyProxyClient,client] HTTP/1.1 200 OK 2008-08-07 15:34:01+0100 [MyProxyClient,client] Date: Thu, 07 Aug 2008 14:34:01 GMT 2008-08-07 15:34:01+0100 [MyProxyClient,client] Server: Apache/2.2.9 (Win32) DAV/2 mod_ssl/2.2.9 Ope nSSL/0.9.8h mod_autoindex_color PHP/5.2.6 2008-08-07 15:34:01+0100 [MyProxyClient,client] X-Powered-By: PHP/5.2.6 2008-08-07 15:34:01+0100 [MyProxyClient,client] Content-Length: 1325 2008-08-07 15:34:01+0100 [MyProxyClient,client] Connection: close 2008-08-07 15:34:01+0100 [MyProxyClient,client] Content-Type: text/html 2008-08-07 15:34:01+0100 [MyProxyClient,client] 2008-08-07 15:34:01+0100 [MyProxyClient,client] <html> 2008-08-07 15:34:01+0100 [MyProxyClient,client] <head><title>XAMPP</title> 2008-08-07 15:34:01+0100 [MyProxyClient,client] <link href="xampp.css" rel="stylesheet" type="text/c """ The HTTPS version seems to have an extra line feed being added after the headers, which may be causing the problem. I've tried stripping this out but then I get some other exception being thrown and HTTP traffic stops working. I've got a feeling that I'm not quite going about this in the correct way but I'd appreciate any help or insights that anyone could offer. If you need any more details then please ask. Many thanks in advance, Felix

1 0

linking javascript and CSS file
by arun chhetri 07 Aug '08

07 Aug '08

Hi, I am new to twisted.web and as per the requirement of my project I have to link a CSS and JavaScript file to twisted.web. Please, give me some example or pointer how to do that Thanks, dowell

2 1