Mailman 3 March 2010 - Twisted-web

Test
by Philippe Lafoucrière 05 Aug '21

05 Aug '21

Hi all just a test

3 2

Twisted and reverse proxies
by Rob Newman 31 Mar '10

31 Mar '10

Hi Twisted folks, We have a pure Twisted application that runs on a URL akin to: http://hostname:8080 We wish to use an Apache reverse proxy to allow our web users to transparently view the Twisted application 'within' our existing Apache served site. So that, something like: http://www.companyname.com/tools/twisted_app proxies to: http://hostname:8080 As someone relatively new to Twisted, how will our static (and other) resources react to being reverse proxy served? Will they barf? Is there any online documentation I can look at for case studies? Thanks in advance, - Rob

4 6

Authenticating with a certificate
by Doug Gorley 30 Mar '10

30 Mar '10

G'day Twisted list, I'm brand new to Twisted, and I'm trying to wrap my head around writing a client that authenticates with a certificate. I have a PFX file, and a small Perl script that I can use to download content, but I don't seem to be able to replicate this on other machines. I'd like to replace the whole mess with a more robust Python solution. My communication with the server needs to look like this: ---------------------------------------------------------------- ME: https://www.example.com/AUTHURL | +--------------------> SERVER: (Authenticated) | ME: https://www.example.com/FETCHCONTENT <------------+ | +--------------------> SERVER: (XML content) | ME: https://www.example.com/ACKNOWLEDGE <-------------+ | +--------------------> SERVER: (acknowledged) | ME: https://www.example.com/LOGOUT <------------------+ | +--------------------> SERVER: (logout) ---------------------------------------------------------------- I'm working from the O'Reilly Twisted book, and trying to reconcile that with the API and the examples on the Twisted site, but I'm not sure I'm finding what I need. Can anyone give me any pointers on how to proceed? Thanks muchly. -- Doug Gorley | doug.gorley(a)gmail.com

2 1

[twisted-web] Deferred and threads
by Joson Mandaro 20 Mar '10

20 Mar '10

Hi all, I'm newbie and puzzled by some problems. I create five deferred instances, Then when all of them get the responses, will they run in five threads or one by one ? I'm not sure to use multiple threads if they'll usually run in synchrony. Best regards, Joson

3 4

Web client through https proxy - is it even possible?
by Matt Pruden 19 Mar '10

19 Mar '10

I'm trying to post some data to a web server, but need to go through an https proxy. I can't seem to find anyone that's pulled this off with a twisted web client. I've been sniffing traffic and have it close, but can't quite get past creating the SSL socket. Anything I attempt to write to the transport after swapping out the standard socket for SSL.Connection fails the SSL handshake on the remote end. Here's the code so far: class MyProtocol(client.HTTPPageGetter): got_connect = False def connectionMade(self): proxy = os.environ.get('https_proxy') if proxy: self.transport.write('CONNECT %s:%s HTTP/1.0\r\n' % (self.factory.host, self.factory.port)) self.sendHeader('Host', self.factory.headers.get("host", self.factory.host)) self.sendHeader('User-Agent', self.factory.agent) self.transport.write('\r\n') else: self.got_connect = True if self.got_connect: client.HTTPPageGetter.connectionMade(self) def lineReceived(self, line): if not self.got_connect: self.got_connect == True ctx = ssl.ClientContextFactory() self.transport.stopReading() self.transport.stopWriting() self.transport.socket = SSL.Connection(ctx.getContext(), self.transport.socket) self.transport.fileno = self.transport.socket.fileno self.transport.startReading() client.HTTPPageGetter.connectionMade(self) else: client.HTTPPageGetter.lineReceived(self, line)

2 1

Newbie question on handling args in URL string
by Rob Newman 18 Mar '10

18 Mar '10

Hi Twisted-Web devs, I am using Twisted for a web-application. I have a resource called Data, for which variables are called in a URL string: http://localhost:8008/data?pet=dog&breed=lab&idtag=12345 Where 'pet' is a variable name, as is 'breed' and 'idtag', etc. This all works fine, and we get a JSON object back from the query that we use in the web application. In terms of client ease of use we want to be able to handle URL parsing, such that: http://localhost:8008/data?pet=dog&breed=lab&idtag=12345 can be written: http://localhost:8008/pet/dog/lab/12345 which is a nice semantic URL. However, we also have a bunch of static files (such as jquery javascript and images) that we serve in the application, like: http://localhost:8008/images/layout.png - and - http://localhost:8008/jquery/functionality.js We want to make sure we are handling these correctly and efficiently. From twisted.web we are using the rewrite module thus: import sys import os import re from twisted.web import server, static, rewrite from twisted.application import service, internet root = resource.Root() # Another file (resource.py) defines the resources Data() and Root() root.putChild('data', resource.Data()) root.putChild('images', static.File(images_dir)) root.putChild('jquery', static.File(js_dir)) rewrite_root = rewrite.RewriterResource(root, pathToArgs) site = server.Site(rewrite_root) application = service.Application('My App Name') internet.TCPServer(8008, site).setServiceParent(application) pathToArgs is the critical function, and it is where we are currently determining how to handle these different URL strings: def pathToArgs(request): parts = request.uri.split('/') if request.uri == '/': # Do nothing - at the root level elif 'jquery' in request.postpath: # Handle static jquery request elif 'images' in request.postpath: # Handle static image request elif len(request.postpath) == 1: # Handle only pet type elif len(request.postpath) == 2: # Handle pet type and breed elif len(request.postpath) == 3: # Handle pet type, breed and idtag # Imagine this up to 'n' variables..... elif len(request.postpath) == n # Handle n variables We seem to have an awful lot of replicated code in trying to parse the URL based on the length of the requested.postpath and dealing with each segment (split by '/') of the URL string. I feel that what we are trying to do has probably already been accounted for in the Twisted architecture available to us. Does anyone have any input on what (if anything) I am missing or lacking? Is this the correct way to approach development in Twisted? I am working my way through the O'Reilly Twisted Network Programming Essentials and studying the Twisted docs online, but I have not seen any 'best practices' approaches to application development, especially where parsing arguments is concerned. Thanks in advance, - Rob

2 1

Sending requests in HTTP/1.1
by Igor Katson 05 Mar '10

05 Mar '10

Hello! I'm trying to authorize in a specific site with twisted. However, I believe that the site requires the client to make requests with HTTP/1.1 instead of twisted.web's default HTTP/1.1 What can I do just to make the request line contain HTTP/1.1 instead of HTTP/1.0? I tried changing a line in HTTPClient.sendCommand (I have this file /usr/local/lib/python2.6/dist-packages/Twisted-10.0.0-py2.6-linux-x86_64.egg/twisted/web/http.py), but twisted.web does not work any more if I do that. Thanks in advance!

1 1

Twisted 10.0.0 released
by Jonathan Lange 03 Mar '10

03 Mar '10

On behalf of Twisted Matrix Laboratories, I am honored to announce the release of Twisted 10.0. Highlights include: * Improved documentation, including "Twisted Web in 60 seconds" * Faster Perspective Broker applications * A new Windows installer that ships without zope.interface * Twisted no longer supports Python 2.3 * Over one hundred closed tickets For more information, see the NEWS file. It's stable, backwards compatible, well tested and in every way an improvement. Download it now from: http://tmrc.mit.edu/mirror/twisted/Twisted/10.0/Twisted-10.0.0.tar.bz2 or http://tmrc.mit.edu/mirror/twisted/Twisted/10.0/Twisted-10.0.0.win32-py2.5.… Many thanks to Jean-Paul Calderone and Chris Armstrong, whose work on release automation tools and answers to numerous questions made this possible. Thanks also to the supporters of the Twisted Software Foundation and to the many contributors for this release. jml

1 0