Mailman 3 November 2011 - Twisted-web

Test
by Philippe Lafoucrière 05 Aug '21

05 Aug '21

Hi all just a test

3 2

Porting the features of nevow.guard to twisted.web.guard
by L. Daniel Burr 05 Jan '12

05 Jan '12

Hi gang, Per a short chat with exarkun (thanks exarkun), I'm posting this to the list for discussion. A project upon which I am working requires a twisted.web service that allows a user to delegate authentication/authorization to a third party, e.g., Facebook, Twitter, et cetera. In so doing, I've found myself missing nevow.guard, since web.guard currently only has out-of-the-box support for HTTP Auth. I'd like to see web.guard expand to cover more kinds of auth, such as form-based auth or the OAuth-based solutions coming from so many social graph sites. With this in mind, I asked exarkun about this, and he mentioned that the only thing he does not consider to be garbage in nevow.guard is the feature-set, and that I should port the features to web, discarding the baggage. I'd like to solicit the list for some guidance as to what those features are, or should be, and hopefully end up with a ticket describing the features to be implemented, which I will then attempt to implement and contribute to twisted.web. Thanks, Daniel -- L. Daniel Burr ldanielburr(a)mac.com (312) 656-8387

5 5

twisted.web.template output encoding
by exarkun＠twistedmatrix.com 05 Jan '12

05 Jan '12

Hello all, I recently did some work on <http://twistedmatrix.com/trac/ticket/4896> ("twisted.web.util.formatFailure vulnerable to XSS in rare cases"). Rather than apply the patch adding extra html.escape calls, I tried porting the function to twisted.web.template (presently it builds the html string manually). Apart from various issues relating to the lack of patterns in twisted.web.template, the main difficulty is in handling non-ascii contents in the traceback. Apart from any unicode that may show up in the source code being rendered (or, perhaps, eventually, the values of variables to be rendered - though for now I do not plan to implement this) the no-break space characters which are necessary to get traceback lines indented properly mean that there is always some non-ascii to include in the output. twisted.web.template encodes its output using UTF-8, and this is not customizable. Thus, using twisted.web.template, formatFailure's result will be a str containing UTF-8 encoded text. Previously the result was a str containing only ASCII encoded text, with no-break space represented as ` �. Consequently, callers of `formatFailure� will probably mishandle the result - the caller in `twisted.web.server� does, at least, including the bytes in a page with a content type of "text/html". The solutions that come to mind are all about removing this incompatible change and making it so `formatFailure� can continue to return a str with ASCII-encoded text. One solution is to add support for named entities or numeric character references to twisted.web.template. Very likely this is a good idea regardless (Nevow supported these). Another solution is to use a different encoding in `twisted.web.template� - ASCII, with xmlcharrefreplace as the error handler. This is tempting since it avoids an obtrusive non-ASCII support API (the way Nevow supports these is via `nevow.entities�, which must be used rather than normal Python unicode objects). Perhaps another question is whether the encoding used by `twisted.web.template� should be a parameter. A related question raised might be whether `twisted.web.template� should encoded to bytes at all, or delegate the responsibility for that to code closer to a socket. As a work-around in `formatFailure� I can decode the output of the flattener using UTF-8 and then re-encode it to avoid non-ASCII, but it seems like this should be solved in `twisted.web.template� rather than over and over again in application code. Jean-Paul

5 7

CorePost 0.0.8 is out
by Jacek Furmankiewicz 22 Nov '11

22 Nov '11

New release of the REST microframework built on top of Twisted Web APIs. http://pypi.python.org/pypi/CorePost Minor enhancements to support properly YAML/XML marshaling of Python return types. Cheers, Jacek

1 0

Bug 3031, handling interrupted responses in nevow
by Peter Westlake 20 Nov '11

20 Nov '11

Did anything happen with my patch for ticket 3031? It fixed an error where Request.finish() is called after a redirection, or when the connection closes for some other reason. Peter.

3 8

Fwd: Troubles installing 11.1.0 - is this expected?
by Jacek Furmankiewicz 18 Nov '11

18 Nov '11

Under python2.7 *sudo python2.7 -m easy_install -U twisted* *[sudo] password for jacekf: * *Searching for twisted* *Reading http://pypi.python.org/simple/twisted/* *Reading http://www.twistedmatrix.com* *Reading http://twistedmatrix.com/products/download* *Reading http://twistedmatrix.com/* *Reading http://tmrc.mit.edu/mirror/twisted/Twisted/9.0/* *Reading http://twistedmatrix.com/projects/core/* *Reading http://tmrc.mit.edu/mirror/twisted/Twisted/8.1/* *Reading http://tmrc.mit.edu/mirror/twisted/Twisted/8.2/* *Reading http://tmrc.mit.edu/mirror/twisted/Twisted/10.0/* *Best match: Twisted 11.1.0* *Downloading http://pypi.python.org/packages/source/T/Twisted/Twisted-11.1.0.tar.bz2#md5… * *Processing Twisted-11.1.0.tar.bz2* *Running Twisted-11.1.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-YBvWK_/Twisted-11.1.0/egg-dist-tmp-zIO__W* *Traceback (most recent call last):* * File "/usr/local/lib/python2.7/runpy.py", line 162, in _run_module_as_main* * "__main__", fname, loader, pkg_name)* * File "/usr/local/lib/python2.7/runpy.py", line 72, in _run_code* * exec code in run_globals* * File "build/bdist.linux-i686/egg/easy_install.py", line 5, in <module>* * File "build/bdist.linux-i686/egg/setuptools/command/easy_install.py", line 1712, in main* * File "build/bdist.linux-i686/egg/setuptools/command/easy_install.py", line 1700, in with_ei_usage* * File "build/bdist.linux-i686/egg/setuptools/command/easy_install.py", line 1716, in <lambda>* * File "/usr/local/lib/python2.7/distutils/core.py", line 152, in setup* * dist.run_commands()* * File "/usr/local/lib/python2.7/distutils/dist.py", line 953, in run_commands* * self.run_command(cmd)* * File "/usr/local/lib/python2.7/distutils/dist.py", line 972, in run_command* * cmd_obj.run()* * File "build/bdist.linux-i686/egg/setuptools/command/easy_install.py", line 211, in run* * File "build/bdist.linux-i686/egg/setuptools/command/easy_install.py", line 446, in easy_install* * File "build/bdist.linux-i686/egg/setuptools/command/easy_install.py", line 476, in install_item* * File "build/bdist.linux-i686/egg/setuptools/command/easy_install.py", line 655, in install_eggs* * File "build/bdist.linux-i686/egg/setuptools/command/easy_install.py", line 930, in build_and_install* * File "build/bdist.linux-i686/egg/setuptools/command/easy_install.py", line 919, in run_setup* * File "build/bdist.linux-i686/egg/setuptools/sandbox.py", line 62, in run_setup* * File "build/bdist.linux-i686/egg/setuptools/sandbox.py", line 105, in run * * File "build/bdist.linux-i686/egg/setuptools/sandbox.py", line 64, in <lambda>* * File "setup.py", line 103, in <module>* * File "setup.py", line 74, in main* * File "setup.py", line 31, in getExtensions* * File "twisted/topfiles/setup.py", line 21, in <module>* *ImportError: cannot import name _isCPython* Under PyPy, same errors as before: *pypy -m easy_install -U twisted* *Searching for twisted* *Reading http://pypi.python.org/simple/twisted/* *Reading http://www.twistedmatrix.com* *Reading http://twistedmatrix.com/products/download* *Reading http://twistedmatrix.com/* *Reading http://tmrc.mit.edu/mirror/twisted/Twisted/9.0/* *Reading http://twistedmatrix.com/projects/core/* *Reading http://tmrc.mit.edu/mirror/twisted/Twisted/8.1/* *Reading http://tmrc.mit.edu/mirror/twisted/Twisted/8.2/* *Reading http://tmrc.mit.edu/mirror/twisted/Twisted/10.0/* *Best match: Twisted 11.1.0* *Downloading http://pypi.python.org/packages/source/T/Twisted/Twisted-11.1.0.tar.bz2#md5… * *Processing Twisted-11.1.0.tar.bz2* *Running Twisted-11.1.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-K4bVb9/Twisted-11.1.0/egg-dist-tmp-e8Q1QN* *Traceback (most recent call last):* * File "app_main.py", line 53, in run_toplevel* * File "/home/jacekf/bin/pypy-1.6/lib-python/2.7/runpy.py", line 162, in _run_module_as_main* * "__main__", fname, loader, pkg_name)* * File "/home/jacekf/bin/pypy-1.6/lib-python/2.7/runpy.py", line 72, in _run_code* * exec code in run_globals* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/easy_install.py", line 5, in <module>* * main()* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/command/easy_install.py", line 1864, in main* * with_ei_usage(lambda:* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/command/easy_install.py", line 1845, in with_ei_usage* * return f()* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/command/easy_install.py", line 1868, in <lambda>* * distclass=DistributionWithoutHelpCommands, **kw* * File "/home/jacekf/bin/pypy-1.6/lib-python/modified-2.7/distutils/core.py", line 152, in setup* * dist.run_commands()* * File "/home/jacekf/bin/pypy-1.6/lib-python/modified-2.7/distutils/dist.py", line 953, in run_commands* * self.run_command(cmd)* * File "/home/jacekf/bin/pypy-1.6/lib-python/modified-2.7/distutils/dist.py", line 972, in run_command* * cmd_obj.run()* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/command/easy_install.py", line 345, in run* * self.easy_install(spec, not self.no_deps)* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/command/easy_install.py", line 585, in easy_install* * return self.install_item(spec, dist.location, tmpdir, deps)* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/command/easy_install.py", line 615, in install_item* * dists = self.install_eggs(spec, download, tmpdir)* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/command/easy_install.py", line 805, in install_eggs* * return self.build_and_install(setup_script, setup_base)* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/command/easy_install.py", line 1082, in build_and_install* * self.run_setup(setup_script, setup_base, args)* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/command/easy_install.py", line 1071, in run_setup* * run_setup(setup_script, args)* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/sandbox.py", line 30, in run_setup* * lambda: execfile(* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/sandbox.py", line 72, in run* * return func()* * File "/home/jacekf/bin/pypy-1.6/site-packages/distribute-0.6.19-py2.7.egg/setuptools/sandbox.py", line 32, in <lambda>* * {'__file__':setup_script, '__name__':'__main__'}* * File "setup.py", line 103, in <module>* * File "setup.py", line 45, in main* *ImportError: cannot import name 'copyright'* Sorry :-( Jacek

3 8

Twisted 11.1.0 Released
by Thomas Hervé 18 Nov '11

18 Nov '11

On behalf of Twisted Matrix Laboratories, I am pleased to announce the release of Twisted 11.1. Highlights of the 185 tickets closed include: * The poll reactor as default where applicable, instead of select everywhere. * A new SSL implementation only relying on OpenSSL for cryptography, (not I/O) making it more robust. * Several improvements to the fresh HTTP/1.1 client implementation, including proxy and cookie support. * My personal favorite: a new howto has been published on test-driven development with Twisted. * A special mention to the new abortConnection support on TCP and SSL connections, heroically pushed by Itamar and Jean-Paul, and the oldest ticket closed by this release. This is the last release supporting Python 2.4 (the support on Windows stopped with 11.0). For more information, see the NEWS file here: http://twistedmatrix.com/Releases/Twisted/11.1/NEWS.txt Download it now from: http://pypi.python.org/packages/source/T/Twisted/Twisted-11.1.0.tar.bz2 or http://pypi.python.org/packages/2.5/T/Twisted/Twisted-11.1.0.win32-py2.5.msi or http://pypi.python.org/packages/2.6/T/Twisted/Twisted-11.1.0.win32-py2.6.msi or http://pypi.python.org/packages/2.7/T/Twisted/Twisted-11.1.0.win32-py2.7.msi Thanks to the supporters of the Twisted Software Foundation and to the many contributors for this release. -- Thomas

6 6

Adding a private protocol to Twisted SSL Web server...
by Jerry Westrick 17 Nov '11

17 Nov '11

Hello fellow twisters: I'm writing an ActionScript application with it's corresponding server built upon twisted. first off, I'd like to thank you all for the awesome software you've all put into my hands. Since I'm taking your time I'll get right to the point. What is required - secure serving of web pages (works via twisted web/SSL) - proprietary socket protocol (works with TCPServer and pyAMF). - client access server only via port 443 <--- here I have the questions What I think I need to do is to capture an SSL CONNECT command, steal the the connection and use it as my proprietary communication socket. I've gotten access to the connection using the render_CONNECT() method, and having the client issue a corresponding command. What I cant figure out is how best to remove the connection from the HTTP protocol and setup a pass-thru to my application. (This is prefered to be able to run multiple servers on different machines) I would hate to 'fudged' code into the system all the way down in basic.py, and your code is well modularized that I feel there should be a way to accomplish this, but it seams to be above my current pay grade ;-) Thank You all for your time, and hope the problem is interesting enough to evoke responses Jerry

1 1

How to restore sessions after restart app?
by Аркадий Левин 07 Nov '11

07 Nov '11

After restart twisted.web.server.Site all sessions lost, how it restore?

2 1

Twisted-web November 2011