Mailman 3 June 2003 - Twisted

[Twisted-Python] PATCH: doc/howto/flow.py two typos
by Lee Harr 27 Jun '03

27 Jun '03

>cvs diff -u doc/howto/flow.html Index: doc/howto/flow.html =================================================================== RCS file: /cvs/Twisted/doc/howto/flow.html,v retrieving revision 1.3 diff -u -r1.3 flow.html --- doc/howto/flow.html 26 Jun 2003 09:26:15 -0000 1.3 +++ doc/howto/flow.html 27 Jun 2003 02:59:41 -0000 @@ -14,7 +14,7 @@ <h3>Handling more than one Request</h3> -<p>When creating services to handle simoutaneous requests, processing state +<p>When creating services to handle simultaneous requests, processing state must be managed. A common approach, threading, applies the method used for single user operations: keeping processing state within local variables and function arguments. In this case, the operating environment handles @@ -62,7 +62,7 @@ are done in a parallel, cooperative manner. While this is a good start, it isn't perfect as the event loop is stopped with a hard-coded timeout. It would be better for each Request object to signal when it is completed -so that the event loop can be shuot down sooner.</p> +so that the event loop can be shut down sooner.</p> <h3>Deferred Callbacks</h3> _________________________________________________________________ Protect your PC - get McAfee.com VirusScan Online http://clinic.mcafee.com/clinic/ibuy/campaign.asp?cid=3963

1 0

[Twisted-Python] Broken Twisted on Debian/sarge
by Alex Levy 27 Jun '03

27 Jun '03

I'm using Debian sarge for my server, with twisted-web and twisted-python, and until recently was very happy at never having to touch Apache again. Now it's all dead. I did a standard 'apt-get upgrade', which moved me up to twisted-python version 1.0.5+1.0.6rc2. I am running a server thusly: mktap web --path ./docroot --allow-ignore-ext --logfile ./web.log That's all. No more. And when I browse to http://mysite/, instead of serving up 'index.html' (which exists), it endlessly redirects, with my log files piling up with requests for http://mysite///////////////////// Now, if the docroot directory is _empty_, or if it has no index files, it displays a directory listing normally. So it seems the problem is only when returning an index file. Additionally, navigating to http://mysite/index.html works fine. It's only when you have http://mysite/ that things get weird. When I signed up for Debian 'unstable', this isn't quite what I expected ;) Help? -- Alex Levy WWW: http://mesozoic.geecs.org "Never let your sense of morals prevent you from doing what is right." -- Salvor Hardin, Isaac Asimov's _Foundation_

4 5

[Twisted-Python] The problem with Twisted...
by jml＠ids.org.au 26 Jun '03

26 Jun '03

... is that we have no word for "entrepreneur". Just had a conversation with a guy on #python, and he raised some valid points. He appeared to be a programmer, and his concerns were focussed on his job, and on pitching Twisted to mgmt. Firstly, his biggest concern was documentation. He said that he doesn't want to trawl through Twisted's source code to figure things out. These days, (most of the time) you don't have to do that, but occasionally you do. Of course, our code is generally quite readable (except for the odd module here and there). Suggestions: * API docs Ask ten Java developers what they like most about Java, and nine will say "the API docs". I humbly suggest that we should get better at writing these. * Howtos I remain somewhat unconvinced that the best way to write a book is to present a series of HOWTOs. But then, I also reckon that most of what we call HOWTOs, aren't. Secondly, he couldn't find any information on the twistedmatrix.com website that said "Managers, this is why you should use Twisted". I hate writing that sort of thing, but I imagine it needs to be done. It could call cred an "Identity Server" and things like that. It could also not use "asynchronous" as selling point. Managers want to hear words they've already heard. They want to hear why Twisted isn't just something cobbled together by a bunch of geeks in their bedrooms. The Java website starts off with a page geared entirely towards management (even if the headings don't say so), with all the useful programmer stuff hidden away from view. Would it be a stupid idea to have: - http://www.twistedmatrix.com/ : Twisted, the Framework of your Internet - http://www.twistedmatrix.com/dev/ : You have been sucked into the vortex. ?? Or even dispense with a site that targets developers entirely, except for a "This is why Twisted's technology is cool" page. After all, the grunts will be happy with doco, and coders who want more than that will find it on the list and the channel. Thirdly, we should really, really, really get Coil done. This guy didn't mention it, but I know many people (good programmers, even) who feel uncomfortable at a command line, and much prefer web-based (or Windows-based) administration. One of the cool things about Twisted is that it's extremely easy to start a server for just about anything on your personal PC. This would be made much more obvious with a GUI like Coil. Now, all this is suggested humbly and tentatively. I'm not sure whether any of these things are good things. I do know that they'd make ppl who I've worked with in corporate environments more comfortable. (and not just the muppets) I'm very interested in discussion, and what you all think of this. Also, I hope this email isn't critical in a vague way, and isn't inflammatory. It's not meant that way, rather it's meant to note problems that other people see and have told me, and to suggest ways of solving them. cheers, jml

10 20

[Twisted-Python] Want CVS Write Access
by Danny 26 Jun '03

26 Jun '03

Hi! I'm requesting CVS Write Access to twisted repository because I want to work on stuff at twisted/protocols/jabber.py and multiple stuff in the twisted/im directory :) Also, if the twisted.im is currently unmaintained, I want to offer myself as a sacrif... uhm maintainer of the im stuff :) Also, which cvs tags are in use and should be honored etc ? @ Moshez : yah yah sorry yadda yadda :) I'm very late :) cheers, Danny

1 0

[Twisted-Python] Storing site-wide information and scheduling tasks
by Thomas Weholt ( PRIVAT ) 26 Jun '03

26 Jun '03

I want to start a webserver which have object ( or whatever ) available in all Resource-instances running in that server which holds common information for the entire site. What's the appropriate module to use for this; Application, Factory ?? In the same server I need to start tasks ( ie. run functions ) at different intervals. These function-calls can take some time ( they can fetch files from the net, scan the local filesystem etc. ) so I guess I need threads, deferred or something similar. These function-calls must return a result and update the persistent object mentioned above. Can anybody show me a very basic example on how to do this? Thanks. Best regards, Thomas

2 4

[Twisted-Python] flow is now in twisted
by Clark C. Evans 26 Jun '03

26 Jun '03

As of this early morning, the flow module has moved from the sandbox into twisted.flow; for those using the sandbox version, simply change: import flow to from twisted.flow import flow The only change was to break flow.py into several chunks flow/base exceptions and abstract base classes flow/stage public stages such as Zip, Merge, Callback, etc. flow/controller controllers, such as Block and Deferred flow/threads threading support and QueryIterator flow/protocol makeProtocol and Protocol However, to make it easy, all of the public classes in the above files have been imported into a 'mega' module: flow/flow.py This is just a file which imports public objects from the other files. On the TODO list includes: 1. Link flow to what ever the next generation Consumer/Producer interfaces are so that flow just slips in. 2. Add more to flow/protocol to support various sorts of filters on protocols (such as an equivalent to LineReader) 3. More documentation (can there ever be enough?) 4. A "C" version, when the time is ripe; this will mostly focus on two functions: Stage.next() and _Iterator._yield() In the next 3 months I won't have much time to throw at this, but I am always open to suggestions and improvements. Extra thank-yous to Etrepum, Itamar, Exarkun, Radix, Glyph, and Pahan. Share and Enjoy! Clark

3 3

[Twisted-Python] Using Guard and Woven (Newbie)
by John Janecek 26 Jun '03

26 Jun '03

I have been examining Twisted and it seems excellent. The only problem is that twisted seems to require an adjustment in my thinking :) Are there any examples somewhere on how to use. Module twisted.web.woven.guard and Module twisted.web.guard I am not too good with explanations and just prefer the code so i can figure out how it works I have searched the web but obviously I am looking in the wrong places :) basically right now what i would like to do is modify the Words server web interface so it requires a username/password to view it. Would it be advantagous/possible to like convert it to a woven server, or am i out to lunch :) Thanx in advance for reajusting my thinking ;)

1 0

[Twisted-Python] Get the data while it's fresh
by Glyph Lefkowitz 26 Jun '03

26 Jun '03

While the #1 article here is still about Twisted, I just wanted to link: http://www.ibm.com/developerworks permalink for archive readers: http://www-106.ibm.com/developerworks/linux/library/l-twist1.html Maybe if somebody could post this to slashdot as well, I will actually be /physically unable/ to access the internet! Hooray! (Many thanks to Dr. Mertz for this excellent article.)

1 0

[Twisted-Python] Re: [Twisted-commits] Fix call to non-existent function, remove unused import
by Paul Boehm 26 Jun '03

26 Jun '03

On Wed, Jun 25, 2003 at 07:35:54AM -0500, spiv CVS wrote: > Index: Twisted/twisted/web/html.py > diff -u Twisted/twisted/web/html.py:1.16 Twisted/twisted/web/html.py:1.17 > --- Twisted/twisted/web/html.py:1.16 Thu Jun 12 19:28:34 2003 > +++ Twisted/twisted/web/html.py Wed Jun 25 07:35:53 2003 [...] > def PRE(text): > "Wrap <pre> tags around some text and escape it with web.escapehtml." > - return "<pre>"+escapehtml(text)+"</pre>" > + return "<pre>"+escape(text)+"</pre>" [...] documentation for PRE is out of synch

2 1

[Twisted-Python] Getting Stories Straight (RPYs)
by Moshe Zadka 25 Jun '03

25 Jun '03

First, let me clarify: I never said "don't use listenTCP". I merely said that using application.listenTCP(0,...) is a bad idea, and if you want to listen on an arbitrary port, you should do it with an ApplicationService. Now, let me clarify the position about RPYs: The official line is "your development must be orthogonal to your deployment". What this means is that if you are developing a web application, it should be a resource with children, and internal links. Some of the children may use Woven, some may be resources manually using .write, etc. The point is, the code should be in a Python module, or package, *outside* the web tree. You will probably want to test your application as you develop it. There are many ways to test, starting with dropping an .rpy which looks like """ from mypackage import toplevel resource = toplevel.Resource(file="foo/bar", color="blue") """ into a directory, and then running % mktap web --path=/directory % twistd -f web.tap to writing a Python script like """ #!/usr/bin/python2.2 from twisted.web import server from twisted.internet import reactor from mypackage import toplevel reactor.listenTCP(8080, server.Site(toplevel.Resource(file="foo/bar", color="blue"))) reactor.run() """ Which one of these strategies you use is not terribly important, since (and this is the important part) deployment is *orthogonal*. Later, when you want users to actually *use* your code, you should worry about what to do -- or rather, don't. Users may have widely different needs. Some may want to run your code in a different process, so they'll use distributed web. Some may be using the Debian package, and will drop in % cat > /etc/local.d/99addmypackage.py from mypackage import toplevel default.putChild("mypackage", toplevel.Resource(file="foo/bar", color="blue")) ^D If you want to be friendly to your users, you can supply many examples in your package, like the above .rpy and the Debian-package drop-in. But the *ultimate* friendliness is to write a useful resource which does not have deployment assumptions built in. This is what itamar meant by "Twisted.Web is not PHP": since we have a better tool for organizing code (Python modules and packages), use it. In PHP, the only tool for organizing is web pages, which leads to silly things like PHP pages full of functions that other pages import, etc. etc. If you translate this wholesale into Python, you may assume the correct way to do web development is to have many RPYs, all importing some Python module. This is a *bad idea* -- it mashes deployment with development, and makes sure your users will be *tied* to the file-system. We respect you enough to assume you're using Twisted.Web to write non-trivial applications. This means that you will eventually have the Twisted.Web Zen, by the time you finish to write your application. Using itamar's methodology insures that when you *do* have the Zen, you will have less of an itch to throw it away and start anew because it is crap. So, to sum up: We have .rpys because they are useful and necessary. But using them incorrectly leads to horribly unmaintainable applications. The best way to insure using them correctly is to not use them at all, until you are on your *final* deployment stages. By then, the whole "An RPY must be less than 10 lines" will be superfluous because you will not *have* more than 10 lines to write. -- Moshe Zadka -- http://moshez.org/ Buffy: I don't like you hanging out with someone that... short. Riley: Yeah, a lot of young people nowadays are experimenting with shortness. Agile Programming Language -- http://www.python.org/

8 17