Mailman 3 March 2006 - Twisted

[Twisted-Python] ftp server
by John Pote 22 Mar '06

22 Mar '06

Hi everyone. I've just started looking at Twisted as I need an ftp server and possibly a TCP listener on an internet connected server. I have the new 'Twisted' book which looks like it should get me going pretty quick. But looking at the ......\twisted\protocols\ftp.py the following comment is found:- """ An FTP protocol implementation . . API stability: FTPClient is stable, FTP and FTPFactory (server) is unstable. """ As it is the server that I am interested in the 'unstable' comment is somewhat worrying. Any comments on this instability would be appreciated. i.e. is it particular situations that cause problems or are there general problems with the server that may occur doing simple things. The application is for continuous data gathering where continuity of the data is vital. (The data source streams data continuously, sending small amounts of data every few minutes. Source buffering can back up 1 or 2 hours worth of data but then it has to be uploaded or it's lost forever) Also I do not want the uploaded file contents written directly to disk. I want to pass it to another python app/object to decode it, format it and finally append it to a file on disk. Could the Twisted ftp server allow such 'filtering'? The reason for doing this via ftp is the data source client is a GPRS modem that has ftp built in (but not http). The alternative is to do my own thing directly via TCP. Comments invited. Thanks for any help you can give, John Pote

2 2

[Twisted-Python] Mixing generator style (yield+twisted.flow) functions with deferreds?
by Marcin Kasperski 21 Mar '06

21 Mar '06

I develop some twisted application using 'traditional' method (plenty of deferreds and small callbacks). Works well, but is not too readable and a bit difficult to maintain. Therefore, I would like to move into twisted.flow-style coding (single longer function returning flow.Cooperate() from time to time, wrapped with flow.Deferred). There is a problem nevertheless. I still have some functions which return deferreds and which results are needed in the processing. Is it possible to somehow wrap them and keep yield-style of coding? To explain what do I mean, take a look at the code below, written using generators. It is clean, nice and easy to maintain, but at the same time well-behaving in cooperative environment. Just what I want to use. from __future__ import generators from twisted.internet import reactor, defer from twisted.flow import flow def someFunction(name): return flow.Deferred( someFunctionBody(name) ) def someFunctionBody(name): x = 1 print name, x yield flow.Cooperate() x = x+1 print name, x yield flow.Cooperate() x = x+1 print name, x yield flow.Cooperate() x = x+1 print name, x yield x d = defer.DeferredList([someFunction('a'), someFunction('b')]) d.addCallback(lambda _: reactor.stop()) reactor.run() What is the problem? Imagine that somewhere within the function I need to call some deferred-returning function (and use its result in the further computation)? For instance so: def someFunctionBody(name): x = 1 print name, x yield flow.Cooperate() x = x+1 print name, x yield flow.Cooperate() d = functionReturningDeferredWhichFiresInteger(x) #### and here some magic to extract value from d to x #### would be so nice print name, x yield flow.Cooperate() x = x+1 print name, x yield x Is it possible to apply some syntax glue to keep the code in one piece, without splitting the function and callback-ing explicite? I do *not* want to call deferred synchronously, I just search for opportunity to have nicely-looking code. At the first sight I doubt, but ... I would never believe that the generator-based code is possible until I saw it... If the general solution is not possible, another question. What if, in the critical place, I need to call computation-intensive database function (currently deferred using enterprise api)?

2 2

[Twisted-Python] using gtk without threads and pb
by Kim Novak 21 Mar '06

21 Mar '06

I am new to twisted and am trying to figure out if I can use it with gtk but without threads. I need this because of an old library I'm using that doesn't work with gtk threads. Since I have to run single threaded the async xml rpc offered by Twisted is ideal for my application to work well. To test this I tweaked the example pbgtk2.py to disable threads as recommended here: http://twistedmatrix.com/trac/ticket/1083 The tweaked version is attached. I start pbecho.py and run my pbgtk2.py. When I click connect it eventually times out. Without my tweaks it connects immediately. Does anyone know if this is supposed to be possible? If so, what I am I doing wrong? I am using python v2.3 and pygtk v2.6. Thanks Kim

3 4

[Twisted-Python] twisted.protocols.telnet or twisted.conch.telnet?
by James Schend 21 Mar '06

21 Mar '06

I'm new to both Twisted and Python, so excuse this question if it's a stupid one. I'm trying to create a telnet server for a MUD, and the twisted classes look to be the easiest way to accomplish this. I've found an example on an archived post on this mailing list which used: from twisted.protocols.telnet import * When I run that example, I get the message that twisted.protocols.telnet is deprecated and I should instead be using twisted.conch.telnet. So I made the switch, and then got the error that conch wasn't found. After digging around for a couple hours, I've found out the following: 1) "conch" isn't part of the core install of Twisted, so I had to run the installer again to get it. In addition, it hasn't reached 1.0 yet and is marked as "unstable." 2) "conch" has barely any documentation in the API reference: http://twistedmatrix.com/documents/current/api/twisted.conch.telnet.html Is there something I'm missing here, or is Twisted telling me that I should be using an unstable <1.0 library with no documentation that's not even part of the core install instead of a 2.2 version library with good documentation that *is* part of the core install? Is this deprecated warning in the wrong spot? I don't get it. Thanks for your help.

11 21

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 19 Mar '06

19 Mar '06

Bug summary ______________________ Summary for 2006-03-12 through 2006-03-19 Bugs opened: 31 Bugs closed: 16 Total open bugs: 583 (+15) |== Type Changes |== Priority Changes |== Component Changes |Defect: +6 |Highest: +5 |Conch: +2 |Enhancement: +10 |High: -3 |Core: +9 |Task: +2 |Normal: +14 |Ftp: +5 |Low: +2 |Names: +0 |Trial: +2 |Web2: +6 |Website: -5 |Words: -1 New / Reopened Bugs ______________________ ===== Highest ===== [#1561] Qt reactor fails two TCP tests (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/1561 [#1562] Permission denied errors on Win32 (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/1562 [#1566] Allow tickets to be submitted if user enters an email address in the "Your email or username" field (opened by exarkun) enhancement core http://twistedmatrix.com/trac/ticket/1566 [#1572] twistd starts services synchronously: it should start them using the startup system event. (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/1572 [#1581] Bug in Twisted Names (opened by wdy) (CLOSED, fixed) defect names http://twistedmatrix.com/trac/ticket/1581 [#1583] twisted.names has crummy trailing whitespace (opened by exarkun) (CLOSED, fixed) defect names http://twistedmatrix.com/trac/ticket/1583 ===== High ===== [#1560] Death to util.wait() (opened by jml) task core http://twistedmatrix.com/trac/ticket/1560 [#1564] Failure.getErrorMessage() uses safe_str (opened by moof) (CLOSED, wontfix) defect core http://twistedmatrix.com/trac/ticket/1564 [#1571] Typo in python/dispatch.py (opened by loic) (CLOSED, fixed) defect core http://twistedmatrix.com/trac/ticket/1571 [#1573] trial does not wait for the reactor to stop completely between tests/test methods/test suites/test runs/I don't know what (opened by exarkun) defect trial http://twistedmatrix.com/trac/ticket/1573 [#1574] wxreactor completely broken if there are any startup triggers. (opened by jknight) defect core http://twistedmatrix.com/trac/ticket/1574 ===== Normal ===== [#1563] trial --testmodule should be usable without causing test methods to run repeatedly (opened by exarkun) enhancement core http://twistedmatrix.com/trac/ticket/1563 [#1565] VT102Writer.__str__ method in manhole.py does not check for special case (opened by htj) defect core http://twistedmatrix.com/trac/ticket/1565 [#1567] Use svnsync in a commit hook to update trac's repository on pyramid (opened by exarkun) task core http://twistedmatrix.com/trac/ticket/1567 [#1568] Avoid redirects for broken DAV clients (opened by wsanchez) enhancement web2 http://twistedmatrix.com/trac/ticket/1568 [#1569] IRequest should have a uri object for accessing and mangling the requested uri (opened by dreid) enhancement web2 http://twistedmatrix.com/trac/ticket/1569 [#1570] static.File shouldn't allow excessive /s. (opened by jknight) defect web2 http://twistedmatrix.com/trac/ticket/1570 [#1575] twisted.protocols.ftp.FTP.ftp_STOR() does not handle anonymous requests gracefully (opened by grimmtooth) defect ftp http://twistedmatrix.com/trac/ticket/1575 [#1576] web2.dirlist.DirectoryLister should support unicode filenames (opened by htj) enhancement web2 http://twistedmatrix.com/trac/ticket/1576 [#1577] Add MOVE tests (opened by wsanchez) (CLOSED, fixed) enhancement web2 http://twistedmatrix.com/trac/ticket/1577 [#1578] setsockopt fails on joinAddr (opened by ghazel) defect core http://twistedmatrix.com/trac/ticket/1578 [#1579] FTP server example for twisted/doc/core/examples (opened by grimmtooth) enhancement ftp http://twistedmatrix.com/trac/ticket/1579 [#1582] move web2.dav.method.* to web2.dav.method.davfile.* (opened by wsanchez) enhancement web2 http://twistedmatrix.com/trac/ticket/1582 [#1584] ftp.FTPAnonymousShell.access() handles non-existant file paths in a confusing way (opened by grimmtooth) defect ftp http://twistedmatrix.com/trac/ticket/1584 [#1585] FTPClient should allow you to try logging in more than once (e.g. for implementing an interactive client) (opened by spiv) enhancement ftp http://twistedmatrix.com/trac/ticket/1585 [#1587] web2 DirectoryLister is too inefficient! (opened by exarkun) defect web2 http://twistedmatrix.com/trac/ticket/1587 [#1588] verifyHostKey fails if ~/.ssh/known_hosts missing or it's empty (opened by jaze) enhancement conch http://twistedmatrix.com/trac/ticket/1588 [#1589] cftp.py fails to transfer files (opened by jaze) enhancement conch http://twistedmatrix.com/trac/ticket/1589 ===== Low ===== [#1580] Reloading twisted.web2.http raises an exception (opened by edsuom) defect web2 http://twistedmatrix.com/trac/ticket/1580 [#1586] FTP needs stream loving (opened by htj) enhancement ftp http://twistedmatrix.com/trac/ticket/1586 [#1590] Wrong wiki link (opened by osuchw) (CLOSED, fixed) defect website http://twistedmatrix.com/trac/ticket/1590 Closed Bugs ______________________ ===== Highest ===== [#1581] Bug in Twisted Names (opened by wdy, closed by exarkun, fixed) defect names http://twistedmatrix.com/trac/ticket/1581 [#1583] twisted.names has crummy trailing whitespace (opened by exarkun, closed by exarkun, fixed) defect names http://twistedmatrix.com/trac/ticket/1583 ===== High ===== [#1564] Failure.getErrorMessage() uses safe_str (opened by moof, closed by moof, wontfix) defect core http://twistedmatrix.com/trac/ticket/1564 [#1571] Typo in python/dispatch.py (opened by loic, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/1571 [#965 ] No general download page (and link) on website (opened by ash, closed by itamarst, fixed) defect website http://twistedmatrix.com/trac/ticket/965 [#965 ] No general download page (and link) on website (opened by ash, closed by itamarst, fixed) defect website http://twistedmatrix.com/trac/ticket/965 [#1137] Web site menu disappears when window not big (opened by justinj, closed by dreid, invalid) defect website http://twistedmatrix.com/trac/ticket/1137 [#936 ] minor website rendering problem (opened by teratorn, closed by dreid, invalid) defect website http://twistedmatrix.com/trac/ticket/936 [#1419] 404 from Main Page (opened by TimothyFitz, closed by dreid, invalid) defect website http://twistedmatrix.com/trac/ticket/1419 [#1018] Two quirks noticed with the new WebSite (opened by mesozoic, closed by dreid, invalid) defect website http://twistedmatrix.com/trac/ticket/1018 [#931 ] Add description of words to its project site (opened by hypatia, closed by exarkun, fixed) defect words http://twistedmatrix.com/trac/ticket/931 ===== Normal ===== [#1482] [PATCH] add RedirectResource (opened by andrea, closed by wsanchez, fixed) enhancement web2 http://twistedmatrix.com/trac/ticket/1482 [#1544] docextractor's makehtml cannot handle data from maketwisteddocsys path/with/trailing/slash/ (opened by exarkun, closed by mwh, fixed) defect core http://twistedmatrix.com/trac/ticket/1544 [#1577] Add MOVE tests (opened by wsanchez, closed by wsanchez, fixed) enhancement web2 http://twistedmatrix.com/trac/ticket/1577 ===== Low ===== [#1580] Reloading twisted.web2.http raises an exception (opened by edsuom, closed by jknight, ) defect web2 http://twistedmatrix.com/trac/ticket/1580 [#1590] Wrong wiki link (opened by osuchw, closed by radix, fixed) defect website http://twistedmatrix.com/trac/ticket/1590

1 0

[Twisted-Python] Broken mailing list link on wiki
by Scott Lamb 16 Mar '06

16 Mar '06

Hey, the wiki page at <http://twistedmatrix.com/trac/wiki/ TwistedProject> links to <http://twistedmatrix.com/cgi-bin/mailman/ twisted-python>, which doesn't work. Looks like it should be <http:// twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python>, as featured in the List-Subscribe: headers. Is this page editable by anyone? If so, I'm blind...I don't see an edit link when logged into trac as my freshly-created user. -- Scott Lamb <http://www.slamb.org/>

4 4

[Twisted-Python] Writing Servers
by A S 15 Mar '06

15 Mar '06

Hi, It is said all over the documentation That when connection is accepted the new *instance* of a protocol is created. However as it is single threaded, can use the same instance? For example (In case of UDP): port = x; #some proto subclass of AbstractDatagramProtocol #this protocol does not does nt delegate request to threads. I assume request is served quickly proto = Proto() for if in ("eth0", "eth1") addr = getAddr(if) reactor.listenUDP(port, proto, interface = addr,) I want to have same protocol *instance running* for diff interface on same port. As this protocol does not store any state. Also instead of creating one when connection comes and descard is when connection is broken. Use a single one. however, internet/protocol.py does not allow it? def makeConnection(self, transport): assert self.transport == None self.transport = transport self.doStart() Can not i use the same instance of the protocol for each connection instead of getting new instance every time. As it is single threaded and it must return before next connection in q is served? I am once the datagramReceived is call, it must return before any other request is served. (i am not using any deferrer) Q1) Am i missing some concept? Q2) What if the request is delegated to deferrer or threads, can we still use the same instance of protocol class? Q3) What are the ways to create deferrer itself There is little about it, reactor callfromthread or callinthread? Any good doc? Regards, Abbey __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

2 1

[Twisted-Python] Twisted Website
by Jean-Paul Calderone 15 Mar '06

15 Mar '06

As some of you may have noticed, Twisted's website has undergone a somewhat major change. This comes in several pieces: * Roundup has been replaced by trac as our issue tracker. All of the tickets in roundup have been moved over and the various fields adjusted to fit trac's view of things. User accounts have been transferred as well; you should be able to log in to trac using your roundup username/password. If you had configured roundup with your email address, that has been transferred as well; if you did not, or if you didn't have a roundup account and create a trac account, you must provide an email address before you will be able to submit new tickets. We still have the roundup database around in case anyone notices any problems, but so far as I can tell, everything has been migrated successfully. We are using several custom plugins in order to preserve roundup functionality which trac does not offer natively: the twisted-bugs list is still in operation and changes will still be sent to anyone who is nosy ("cc'ed") on a ticket. We have introduced a new feature as well: newly created tickets are now announced on the IRC channel. * Epydoc has been replaced by docextractor (to be renamed). Since we have so much documentation using epytext markup, we will likely continue to use that markup style. API documentation emitted by docextractor is currently up on the website at the URL previously occupied by epydoc's output. The docextractor markup is currently very rough. Patches are, as always, welcome ;) You will find the source at <http://codespeak.net/svn/user/mwh/docextractor/trunk>. * Obviously we now have a wiki. Feel free to contribute content. A few pages, mainly those with project download links and such, will be kept read-only. Speak with project maintainers if you want to make changes to these pages. * Tim Stebbing has volunteered to maintain the website from this point on. Project maintainers, speak with him (tjs on irc) to get edit permission for the read-only parts of the wiki. There are bound to be a few problems with the new site. If you encounter any, please report them, preferably in the tracker. Thanks to everyone who helped out with the website switch over, in particular Chris Armstrong who helped push things over the last hump, and Michael Hudson who did what a lot of people have been avoiding for years and wrote an epydoc replacement. Jean-Paul

3 5

[Twisted-Python] IRC Meeting: Trial Documentation
by Jonathan Lange 15 Mar '06

15 Mar '06

Hello, Mary and I will be meeting on #twisted-trialdocs (freenode) from 5pm on 8th March (UTC+11). The topic of discussion is: how to improve the Trial documentation. Please come along, share your suggestions and help us write the documents. Even if you are totally uninterested, come along anyway to show your support of task-oriented, real-time, explicit collaboration within the Twisted community. cheers, jml

3 14

[Twisted-Python] A doc sprint... but first, a challenge
by Mary Gardiner 13 Mar '06

13 Mar '06

Feedback on my last (fairly unsuccessful) doc sprint was that reviewing the documentation was a good idea and would provide a good *basis* for a sprint but wasn't a great sprint in and of itself because it's not collaborative. However... Since then no one has contributed documentation reviews, collaborative or not. So we're not yet building our good basis for a sprint. Therefore, a challenge. There are currently 4 reviews on http://twistedmatrix.com/trac/wiki/DocumentationAnalysis/DocumentList . When that number of reviews reachs 14 (ie, 10 more), I will schedule and run a doc sprint day for us. I will do 2 and I know Andrew Bennetts has one more in the works, so that leaves a grand total of 7 reviews for other people to do before I hold a sprint. That's like 0.00001 reviews per whine about our documentation over the lifetime of the Twisted project! Instructions on how to review the documentation are at http://twistedmatrix.com/trac/wiki/DocumentationAnalysis/DocumentList . You can also ask me questions by posting a response to this very mailing list, or joining #twisted-docs on irc.freenode.net where I'll be whenever I'm, well, at a computer. -Mary -- <Rainy-Day> no? jesus was like, love thy neighbour and shit

1 1