Mailman 3 February 2010 - Twisted

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com Feb. 7, 2010

Feb. 7, 2010

1 0

[Twisted-Python] Sending a stream via Protocol?
by Darren Govoni Feb. 6, 2010

Feb. 6, 2010

Hi, I have a simple protocol listening on a port. I send it a text message (a filename) and the protocol tries to stream back the bytes of the file. Mostly, this works but in some cases, the receiving side receives less bytes than is written by: self.transport.write(bytes) I read the API which says it can receive less than expected bytes or messages. Why? So how can I reliably send a sequences of bytes via "dataReceived" in my protocol? Thanks for any help! Darren

2 3

[Twisted-Python] Fwd: Twisted + python = TELNET server (without AUTH)
by Knezan Feb. 6, 2010

Feb. 6, 2010

Hi. I am long time in python and having twisted is good thing. I want to make telnet server (with python or linux prompt) but without auth, beacuse i'd use it via serial port (RS232) ideas? Greetings, Vatts -- case(word == "ping"): # TABLE TENNIS!!! say "pong "+params return

2 1

[Twisted-Python] Simple gateway server
by 徐乔 Feb. 6, 2010

Feb. 6, 2010

I need to write a gateway server that forwarding data between client and data server。I use a Protocol instance for incoming connection from client, and creating another Protocol instance to connect data server when received data from client: Exp.1 ... Class ToClientProtocol(Protocol): """ Protocol for incoming connection from client. """ def connectionMade(self): self.data_server = reactor.connectTCP('localhost', 8888, DataServerFactory()) # make connection to data server … [View More]

2 1

Re: [Twisted-Python] Lore to Sphinx Conversion Progress Report 5
by Terry Jones Feb. 6, 2010

Feb. 6, 2010

Hi Kevin I think this is looking really good. Here are a few superficial / quick comments. - It looks fine under Google chrome - You could reduce visual repetition / density of some of the high-level pages by taking out a word like "Documentation" which appears in the heading and on every line of things like this: Twisted Documentation Table of Contents Twisted Conch Documentation Twisted Core Documentation Historical Documents … [View More]

3 3

[Twisted-Python] Question about ReconnectingClientFactory and conch StatefulTelnetProtocol
by Mark Bailey Feb. 6, 2010

Feb. 6, 2010

Good day, everyone: Continuing my effort to learn Python and Twisted, I need to create several Telnet clients and somehow send two arguments to each and receive data from each. I tried the same pattern that I used with the Telnet server and created a Factory, actually a ReconnectingClientFactory. It doesn't work. My source and the error (no attribute 'factory') are below. Do the "conch" protocols not support a factory? Is there an alternative that provides a Telnet client with a … [View More]

2 2

Re: [Twisted-Python] Lore to Sphinx Conversion Progress Report 5
by Terry Jones Feb. 5, 2010

Feb. 5, 2010

> - It looks fine under Google chrome Argh, having said that, I just noticed the table of contents is below and to the right of the main page content. An example page that exhibits this is http://twistedsphinx.funsize.net/projects/conch/howto/conch_client.html Terry

3 5

Re: [Twisted-Python] Lore to Sphinx Conversion Progress Report 5
by Terry Jones Feb. 5, 2010

Feb. 5, 2010

Hi Kevin I just tried building under Python 2.5.2 and got this: $ python lore2sphinx.py Traceback (most recent call last): File "lore2sphinx.py", line 32, in <module> from table import Table File "/home/terry/s/net/lore2sphinx/table.py", line 214 row_lines = list(izip_longest(*row_split, fillvalue='')) ^ SyntaxError: invalid syntax >From a quick look at table.py, I don't see the problem.… [View More]

3 4

[Twisted-Python] Lore 2 Sphinx addendum: Divmod docs
by Kevin Horn Feb. 5, 2010

Feb. 5, 2010

For those that are interested, my current Sphinx versions of the docs for the 3 Divmod projects that have Lore-format docs (Epsilon, Mantissa, and Nevow) are here: http://divmodsphinx.funsize.net/ They just use the default Sphinx theme at the moment. Enjoy! Kevin Horn

1 0

[Twisted-Python] Lore to Sphinx Conversion Progress Report 5
by Kevin Horn Feb. 5, 2010

Feb. 5, 2010

This time on "How the Docs Conversion Turns"... Moving along at about the same pace, but this time have some very visible results! Here's the latest: - The generated toctree directives now preserve the order of the links from the original source documents. This makes the "prev"/"next" links work in a sane fashion in the resulting Sphinx docs. - Comments in Lore docs are now translated properly. - You want Trac integration? I got your Trac integration right here! … [View More]

1 0

[Twisted-Python] Conch channel blocked
by james bardin Feb. 4, 2010

Feb. 4, 2010

Hello, I'm trying to get a feel for twisted.conch, and not getting very far. I know the documentation is lacking, but I'm not here to complain, I'm here to figure this out. I only have a cursory knowledge of twisted so far, so that may be some of my problem. I am however fairly familiar with the internals of ssh, so I thought I could start there... I started with the sshsimpleclient example, took some pieces, and began experimenting. The example worked as expected. Next, I wanted to pipe … [View More]

3 3

[Twisted-Python] Using Twisted and GTK2
by Ramiro Alba Queipo Feb. 4, 2010

Feb. 4, 2010

Hi everybody, I recently new about Twisted and saw it as the best way to deal with a client/server network application (I use python long time ago). Really wonderful. I now intend to write a GTK client that can send commands and transfers files to the server and from it. I started to learn how to write applications not using 'Perspective Broker', but when I reached to the example pbgtk2.py to authenticate and send echo commands, I could no see a way the same with a PB. Is that true?. Is, … [View More]

5 7

[Twisted-Python] twisted + virtual synchrony
by K. Richard Pixley Feb. 4, 2010

Feb. 4, 2010

Has anyone done any work towards integrating any virtual synchrony system, (like spread - http://spread.org), into twisted? --rich

1 0

[Twisted-Python] How do I get data from a Queue (or "outside") into a Telnet Server?
by Mark Bailey Feb. 3, 2010

Feb. 3, 2010

Good day, everyone: I'm trying to learn Python and Twisted at the same time and having fun (mostly). I'm writing an application that is collecting data from multiple sources, filtering the data, and providing it to users through a Telnet server. I can set up a polling loop for the server but I can't figure out how to get send the data to users connected to my server. I thought I'd put the server in a thread and use a Queue to send data to it. But, I could do the work within the server … [View More]

2 3

[Twisted-Python] [ANN] Ampoule 0.2.0 released
by Valentino Volonghi Feb. 2, 2010

Feb. 2, 2010

After a LOT of time I am finally, with Canonical Ltd. (Aaron Bentley) help, happy to release a new version of Ampoule. The changelog is not terribly long, hopefully this means that the library kind of works well for most use cases :). Have fun! For those that don't know Ampoule (a lot): ampoule is a process pool implementation written on top of Twisted Matrix. Its name comes from the use of AMP as the default communication protocol between the pool and all its children. It's different from … [View More]

3 2

Re: [Twisted-Python] understanding deferreds
by Terry Jones Feb. 2, 2010

Feb. 2, 2010

>>>>> "Michael" == Michael P Soulier <msoulier(a)digitaltorque.ca> writes: Michael> I'm a bit confused as to the "visual explanation". It seems like Michael> if you have a single callback and errback, that if the errback Michael> wants to swallow the error, the callback will not be called at Michael> all, since deferred processing will look for the second callback Michael> at that point by the diagram. Michael> So, right now I'm calling my own callback … [View More]

4 4

[Twisted-Python] ANNOUNCING Tahoe, the Least-Authority File System, v1.6
by Zooko O'Whielacronx Feb. 2, 2010

Feb. 2, 2010

This highly reliable distributed data store is built on top of Twisted. Thanks for the excellent tool! Regards, Zooko Wilcox-O'Hearn ANNOUNCING Tahoe, the Least-Authority File System, v1.6 We are pleased to announce the immediate availability of version 1.6 of Tahoe-LAFS, an extremely reliable distributed data store. Tahoe-LAFS is the first cloud storage system which offers "provider-independent security" -- meaning that not even your cloud service provider can read or alter your data … [View More]without your consent. Here is the one-page explanation of its unique security and fault-tolerance properties: http://allmydata.org/source/tahoe/trunk/docs/about.html Tahoe-LAFS v1.6.0 is the successor to v1.5.0, which was released August 1, 2009 [1]. This release includes major performance improvements, usability improvements, and one major new feature: deep-immutable directories (cryptographically unalterable permanent snapshots). See the NEWS file [2] for details. WHAT IS IT GOOD FOR? With Tahoe-LAFS, you spread your filesystem across multiple servers, and even if some of the servers fail or are taken over by an attacker, the entire filesystem continues to work correctly, and continues to preserve your privacy and security. You can easily and securely share chosen files and directories with others. In addition to the core storage system itself, volunteers have developed related projects to integrate it with other tools. These include frontends for Windows, Macintosh, JavaScript, and iPhone, and plugins for Hadoop, bzr, duplicity, TiddlyWiki, and more. As of this release, contributors have added an Android frontend and a working read-only FUSE frontend. See the Related Projects page on the wiki [3]. We believe that the combination of erasure coding, strong encryption, Free/Open Source Software and careful engineering make Tahoe-LAFS safer than RAID, removable drive, tape, on-line backup or other Cloud storage systems. This software is developed under thorough unit tests, and there are no known bugs or security flaws which would compromise confidentiality or data integrity under normal use. (For all currently known issues please see the known_issues.txt file [4].) COMPATIBILITY This release is fully compatible with the version 1 series of Tahoe-LAFS. Clients from this release can write files and directories in the format used by clients of all versions back to v1.0 (which was released March 25, 2008). Clients from this release can read files and directories produced by clients of all versions since v1.0. Servers from this release can serve clients of all versions back to v1.0 and clients from this release can use servers of all versions back to v1.0. This is the seventh release in the version 1 series. The version 1 series of Tahoe-LAFS will be actively supported and maintained for the forseeable future, and future versions of Tahoe-LAFS will retain the ability to read and write files compatible with Tahoe-LAFS v1. In addition, version 1.6 improves forward-compatibility with planned future directory formats, allowing updates to a directory containing both current and future links, without loss of information. LICENCE You may use this package under the GNU General Public License, version 2 or, at your option, any later version. See the file "COPYING.GPL" [5] for the terms of the GNU General Public License, version 2. You may use this package under the Transitive Grace Period Public Licence, version 1 or, at your option, any later version. (The Transitive Grace Period Public Licence has requirements similar to the GPL except that it allows you to wait for up to twelve months after you redistribute a derived work before releasing the source code of your derived work.) See the file "COPYING.TGPPL.html" [6] for the terms of the Transitive Grace Period Public Licence, version 1. (You may choose to use this package under the terms of either licence, at your option.) INSTALLATION Tahoe-LAFS works on Linux, Mac OS X, Windows, Cygwin, Solaris, *BSD, and probably most other systems. Start with "docs/install.html" [7]. HACKING AND COMMUNITY Please join us on the mailing list [8]. Patches are gratefully accepted -- the RoadMap page [9] shows the next improvements that we plan to make and CREDITS [10] lists the names of people who've contributed to the project. The Dev page [11] contains resources for hackers. SPONSORSHIP Tahoe-LAFS was originally developed thanks to the sponsorship of Allmydata, Inc. [12], a provider of commercial backup services. Allmydata founded the Tahoe-LAFS project and contributed hardware, software, ideas, bug reports, suggestions, demands, and they employed several Tahoe-LAFS hackers and instructed them to spend part of their work time on this Free Software project. Also they awarded customized t-shirts to hackers who found security flaws in Tahoe-LAFS (see the Hack Tahoe-LAFS Hall Of Fame [13]). After discontinuing funding of Tahoe-LAFS R&D in early 2009, Allmydata, Inc. has continued to provide servers, co-lo space, bandwidth, and small personal gifts as tokens of appreciation. (Also they continue to provide bug reports.) Thank you to Allmydata, Inc. for their generous and public-spirited support. This is the third release of Tahoe-LAFS to be created solely as a labor of love by volunteers. Thank you very much to the dedicated team of "hackers in the public interest" who make Tahoe-LAFS possible. Zooko Wilcox-O'Hearn on behalf of the Tahoe-LAFS team February 1, 2010 Boulder, Colorado, USA [1] http://allmydata.org/trac/tahoe/browser/relnotes.txt?rev=4042 [2] http://allmydata.org/trac/tahoe/browser/NEWS?rev=4189 [3] http://allmydata.org/trac/tahoe/wiki/RelatedProjects [4] http://allmydata.org/trac/tahoe/browser/docs/known_issues.txt [5] http://allmydata.org/trac/tahoe/browser/COPYING.GPL [6] http://allmydata.org/source/tahoe/trunk/COPYING.TGPPL.html [7] http://allmydata.org/source/tahoe/trunk/docs/install.html [8] http://allmydata.org/cgi-bin/mailman/listinfo/tahoe-dev [9] http://allmydata.org/trac/tahoe/roadmap [10] http://allmydata.org/trac/tahoe/browser/CREDITS?rev=4186 [11] http://allmydata.org/trac/tahoe/wiki/Dev [12] http://allmydata.com [13] http://hacktahoe.org [View Less]

1 0

Re: [Twisted-Python] understanding deferreds
by Terry Jones Feb. 2, 2010

Feb. 2, 2010

>>>>> "Alexey" == twisted-web <twisted-web(a)udmvt.ru> writes: Alexey> Is it true, that adding many callback functions as filters is Alexey> elegant, but impractical solution? Many callbacks as a filter is elegant & practical. But there's a difference with errbacks, as people are touching on. That's, with a bit of hand-waving, because when things are going right there's only one thing happening - you're in the middle of a computation figuring out the single … [View More]result. With errors though, there are multiple types of errors, many ways of dealing with them, multiple different possible outcomes when an error occurs. So the callback chain is great when everything is working, but the errback chain can sometimes feel like it's not quite the right tool for the job. But there are some techniques to mitigate that, and I think they work quite well. Alexey> Since there is only a [linear] list of pairs (callback, errback), Alexey> the last errbacks have to be complex to distinguish the failures, Alexey> that came from the previous callback from failures, that traverse Alexey> the errback chain from the beginning. Alexey> Should I only use errbacks as a means of catching errors only from Alexey> who have produced the Deferred? And never use them to catch Alexey> errors, that came from my callbacks? No. One thing to think about is the flow down the call/errback chain. You can do something like this. d = IReturnADeferred() d.addErrback(e1) d.addCallback(c1) d.addErrback(e2, 'first') d.addCallback(c2) d.addCallback(c3) d.addErrback(e2, 'second') Here e1 will only get errors created by IReturnADeferred. If IReturnADeferred has no problem, you're into c1 and e1 is "behind" you on the call/errback chain. Note that I add e2 to the errback chain twice. That's a way of having the same function be called for (perhaps) the same reason, but on the chain in 2 places. By the time the flow of control gets to c2 or c3, e2 can only be called with 'second' as its argument. Alexey> Nevertheless the Deferred mechanism always catch the exceptions in Alexey> my callbacks, I have to always catch them myself and never let them Alexey> out uncontrolled (since I cannot distinguish, say TypeError that Alexey> came from the first callback from TypeError, that came from the Alexey> next callback, and they are not the same for me, since I try to do Alexey> a cleanup)? But then I have to translate all errors to my invented Alexey> exceptions, so they will differ. See the above example. Alexey> Or just tell me, that I have missed something, I'm still getting Alexey> into the theme! The other thing that's very useful is to write errbacks like this: def e1(fail): fail.trap(TypeError, KeyError) # Do stuff to handle just TypeError, KeyError def e2(fail): fail.trap(MyException) # Do stuff to handle MyException then you just do d = IReturnADeferred() d.addErrback(e1) d.addErrback(e2) The fail.trap will cause the function to immediately return the current failure if it's not one of the mentioned types. See also fail.check (which is what trap uses). I.e., go read the source of twisted.python.failure That approach is nice because you can write your err handling methods completely separately, and can probably not worry about the order you list them in, etc. The failure just falls down the errback chain until it hits something that can deal with it ("trap" it). Another thing you could do (a bit of a hack) is to add an attribute to a failure object to mark that you've processed it (e.g., that it has been logged). And you might want to read the recent post to this list by Brian Warner (which I've also been meaning to reply to - hi Brian!). See http://twistedmatrix.com/pipermail/twisted-python/2010-January/021330.html Probably others have suggestions on nice ways to handle particular cases. Those are just some that I've used. Terry [View Less]

1 0

Re: [Twisted-Python] PyCon 2010 Twisted Sprint
by Terry Jones Feb. 1, 2010

Feb. 1, 2010

>>>>> "Glyph" == Glyph Lefkowitz <glyph(a)twistedmatrix.com> writes: Glyph> I will be there for one day of the sprints. I'm interested in web2, Glyph> deferred cancellation, endpoints, and getting a new release out. I could probably stay for most/all of the 22nd. Doing some work on deferred cancellation would be good. Terry

1 0