Mailman 3 November 2006 - Twisted

Re: [Twisted-Python] SQLAlchemy integration
by glyph＠divmod.com 23 Nov '06

23 Nov '06

On 22 Nov, 11:19 am, manlio_perillo(a)libero.it wrote: >I'm writing some modules for integrating SQLALchemy with Twisted. >The idea is to write a custom Pool, EngineStrategy and Engine for Twisted. >I would like to know if there are some other people working on this >(excluding sAsync) Is there really a good reason for having *two* different efforts to integrate Twisted with a single other library? Surely it must be possible to collaborate somehow.

2 1

[Twisted-Python] Twisted <> USB units?
by Sven-Erik Tiberg 22 Nov '06

22 Nov '06

Hi. Been thinking of attaching USB connected Human User Interfaces to my applications. Could it be wise to use Twisted to interface USB-units. If so, any hints or docs? BG Sven-Erik Tiberg Lulea / Sweden

1 0

[Twisted-Python] SQLAlchemy integration
by Manlio Perillo 22 Nov '06

22 Nov '06

Hi. I'm writing some modules for integrating SQLALchemy with Twisted. The idea is to write a custom Pool, EngineStrategy and Engine for Twisted. This allows to do: 1) use the custom engine to execute queries asyncronously 2) bound metadata to the custom engine 3) write a ConnectionPool class compatible with the current adbapi interface (including openfun and noisy parameter support (this will use twisted logged system) 4) integration with sqlalchemy.orm Points 1, 2 and 3 are ready (but 3 is still incomplete: I'm testing against adbapi test suite). I would like to know if there are some other people working on this (excluding sAsync) Manlio Perillo

1 0

[Twisted-Python] Trial Loader: nested test suites
by Markus Schiltknecht 21 Nov '06

21 Nov '06

Hi, I've recently been wondering if it's possible to nest test suites with trial. I've been experimenting with the Loader and the Runner to achieve what I want. I came up with the following patch. Does such a thing have any chance of being accepted? Regards Markus

2 2

[Twisted-Python] Keeping a list of connected PB clients
by Yi Qiang 20 Nov '06

20 Nov '06

Hi, I am trying to figure out how to keep an continuously updated list of connected clients to a PB server. I have had success in figuring out how to add clients to my list when they connect, but I am not sure what methods get called when a client disconnects. This is what I have so far: from twisted.spread import pb class DSagePBServerFactory(pb.PBServerFactory): def __init__(self, root): pb.PBServerFactory.__init__(self, root) self.clients = [] def clientConnectionMade(self, broker): """Keeps a 3-tuple of connected clients. tuple[0] - the broker transport tuple[1] - the clients ip tuple[2] - the clients port """ self.clients.append((broker.transport, broker.transport.getPeer().host, broker.transport.getPeer().port)) print self.clients There does not seem to be a corresponding clientConnectionLost method for the Factory class. Any suggestions would be appreciated. Yi

3 5

[Twisted-Python] Testing protocols without connection?
by Marcin Kasperski 20 Nov '06

20 Nov '06

(sorry if it was already described somewhere, but 15 mins of googling did not help me) In one of the recent posts (http://twistedmatrix.com/pipermail/twisted-python/2006-November/014374.html) I noticed the following sentence: > In general you don't need actual network > connections to test protocols. For example, there are helpers > in twisted.test.proto_helpers for mimicking a transport. How should those be used? Not much docs inside... To give a simple example, imagine I have some factory which provides something over HTTP. And I have test case which setup this server on loopback address, connects to it using HTTP, and analyses whether correct output was received. Is it possible to refactor such test, so it does not create any true TCP connection?

1 0

[Twisted-Python] Questions about the very nice AMP protocol
by Brian Granger 20 Nov '06

20 Nov '06

Hi, I currently use Perspective Broker for a number of projects. As time has gone by I have really come to appreciate having a full two-way network protocol. But, my company has lots of Java programmers and they do lots of "serious" (read, pain in the ass) web services and grid services stuff. I would like to be able to get the many Python things I have playing nicely with the many Java things floating around here. Thus, AMP is extremely attractive. There is one problem that I have though. We do high performance scientific computing and deal with extremely large tera/peta-byte data sets. Thus we need network protocols that can send large amounts of data around. The focus of AMP of small messages thus presents a problem. There are really two usage cases that I have in mind: 1. Sending larger (maybe 100's of Mb) objects around that do fit in memory. These can be serialized easily (w/o creating a big pickle), but I need to make sure that Twisted doesn't make extra copies of them during the transfer. 2. Sending even bigger things that don't fit into memory. Any thoughts on the best way to address these questions using AMP. Here are my thoughts: 1. Use a multi-connection approach like FTP does. Use AMP for control and the other connection for the binary data. It would be easy to use producers/consumers in this channel to handle the large data problems above. I don't like this because I often need to ssh tunnel the protocol through firewalls - two connections is unpleasant. 2. Use AMP's inner protocol to run two protocols simultaneously. My understanding is that AMP doesn't support switching back and forth between AMP and its inner protocol. Would it be crazy to try this approach? 3. Try to modify AMP itself to handle the large objects itself by registering Producers with the underlying transport. It may sound like I just want something like FTP, but I also need to send lots application specific control messages as well - and these really need to be two way. Any thoughts would be greatly appreciated. Brian

3 2

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 19 Nov '06

19 Nov '06

Bug summary ______________________ Summary for 2006-11-12 through 2006-11-19 Bugs opened: 12 Bugs closed: 15 Total open bugs: 780 (-3) |== Type Changes |== Priority Changes |== Component Changes |Defect: -8 |Highest: -7 |Core: -4 |Enhancement: +1 |High: -3 |Ftp: +1 |Task: +4 |Normal: +5 |Trial: +1 |Low: +3 |Web2: -2 |Lowest: -1 |Words: +1 New / Reopened Bugs ______________________ ===== High ===== [#2229] Syntax error when upgrading Debian Python 2.4 (opened by LonelyPixel) (CLOSED, fixed) defect core http://twistedmatrix.com/trac/ticket/2229 ===== Normal ===== [#2228] Add higher level primitives for FTP cwd/pwd (opened by therve) enhancement ftp http://twistedmatrix.com/trac/ticket/2228 [#2230] trial -b does not interact in a useful way with -u (opened by glyph) enhancement trial http://twistedmatrix.com/trac/ticket/2230 [#2231] t.p.usage documents multicharacter shortcuts for subcommands but does not support them. (opened by dreid) (CLOSED, duplicate) defect core http://twistedmatrix.com/trac/ticket/2231 [#2233] twisted.internet.fdesc does not handle EINTR (opened by exarkun) defect core http://twistedmatrix.com/trac/ticket/2233 [#2234] Select default reactor based on platform and available libraries (opened by exarkun) enhancement core http://twistedmatrix.com/trac/ticket/2234 [#2235] WebDAV copy fails if the name of the destination folder contains whitespace (opened by vincentk) (CLOSED, duplicate) defect web2 http://twistedmatrix.com/trac/ticket/2235 [#2237] Reorganise Trial tests (opened by jml) task trial http://twistedmatrix.com/trac/ticket/2237 [#2239] Factor out test support module for trial (opened by jml) task trial http://twistedmatrix.com/trac/ticket/2239 ===== Low ===== [#2232] Tool for measuring coding standard conformance (opened by jml) task core http://twistedmatrix.com/trac/ticket/2232 [#2236] Make test_toc adhere to coding standard (opened by jml) task words http://twistedmatrix.com/trac/ticket/2236 [#2238] Add function and object level unit tests for twisted.words.protocols.toc (opened by glyph) enhancement words http://twistedmatrix.com/trac/ticket/2238 Closed Bugs ______________________ ===== Highest ===== [#2218] Add timeout to XMPP IQ requests (opened by ralphm, closed by ralphm, fixed) enhancement words http://twistedmatrix.com/trac/ticket/2218 [#2199] Adaption of web2.iweb interfaces is broken (opened by wsanchez, closed by exarkun, fixed) defect web2 http://twistedmatrix.com/trac/ticket/2199 [#719 ] better pluggable reactor support for twistd (opened by itamarst, closed by exarkun, fixed) enhancement core http://twistedmatrix.com/trac/ticket/719 [#2136] t.plugin.getCache craps out on Windows with Python 2.5 (opened by PenguinOfDoom, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/2136 [#2065] windows buildbot errors, already imported failures (opened by scmikes, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/2065 [#2165] trial's "test_suite" feature violates naming standard (opened by exarkun, closed by jml, fixed) defect trial http://twistedmatrix.com/trac/ticket/2165 [#1430] trial reporter doesn't write to streams properly (opened by exarkun, closed by jml, fixed) defect trial http://twistedmatrix.com/trac/ticket/1430 ===== High ===== [#1067] epyrun doesn't work (opened by marienz, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/1067 [#2229] Syntax error when upgrading Debian Python 2.4 (opened by LonelyPixel, closed by exarkun, fixed) defect core http://twistedmatrix.com/trac/ticket/2229 [#2139] test_underUnderPathAlreadyImported and test_listingModules from twisted.test.test_modules.(Zip)PathModificationTest fail with Gtk2 reactor (opened by exarkun, closed by exarkun, fixed) enhancement core http://twistedmatrix.com/trac/ticket/2139 [#2224] Web2: Behavior of Request.locateResource vs Resource.locateChild is not clearly defined. (opened by dreid, closed by wsanchez, invalid) defect web2 http://twistedmatrix.com/trac/ticket/2224 ===== Normal ===== [#2222] t.i.task.Clock.advance should set the call.called attribute. (opened by ralphm, closed by ralphm, fixed) defect core http://twistedmatrix.com/trac/ticket/2222 [#2231] t.p.usage documents multicharacter shortcuts for subcommands but does not support them. (opened by dreid, closed by dreid, duplicate) defect core http://twistedmatrix.com/trac/ticket/2231 [#2235] WebDAV copy fails if the name of the destination folder contains whitespace (opened by vincentk, closed by wsanchez, duplicate) defect web2 http://twistedmatrix.com/trac/ticket/2235 ===== Lowest ===== [#2226] qt4reactor.stop() not closing connections and quitting python (opened by Tantalum, closed by Tantalum, fixed) defect core http://twistedmatrix.com/trac/ticket/2226

1 0

[Twisted-Python] Trial Test Runner
by Markus Schiltknecht 18 Nov '06

18 Nov '06

Hi, I'm having a hard time writing a test suite using trial. What's the best documentation available? I've the API Reference as well as the sources at hand, but... For example I've tried this: #!/usr/bin/python # -*- test-case-name: eUnit.test.test_sample -*- from twisted.trial import unittest, runner, reporter class Test(unittest.TestCase): def testSample(self): print "hallo welt" if __name__ == "__main__": runner.TrialRunner(reporter.TextReporter).run(Test) It's failing with: TypeError: unbound method countTestCases() must be called with Test instance as first argument (got nothing instead) Some more documentation (an introduction or tutorial or some such) would be very welcome and helpful. Regards Markus

3 11

[Twisted-Python] Packaging application...suggestions?
by Chaz. 16 Nov '06

16 Nov '06

I released my open source project built on top of Twisted more than a month ago. Since then I have been looking for ways to make distributing the application simple. I would love to have it self-contained, holding all the python libraries, etc, to ease the install by the user. Any advice would be greatly appreciated. Chaz.

2 2