Mailman 3 October 2006 - Twisted

[Twisted-Python] Twisted - reactor activated by reciving UDP-package.
by Sven-Erik Tiberg 17 Oct '06

17 Oct '06

Hi. I'm Sven-Erik Tiberg at Lulea Univ. of Technology / Sweden and having a project to make a system for distributed Interactive 3D simulations. My approach are to use OpenSource program as far as possible as Python, Blender and Flux Studio in the client. Transport of states will use UDP between client X3D-browser and simulation server. Would like to use Twisted with it's RT-functionallity to have Twisted processes waiting for a UDP package to arrive ( interupt ) and then activate a ROUTE node in the X3D-world that will change properties of a X3D-Node like a cube, 3D speedometer,, My Q. can a Twisted script be activated from an arrival of a UDP or TCP package? BG Sven-Erik Tiberg Lulea Univ of Technology. Sweden

1 0

[Twisted-Python] Help wanted, will pay| Identity and media sharing system
by Konrads Smelkovs 16 Oct '06

16 Oct '06

Hello, Looking for developer(s) for Identity and media sharing system. This is a contract job. Result could be opensourced. Delivery in phases is acceptable. Use of opensource components is encouraged A middleware application must be developed for 3d party Application integration in web environment. Requirements doc: http://docs.google.com/View?docid=dfk9tgvx_1g3ph94 The general purpose is to enable all media files to be uniquely referenceable while avoiding duplicates. In addition, the management of user information and rights across multiple services needs to be made simple and secure. <h2> 1. Objectives:</h2> * Develop subsystems that will allow non locally developed applications to be securely integrated into the main media data sharing system used on the services Platform. * The subsystems have to provide easy and secure integration the identity management and media data sharing facilities. * The sub-systems must enable the possibility to provide an API for external services (third party applications) with custom sharing of information. Examples: -- Konrads Smelkovs Applied IT sorcery.

2 2

[Twisted-Python] Weekly Bug Summary
by exarkun＠twistedmatrix.com 15 Oct '06

15 Oct '06

Bug summary ______________________ Summary for 2006-10-08 through 2006-10-15 Bugs opened: 15 Bugs closed: 12 Total open bugs: 743 (+3) |== Type Changes |== Priority Changes |== Component Changes |Defect: +4 |Highest: -4 |Conch: -1 |Enhancement: -1 |High: -2 |Core: -1 |Task: +0 |Normal: +9 |Lore: -1 |Mail: +0 |Trial: +6 |Web2: +0 |Website: -1 |Words: +1 New / Reopened Bugs ______________________ ===== Highest ===== [#2158] SMTP server incorrectly handles SMTPBadSender from validateFrom (opened by exarkun) (CLOSED, fixed) enhancement mail http://twistedmatrix.com/trac/ticket/2158 [#2160] Make Twisted work with latest zope.interface (opened by radix) (CLOSED, fixed) enhancement core http://twistedmatrix.com/trac/ticket/2160 [#2171] Bad ssl check (opened by ilia) defect words http://twistedmatrix.com/trac/ticket/2171 ===== Normal ===== [#2159] Conch uses no-longer-present trial benchmark feature (opened by exarkun) defect conch http://twistedmatrix.com/trac/ticket/2159 [#2161] trial doesn't load all the bzr tests (opened by jml) defect trial http://twistedmatrix.com/trac/ticket/2161 [#2162] Do skip and todo with exceptions (opened by jml) task trial http://twistedmatrix.com/trac/ticket/2162 [#2163] Add subunit reporter to Trial (opened by jml) enhancement trial http://twistedmatrix.com/trac/ticket/2163 [#2164] trial's IReporter interface is missing some attributes (opened by exarkun) defect trial http://twistedmatrix.com/trac/ticket/2164 [#2165] trial's "test_suite" feature violates naming standard (opened by exarkun) defect trial http://twistedmatrix.com/trac/ticket/2165 [#2166] Paste wsgi.lint finds a problem with web2 wsgi implementation. (opened by martinpaljak) (CLOSED, fixed) defect web2 http://twistedmatrix.com/trac/ticket/2166 [#2167] typo in web2.channel.scgi (opened by mars) defect web2 http://twistedmatrix.com/trac/ticket/2167 [#2168] tearDownClass() not always called after setUpClass() (opened by slamb) defect trial http://twistedmatrix.com/trac/ticket/2168 [#2169] twisted.plugin documentation errors (opened by babbitt) task core http://twistedmatrix.com/trac/ticket/2169 [#2170] BufferedStream.readline strips delimiter - makes it impossible to discover EOF (opened by exarkun) (CLOSED, fixed) defect web2 http://twistedmatrix.com/trac/ticket/2170 [#2172] kqueue connection failure results in bad fd message (opened by ghazel) defect core http://twistedmatrix.com/trac/ticket/2172 Closed Bugs ______________________ ===== Highest ===== [#2148] Clean conch tests (opened by therve, closed by exarkun, fixed) enhancement conch http://twistedmatrix.com/trac/ticket/2148 [#2155] test_udp.ReactorShutdownInteraction needs to clean up the UDP port (opened by PenguinOfDoom, closed by pahan, fixed) defect core http://twistedmatrix.com/trac/ticket/2155 [#2134] lore --output latex fails on span indexes (opened by DavidBlewett, closed by exarkun, fixed) defect lore http://twistedmatrix.com/trac/ticket/2134 [#2158] SMTP server incorrectly handles SMTPBadSender from validateFrom (opened by exarkun, closed by exarkun, fixed) enhancement mail http://twistedmatrix.com/trac/ticket/2158 [#1983] Rename 'tlsstarted' to something that isn't a lie, and use more global constants for magic strings (opened by radix, closed by radix, fixed) task core http://twistedmatrix.com/trac/ticket/1983 [#2079] Deprecate twisted.python.reflect.funcinfo (opened by radix, closed by exarkun, fixed) task core http://twistedmatrix.com/trac/ticket/2079 [#2160] Make Twisted work with latest zope.interface (opened by radix, closed by exarkun, fixed) enhancement core http://twistedmatrix.com/trac/ticket/2160 ===== High ===== [#1481] SEO: Google searches for docs usually go to out-of-date sourceforge (opened by moonfallen, closed by jknight, fixed) defect website http://twistedmatrix.com/trac/ticket/1481 [#1451] twisted.web2.stream readline size argument (opened by mkerrin, closed by foom, fixed) enhancement web2 http://twistedmatrix.com/trac/ticket/1451 ===== Normal ===== [#1679] conch script does not work on Windows (opened by synapsis, closed by exarkun, duplicate) defect conch http://twistedmatrix.com/trac/ticket/1679 [#2170] BufferedStream.readline strips delimiter - makes it impossible to discover EOF (opened by exarkun, closed by foom, fixed) defect web2 http://twistedmatrix.com/trac/ticket/2170 [#2166] Paste wsgi.lint finds a problem with web2 wsgi implementation. (opened by martinpaljak, closed by foom, fixed) defect web2 http://twistedmatrix.com/trac/ticket/2166

1 0

[Twisted-Python] database transaction commit
by Marvin McNett 13 Oct '06

13 Oct '06

In the adbapi documentation it says, "In all cases a database transaction will be commited after your database usage is finished, unless an exception is raised in which case it will be rolled back." So, I'm wondering when my database usage is actually finished. In the example there, would it be after the call to '_getAge' or after the call to 'printResult' (i.e. after the callable to runInteraction or after the last callback attached to the deferred)? Thanks, Marvin

3 2

[Twisted-Python] Foolscap-0.0.3 released (aka newpb)
by Brian Warner 13 Oct '06

13 Oct '06

I've released version 0.0.3 of Foolscap (aka newpb), the next-generation remote-object communication library for Twisted. This release is still highly unstable: incompatible protocols changes *will* happen, so don't use it if you can't retain control over both ends of the wire. This release contains a bunch of API changes and some new features: eventual-send operators, an early version of Promises, and improvements to the way Gifts are delivered. The NEWS file is attached below with complete details. Check out the Foolscap home page at: http://twistedmatrix.com/trac/wiki/FoolsCap for docs, feature lists, and all your other Foolscap needs. And download the 0.0.3 release from here: http://twistedmatrix.com/~warner/Foolscap/ share and enjoy, -Brian * Release 0.0.3 (05 Oct 2006) ** API Changes The primary entry point for Foolscap is now the "Tub": import foolscap t = foolscap.Tub() d = t.getReference(pburl) d.addCallback(self.gotReference) ... The old "PBService" name is gone, use "Tub" instead. There are now separate classes for "Tub" and "UnauthenticatedTub", rather than using an "encrypted=" argument. Tubs always use encryption if available: the difference between the two classes is whether this Tub should use a public key for its identity or not. Note that you always need encryption to connect to an authenticated Tub. So install pyopenssl, really. ** eventual send operators Foolscap now provides 'eventually' and 'fireEventually', to implement the "eventual send" operator advocated by Mark Miller's "Concurrency Among Strangers" paper (http://www.erights.org/talks/promises/index.html). eventually(cb, *args, **kwargs) runs the given call in a later reactor turn. fireEventually(value=None) returns a Deferred that will be fired (with 'value') in a later turn. These behave a lot like reactor.callLater(0,..), except that Twisted doesn't actually promise that a pair of callLater(0)s will be fired in the right order (they usually do under unix, but they frequently don't under windows). Foolscap's eventually() *does* make this guarantee. In addition, there is a flushEventualQueue() that is useful for unit tests, it returns a Deferred that will only fire when the entire queue is empty. As long as your code only uses eventually() (and not callLater(0)), putting the following in your trial test cases should keep everything nice and clean: def tearDown(self): return foolscap.flushEventualQueue() ** Promises An initial implementation of Promises is in foolscap.promise for experimentation. Only "Near" Promises are implemented to far (promises which resolve to a local object). Eventually Foolscap will offer "Far" Promises as well, and you will be able to invoke remote method calls through Promises as well as RemoteReferences. See foolscap/test/test_promise.py for some hints. ** Bug Fixes Messages containing "Gifts" (third-party references) are now delivered in the correct order. In previous versions, the presence of these references could delay delivery of the containing message, causing methods to be executed out of order. The VOCAB-manipulating code used to have nasty race conditions, which should be all fixed now. This would be more important if we actually used the VOCAB-manipulating code yet, but we don't. Lots of internal reorganization (put all slicers in a subpackage), not really user-visible. Updated to work with recent Twisted HEAD, specifically changes to sslverify. This release of Foolscap ought to work with the upcoming Twisted-2.5 . ** Incompatible protocol changes There are now separate add-vocab and set-vocab sequences, which add a single new VOCAB token and replace the entire table, respectively. These replace the previous 'vocab' sequence which behaved like set-vocab does now. This would be an incompatible protocol change, except that previous versions never sent the vocab sequence anyways. This version doesn't send either vocab-changing sequence either, but when we finally do start using it, it'll be ready.

1 0

[Twisted-Python] RE: Problems with code in "Twisted" book ...
by Walsh, Sandy 13 Oct '06

13 Oct '06

Anyone have any answers to this? Abe? Care to support one of your customers? -Sandy -----Original Message----- From: Walsh, Sandy Sent: Tuesday, October 10, 2006 2:34 PM To: 'twisted-python(a)twistedmatrix.com' Subject: Problems with code in "Twisted" book ... Hey there, Just got a copy of "Twisted" and I've been playing around with the book examples. Can't seem to get the "Example 2-6. dataforward.py" to work on Windows. I've reverted back to Python 2.3 (because I ultimately want to use the secure stuff later). It compiles and runs, but I get no echo of the input and the reactor seems to be frozen. When I Ctrl-C the program I get my keyed input spewed into the console, so it seems python is not receiving it. Is there a place I can check for the latest code from the book or is there a more suitable place to ask questions of this type? Thx, Sandy

1 0

Re: [Twisted-Python] Change twisted logging
by glyph＠divmod.com 12 Oct '06

12 Oct '06

On 08:30 pm, ncesar(a)lunix.com.ar wrote: >How can I supress the "Traceback (most recent call last)" when an uncaught >Exception rises up to twistd..? You can't.

1 0

[Twisted-Python] Change twisted logging
by Nicolas D. Cesar 12 Oct '06

12 Oct '06

How can I supress the "Traceback (most recent call last)" when an uncaught Exception rises up to twistd..? I did: ------------------------------------------------- originalLogger = log.theLogPublisher.observers.pop(0) def emit(eventDict): if eventDict["isError"]: eventDict["message"] = ["[EE] " + x for x in eventDict["message"]] global originalLogger originalLogger(eventDict) log.addObserver(emit) -------------------------------------------------- and got: ------------------------------------------------- 2006/10/11 17:23 ART [-] [EE] Traceback (most recent call last): 2006/10/11 17:23 ART [-] [EE] File "/usr/bin/twistd", line 25, in ? 2006/10/11 17:23 ART [-] [EE] run() 2006/10/11 17:23 ART [-] [EE] File "/usr/lib/python2.4/site-packages/twisted/scripts/twistd.py", line 205, in run [...] 2006/10/11 17:23 ART [-] [EE] File "/u/home/ncesar/src-svn/twisted-tests/src/multiltsp/servers.py", line 375, in loadServers 2006/10/11 17:23 ART [-] [EE] raise MandatoryConfig(os.path.join(os.getcwd(),servers_file),'main','servers') 2006/10/11 17:23 ART [-] [EE] multiltsp.servers.MandatoryConfig: ERROR: (..) ----------------------------------------------- I just want to show the last line... not all the traceback info. Is this posible? Greetings, -- Nicolás D. César <ncesar(a)lunix.com.ar> Lunix S.R.L. -[ http://www.lunix.com.ar ]- GnuPG Public Key: gpg --keyserver wwwkeys.pgp.net --recv-key 0x3606F3E6

1 0

[Twisted-Python] udp checksum
by Gaspard, Bradley S 11 Oct '06

11 Oct '06

As a newbie trying to learn twisted I was playing with the udp echo client/server that comes with twisted (2.4.0) (echoclient_upd.py and echoserv_udp.py) which worked fine except that when I observed the packets using Ethereal it indicated that the udp checksum was in error?! [running the example multiple times ... not just a one time occurance] I am on a linux platform and my version of ethereal is 0.10.14 and Python is 2.4.2 Am I missing something??

3 2

[Twisted-Python] trial for integration tests - setUpClass(), tearDownClass()
by Scott Lamb 10 Oct '06

10 Oct '06

We're using trial for tests of an external device. We've got some C-based unit tests where we're able to run our code on the build machine, but the Python/trial stuff is more of an integration test: * Python can't run on our device itself - not only would the porting effort be prohibitive, it simply wouldn't fit. * Tests inevitably cover more than one unit - everything requires the thing to have booted successfully, tests require either working console or Ethernet+IP+TCP+SSL+SSH, etc. * We can't realistically do a new boot for each test method. It'd take too long. We're currently doing everything in one boot; one boot per test class might be feasible. We're really not using any twisted-testing features of trial, and for us the package name "twisted.trial.unittest" is a total lie, but it provides a pretty nice framework all the same. buildbot understands its output, it does nice things like giving you results on InterruptException, etc. So given our unusual usage, there's some stuff we need to do in setUpClass() and tearDownClass(). I've seen murmurs on the list avoid removing them. What's the latest? I like them, but I've encountered a couple problems so far: * When setUpClass() errors out, Trial says our tests are broken, then tries again for every test method in the class. I have a thick skin, so I can take the taunting, but trying to reboot the thing a million times is pretty undesirable. * If the final setUp() fails, tearDownClass() is never invoked. (I'll file a bug with details if there's still interest in setUpClass() and tearDownClass().) -- Scott Lamb <http://www.slamb.org/>

1 0