Mailman 3 January 2004 - Twisted

[Twisted-Python] Twisted Python 0.7.0 Prerelease Testing
by Glyph Lefkowitz 05 Aug '21

05 Aug '21

hi there, folks: I'd really like to release 0.7.0 but I would like it to be at least a little bit tested before I do so. Could those of you with CVS trees check everything out and see if it performs as advertised? Deeper bugs than that will have to wait for the next release, but I'd at least like to know if it works for someone other than me. Thanks. ______ __ __ _____ _ _ | ____ | \_/ |_____] |_____| |_____| |_____ | | | | @ t w i s t e d m a t r i x . c o m http://www.twistedmatrix.com/~glyph/

4 5

[Twisted-Python] Beepy Twisted Library
by Mike Schneider 12 Feb '04

12 Feb '04

After reading the emails on the list I downloaded the Beepy Twisted BEEP library. I read the included docs, and looked at the test cases. I had a server and client up in less than an hour. Thank you for your work on this package. I am going to spend more time prototyping today. I like the development style: - simple short tests - test cases that serve as models for code development FYI. I am running Python2.3 on Windows, so I had to download PyOpenSSL from: This should be a very popular protocol for people developing peer-to-peer solutions. Thank you for your good work, Beepy is being used!!!!!!! Mike PS. The test cases were very valuable. If you have to choose between more docs and more testcases/examples. my +1 would be for more test cases/examples

2 1

RE: [Twisted-Python] Running twisted tap file as NT service
by Schneider, Michael 30 Jan '04

30 Jan '04

Thanks for the guide. I am able to create a ntservice .exe, attached is the command that I used, and the output. My application is in the gridnode package, and it depends on twisted and standard python. Really Stupid question time. I have very little expericence with deploying windows services. What do I do next to install this? Since you leverage py2exe, does python need to be installed on the machines (I am rolling this out to several hundred machines, and python is not installed on those machine at this time)? Thank you very much for your work on this tool!!!!!!!!!!!!!! Mike ------------------- Command and Command Output D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen>python tap2ntsvc --name="gridnoded" --display_name=gridnoded --disp lay_name="Grid Node Service" --type=pickle --include=gridnode d:\grid\gridnoded.tap C:\Python23\Lib\site-packages\py2exe\build_exe.py:992: DeprecationWarning: Non-ASCII character '\xa9' in file C:\Python2 3\Lib\site-packages\py2exe\resources\VersionInfo.py on line 226, but no encoding declared; see http://www.python.org/pep s/pep-0263.html for details from resources.VersionInfo import VS_VERSIONINFO, RT_VERSION, \ C:\Python23\Lib\site-packages\py2exe\resources\VersionInfo.py:70: FutureWarning: hex/oct constants > sys.maxint will ret urn positive values in Python 2.4 and up dwSignature = 0xFEEF04BD warning: py2exe: could not parse version number '' No VersionInfo will be created warning: py2exe: ************************************************************************* warning: py2exe: * The following modules were not found: warning: py2exe: * Carbon.Folder warning: py2exe: * Carbon.Folders warning: py2exe: * Crypto.Cipher warning: py2exe: * OpenSSL warning: py2exe: * SOCKS warning: py2exe: * _ssl warning: py2exe: * _xmlplus warning: py2exe: * _xmlrpclib warning: py2exe: * fcntl warning: py2exe: * grp warning: py2exe: * ic warning: py2exe: * jarray warning: py2exe: * java.io.IOException warning: py2exe: * java.io.InterruptedIOException warning: py2exe: * java.net warning: py2exe: * readline warning: py2exe: * rourl2path warning: py2exe: * sgi warning: py2exe: * sgmlop warning: py2exe: ************************************************************************* Built File dist\gridnodedsvc\gridnodedsvc.exe Created gridnoded.fms Inno Setup 4 Command-Line Compiler Copyright (C) 1998-2003 Jordan Russell. All rights reserved. Portions by Martijn Laan Compiler engine version: Inno Setup 4.0.9 Reading [Setup] section, line 18 Reading [Setup] section, line 19 Reading [Setup] section, line 20 Reading [Setup] section, line 21 Reading [Setup] section, line 22 Reading [Setup] section, line 23 Reading file (WizardImage) File: C:\Python23\Lib\site-packages\inno\program\WIZMODERNIMAGE.BMP Reading file (WizardSmallImage) File: C:\Python23\Lib\site-packages\inno\program\WIZMODERNSMALLIMAGE.BMP Reading [LangOptions] and [Messages] sections File: C:\Python23\Lib\site-packages\inno\program\DEFAULT.ISL Messages in script file Reading [Code] section Reading [Dirs] section, line 16 Reading [Icons] section, line 25 Reading [Run] section, line 27 Reading [Run] section, line 28 Reading [UninstallRun] section, line 30 Reading [UninstallRun] section, line 31 Reading version info: C:\Python23\Lib\site-packages\inno\program\UNINST.E32 Reading [Files] section, line 2 Reading [Files] section, line 3 Reading [Files] section, line 4 Reading [Files] section, line 5 Reading [Files] section, line 6 Reading [Files] section, line 7 Reading [Files] section, line 8 Reading [Files] section, line 9 Reading [Files] section, line 10 Reading [Files] section, line 11 Reading [Files] section, line 12 Reading [Files] section, line 13 Reading [Files] section, line 14 Creating setup files Compressing: C:\Python23\Lib\site-packages\inno\program\UNINST.E32 (51.9.0.0) Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\gridnoded.tap Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\gridnodedsvc.exe Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\parser.pyd Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\pyexpat.pyd Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\python23.dll Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\PyWinTypes23.dll Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\select.pyd Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\win32api.pyd Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\win32process.pyd Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\win32service.pyd Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\_socket.pyd Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\_sre.pyd Compressing: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\dist\gridnodedsvc\_winreg.pyd Successful compile (1.402 sec). Resulting Setup program filename is: D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\gridnoded-1.0-setup.exe Output written to D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen\gridnodedsvc\gridnodedsvc\gridnoded-setup-1.0.exe tap2ntsvc: 0 warnings. D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen> D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen> D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen> D:\grid\work\python\Twisted-1.1.1\sandbox\moonfallen>

2 1

[Twisted-Python] deferred proposed update
by Fabrice Coudert 29 Jan '04

29 Jan '04

Hi, I 'd like to add a pre-processing and post-processing callback in a deferred callback list. I did somthing like this : my_defer = getADeferredForSomething() new_defer = defer.Deferred() new_defer.addCallback(preprocessing) new_defer.chainDeferred(my_defer) new_defer.addCallback(postprocessing) my_defer = new_defer My problem is that postprocessing doesn't receive the result of the last callback in my_defer, but it reveive None. This can be explained in twisted source by that chainDeferred(d) is equivalent to addCallbacks(d.callback, d.errback), but this two methods are not really sort of callback methods for deferred coz they didn't return a result. So I patched Deferred class to add "return self.result", and it works well : Deferred_old = defer.Deferred class Deferred_new(Deferred_old): def callback(self, result): Deferred_old.callback(self, result) return self.result def errback(self, fail=None): Deferred_old.errback(self, fail) return self.result defer.Deferred = Deferred_new Notes by doing this you can also get final result when firing the callbacks : final_result = my_defer.callback(result) I dunno if this patch will fail something else in twisted. fc.

6 6

[Twisted-Python] Running twisted tap file as NT service
by Schneider, Michael 28 Jan '04

28 Jan '04

I am tring to convert a twisted .tap file (gridnoded.tap) to a service for windows 2000 and XP. I installed the required python packages: - inno - win32 extensions What I have done: created .tap file run with twistd (checks out ok) When I run tap2ntsvc --help, I get no output (error or help message). what else do I have to do to get this going? Thanks for your efforts with tap2ntsvc, Mike ------------------------------------------------------------------------------ I've finished the initial work on tap2ntsvc. This script does the tedious work of creating an installer around your Twisted service. A quick howto: 1. Create a tap or tac file for your application, using the method you normally use. **Test with twistd to make sure that you can start the app from the command line, _before_ you wrap a service around it.** 2. Acquire and install the prerequisites of tap2ntsvc. It depends on software outside of Twisted, specifically: win32all @ http://starship.python.net/crew/mhammond/win32/Downloads.html Innoconda @ http://twistedmatrix.com/~moonfallen/innoconda.html 3. Run tap2ntsvc from the command line. (*This is not yet integrated with the "Twisted Command Prompt" available on MSWindows with the official Twisted installer, but it will be when the script becomes an official part of Twisted.) Use --help to get the command line options. To start with, all you need to provide is the name of your tap or tac file. | python .../Twisted/sandbox/moonfallen/tap2ntsvc myapp.tac This will build an installable package using Innoconda. 4. Install the package. It will be in myappsvc/myapp-...-setup.exe. 5. Start the service; it will fail, but you'll find out what modules you need to add. | net start myapp **It's ok if this doesn't work.** 6. Check the Application event log to find out what modules failed to import; you will be re-running py2exe after you add the missing modules. 7. Either: (a) re-run tap2ntsvc with the -i option or (b) add your modules to myappsvc/setup.cfg on the "includes=" line. If you choose to do the latter, read myappsvc/README.txt to find out how to recompile just the parts you need. 8. Redo steps 3 through 7 until you no longer get ImportErrors in the Application log. 9. Some applications need data files. If you need data files in your application, consult myappsvc/README.txt and edit myappsvc/myapp.fms. myapp.fms uses a special command language to make adding data files as intuitive as possible. You can put files in c:\Program Files\myapp or any subdirectory thereof, so make sure your application code can find data files there. When you're done, you should be able to 'net start myapp' successfully. ~ When you want to rebuild it in the future, just keep these files in your version control: ~ myappsvc/do_inno_script.py ~ do_inno.py ~ setup.cfg ~ setup.py ~ myapp.fms Caveats, bugs, TODO: - - you must be able to start your application in py2exe. Things most likely to not work are finding important data files based on the value of __file__ in some module. - - if you install the same service multiple times without uninstalling it in between installs, then start it, then uninstall it, it will crash on uninstall. Just be sure to uninstall it in between installs while you're experimenting. - - I want to make the module finder more foolproof, saving several of the steps above. This is a non-trivial problem, however. - - Really, it needs a frontend. And I hate Tk. Can I put a Gtk app into ~ Twisted proper? :-) The future: I want to move tap2ntsvc out of sandbox and into main Twisted. I want people to read this email over and try it before I do so, in case there are important concerns I need to address. We need to give some thought to what to do about the 2 significant dependencies. Should this block tap2ntsvc from being in Twisted proper? Is there a policy for this sort of thing? ---------------------------------------------------------------- Michael Schneider Senior Software Engineering Consultant UGS PLM Solutions - an EDS Company "The Greatest Performance Improvement Is the transitioning from a non-working state to the working state"

2 1

[Twisted-Python] RPC over UDP
by Rita Díaz y/o Rodrigo Benenson 27 Jan '04

27 Jan '04

Is there an UDP RPC twisted system aviable ? What happened to the UDP support of PB ? Khashmir has an airhook UDP RPC, but the code does not give 'quality assurance' (at least at a psycholigical level). It is something similar integrated in the Twisted Distro, or as an external package ? rodrigob.

1 0

[Twisted-Python] Re: Adding pb users online
by maxwell hammer 25 Jan '04

25 Jan '04

here is a mysql checker i made, probably not the best job but you can fix it :) from twisted.python import components, failure, log from twisted.cred import error, credentials from twisted.cred.checkers import ICredentialsChecker from twisted.enterprise import adbapi class MysqlPasswordDatabase : __implements__ = ICredentialsChecker credentialInterfaces = (credentials.IUsernamePassword,credentials.IUsernameHashedPassword) def __init__(self,db_name,db_username,db_password,table_name) : self.db_name=db_name self.db_username=db_username self.db_password=db_password self.table_name=table_name self.dbpool = adbapi.ConnectionPool("MySQLdb",host="localhost", db=db_name, user=db_username, passwd=db_password) def _dbResult(self,result,credentials) : #print result[0][0] #print credentials if result : if credentials.checkPassword(str(result[0][0])) : return credentials.username else : #print "Failing in password cmp" return failure.Failure(error.UnauthorizedLogin()) else : #print "Failing in dbresult" return failure.Failure(error.UnauthorizedLogin()) def _dbError(self,reason) : return failure.Failure(error.UnauthorizedLogin()) def requestAvatarId(self,c) : print "requestAvatarID ",c d=self.dbpool.runQuery("SELECT pword FROM %s WHERE uname = '%s'" % (self.table_name,c.username)) d.addCallback(self._dbResult,c) d.addErrback(self._dbError) return d anyway you get the idea, the above code works for me, but it assumes passwords are stored in plain text. John Janecek _________________________________________________________________ STOP MORE SPAM with the new MSN 8 and get 2 months FREE* http://join.msn.com/?page=dept/bcomm&pgmarket=en-ca&RU=http%3a%2f%2fjoin.ms…

1 0

[Twisted-Python] can't get twisted to install on SunOS...
by Ed Hartnett 15 Jan '04

15 Jan '04

Howdy all! I am using twisted as part of BuildBot, to automatically test my software on various platforms. One problem I am having on a couple of Suns is that twisted won't install. I have python 2.2.3 installed as you can see from the printout: gilda.unidata.ucar.edu% python Python 2.2.3 (#1, Jan 13 2004, 13:54:46) [C] on sunos5 Type "help", "copyright", "credits" or "license" for more information. >>> bash-2.03# pwd /home/ed/downloads/Twisted-1.1.1 bash-2.03# python setup.py install Traceback (most recent call last): File "setup.py", line 43, in ? from twisted import copyright File "twisted/__init__.py", line 23, in ? from python import compat File "twisted/python/compat.py", line 27, in ? import sys, types, socket, struct, __builtin__, exceptions File "/usr/local/lib/python2.2/socket.py", line 41, in ? from _socket import * ImportError: No module named _socket What's the deal here? Any suggestions for getting Twisted working on these suns? I've had trouble before because of the weird directories that sun uses, but this seems to be a problem within python. Thanks for any suggestions, Ed Hartnett Unidata

4 3

[Twisted-Python] mktap/twistd make 2 copies of some objects? (was Re: [Twisted-web] subtle copying in woven driving me crazy.)
by Douglas Bagnall 15 Jan '04

15 Jan '04

A while ago in twisted-web, in a thread beginning here: http://twistedmatrix.com/pipermail/twisted-web/2003-December/000061.html I was complaining about twisted making a spare copy of an object used for guard credentials (meaning you can't add users on the fly). I now think it stems from the pickling of objects between mktap and twistd. The checker is instantiated and pickled in mktap, because the guard code is called directly from updateApplication. But then when twistd runs, it is instantiated again for the rest of the app. This makes two copies of my checker: #!/bin/sh kill `cat twistd.pid` mktap2.3 upstage twistd2.3 -f upstage.tap and this doesn't: #!/usr/bin/python from upstage import app from twisted.internet import reactor app.updateApplication(reactor, {'webport':8083,'port':7232 }) reactor.run() The code called in updateApplication goes a bit like this: def updateApplication(app, options): docroot = website() app.listenTCP(webport, server.Site(docroot)) def website(): docroot = static.File(config.HTDOCS) admin = adminWrapper(config.ADMIN) docroot.putChild('admin', admin) return docroot class Checker(dict): __implements__ = checkers.ICredentialsChecker credentialInterfaces = (IUsernamePassword,) def requestAvatarId(self, credentials): player = self.get(credentials.username) if player and player.password == credentials.password: return credentials.username return failure.Failure(error.UnauthorizedLogin()) myCheckerThatGetsCopied = Checker({'p1': player1}) def adminWrapper(admin_dir): p = Portal(AdminRealm(admin_dir)) p.registerChecker(AllowAnonymousAccess(), IAnonymous) p.registerChecker(myCheckerThatGetsCopied, IUsernamePassword) upw = guard.UsernamePasswordWrapper(p, callback=dumbRedirect) r = guard.SessionWrapper(upw) r.sessionLifetime = 12 * 3600 return r One workaround is wrapping the true checker in one that has no data: class CheckerThatGetsCopiedWrapper: __implements__ = checkers.ICredentialsChecker credentialInterfaces = (credentials.IUsernamePassword,) def requestAvatarId(self, credentials): return myCheckerThatGetsCopied.requestAvatarId(credentials) which is what I'm actually using now. Is my diagnosis plausible? regards, douglas bagnall

2 1

[Twisted-Python] announcing another twisted project
by Douglas Bagnall 15 Jan '04

15 Jan '04

hi all, For a few months I've been working on software for some people who do "cyberformance", which boils down to being theatre in chat rooms. They want to be able to do everything they can in their vintage Mac apps, but be accessable to a general audience. So I've almost written a graphical chat thingy using SWF for the front end and twisted for the server. I wasn't quite ready to announce it, but the Daily Python Url has gone and exposed it anyway. The theatrical paradigm makes it very slightly different from most chat programs - for example, you don't need to log in to watch, but as audience you won't appear on stage; the "avatars" are more like puppets - players can exchange them during the performance without the audience knowing. There are also a few unusual features, like text-to-speech processing (using Festival), and seconds-per-frame live video, to suit the particular performance style of the artists. But really it's just a chat program. And it's GPL'd, so if anyone wants a chat program, it wouldn't be too hard to configure the strange elements away (and I'd really appreciate anyone using it). The flash part is generated entirely from actionscript, using the Ming compiler (http://ming.sf.net/), which I found to be easier than working in Macromedia Flash, not to mention altogether freer. You still need the flash plugin to view it though. Some things about it are a bit broken, and the tests are woefully out of date. But there you go. http://sourceforge.net/projects/upstage/ and http://upstage.org.nz/ cheers, douglas

1 0