Mailman 3 June 2003 - Twisted

[Twisted-Python] Looking for web authentication examples...
by Stuart Hungerford 16 Jun '03

16 Jun '03

Hi all, I'm looking for any examples people might have on using username/password authentication via Twisted.web. I guess it's the sort of example that would appear under the "Authentication on the web" heading in the HOWTO's, when it's completed. Cheers, Stu -- :: Stuart Hungerford (stuart.hungerford(a)anu.edu.au) :: ANU Internet Futures Group

2 1

[Twisted-Python] Custom webserver
by Vijay Rao 16 Jun '03

16 Jun '03

Hi , I am trying to use twisted as a webserver that serves files only for requests from the localhost ie the desktop on which it is running by mapping localhost(127.0.0.1) to a domain pattern ( thru the hosts file on windows ) so that a particular type of URL is served from this webserver. Can anyone help me with these : 1) How do I refuse to serve any request from any other machine on the network ( external or internal ) ie is there any way of finding out from where the request originated ( or is it possible to use something like .htaccess ) . Currently the directory listing is exposed to any other machine that can access the machine. 2) It is easy to set up a web.tap file using mktap web --path <pathtoRootDirectory> to serve files but I dont want to map the URL to a path on disk directly. Is it possible to override the getChild function of static.File ( which is doing the publishing part ) so that certain components of the URL can be ignored or re-mapped to a different path on local storage. I tried using a .rpy but that seems to be ignored as I guess that given the --path argument mktap creates a root Resource which is used by the application. Thanks, E.Vijay Rao vijay(a)accellion.com http://www.accellion.com

2 1

[Twisted-Python] Twisted Matrix and PDOM
by N. Wieland 16 Jun '03

16 Jun '03

Hi, I want to implement a Native XML database in Python, so, after having used TM for a little work a pair of months ago, I'm thinking about using Twisted Matrix and implementing it as a plugin. All I need (at this stage) is a persistent DOM for storing XML files on disk instead of keeping them in memory. I need a little help, I don't want to reinvent the weel, I'd like a suggestion about where to look from you Twisted gurus :-] Twisted.persisted ? TIA, nicholas

3 5

[Twisted-Python] Re: [Twisted-commits] Small hack that I need for the beginnings of my woven functional testing
by Andrew Bennetts 15 Jun '03

15 Jun '03

On Fri, Jun 13, 2003 at 01:44:59PM -0500, dp CVS wrote: > Modified files: > Twisted/twisted/trial/runner.py 1.4 1.5 > > Log message: > Small hack that I need for the beginnings of my woven functional testing > framework; hopefully this can be removed sometime later [...] > > def runTests(self, output): > self.testCase = self.testClass() > + self.testCase.output = output > self.testCase.setUpClass() > for methodName in self.methodNames: > method = getattr(self.testCase, methodName) This change broke 2 tests in Twisted that already used that attribute. Should we change the tests, or this hack? What is it for, anyway? Oh, and please run tests before you checkin, this isn't the only thing that has been broken recently. -Andrew.

2 2

[Twisted-Python] Start-up code and passing its results
by Dave Kuhlman 14 Jun '03

14 Jun '03

Here is a seemingly simple question. But after searching the docs, I still haven't figure it out. How do I write some start-up code for a Web app, then pass values from the start-up code to objects that respond to requests? In particular, how do I create a DB ConnectionPool, then pass that to the implementation of a Web page? If the above question made sense, ignore the following. It's more struggling with the same problem. I'm learning Twisted. I've made quite a bit of progress, although I'm slower than most. I've been able to build a small sample Web application. I like what I find in Twisted so far. After some digging, I've been able to use enterprise.adbapi.ConnectionPool in one of my Web pages. But, when I look in my log file, I see the messages "Connecting to database: pyPgSQL.PgSQL" and "adbapi connecting: pyPgSQL.PgSQL" for *every* time I visit that Web page. That makes me think that I'm creating a new connection every time I deliver that Web page, which, of course, a connection pool should eliminate. Am I right? So, what am I doing wrong? I'm guessing that I should not be running the following statement every time I deliver this Web page: dbpool = adbapi.ConnectionPool("pyPgSQL.PgSQL", "localhost:5432:test:postgres:mypassword") So, my question is: Where do I put the above statement? And, how do I share the same dbpool across delivery of that Web page and across all sessions in my Web application? By the way, I created my Twisted application with the following: mktap web --path Test1 --processor=.rtl=twisted.web.script.ResourceTemplate And, I start up my server with the fillowing: twistd -f web.tap Am I supposed to run mktap with the "--type=source" option, and then create the connection pool in the resulting .tas file? If so: 1. How do I add code to the .tas file? How do I get it called during start-up? 2. How do I pass the dbpool (or any variable) to the Web page? Another way of asking this question is: How do I execute code at server start-up? And, how do I make the results of that start-up code available to the various parts of my application, in particular to a Python module that implements the response to a request? Or, am I trying to do things the non-Twisted way? If so, how do I learn the Twisted way? - Dave -- Dave Kuhlman dkuhlman(a)rexx.com http://www.rexx.com/~dkuhlman

1 0

[Twisted-Python] benchmarks for twisted.trial
by Gareth Watts 14 Jun '03

14 Jun '03

Hi all I wanted a means of being able to see whether changes to code (eg. bits of Woven) were having an impact on performance. Rather than separate benchmarks i thought it'd make sense just to make use of the tests that are already written (or write new tests and use those as benchmarks) So, attached is a small/simple patch to add a --benchmarks <iterations> option to trial to give an averaged result after running a test/tests a number of times. A sanity check would be appreciated ;-) Thanks Gareth Index: twisted/scripts/trial.py =================================================================== RCS file: /cvs/Twisted/twisted/scripts/trial.py,v retrieving revision 1.44 diff -c -r1.44 trial.py *** twisted/scripts/trial.py 2 Jun 2003 15:46:26 -0000 1.44 --- twisted/scripts/trial.py 10 Jun 2003 21:44:49 -0000 *************** *** 40,45 **** --- 40,46 ---- optParameters = [["reactor", "r", None, "The Twisted reactor to install before running the tests (looked up as a module contained in twisted.internet)"], ["logfile", "l", "test.log", "log file name"], + ["benchmark", None, None, "Benchmark a test by repeating it a specified number of times"], ["random", "z", None, "Run tests in random order using the specified seed"], ["extra","x", None, *************** *** 54,59 **** --- 55,61 ---- self['testcases'] = [] self['methods'] = [] self['_couldNotImport'] = {} + self['iterations'] = 1 def opt_reactor(self, reactorName): # this must happen before parseArgs does lots of imports *************** *** 123,128 **** --- 125,140 ---- import gc gc.disable() + def opt_benchmark(self, iterations): + """Benchmark a test/tests by running it a number of times""" + try: + self['iterations']=int(iterations) + except ValueError: + raise usage.UsageError("Argument to --benchmark must be a positive integer") + if self.iterations<1: + raise usage.UsageError("Argument to --benchmark must be a positive integer") + + opt_m = opt_module opt_p = opt_package opt_c = opt_testcase *************** *** 246,252 **** log.addObserver(seeWarnings) log.startLogging(open(config['logfile'], 'a'), 0) ! if config['verbose']: reporter = reps.TreeReporter(sys.stdout) elif config['bwverbose']: reporter = reps.VerboseTextReporter(sys.stdout) --- 258,266 ---- log.addObserver(seeWarnings) log.startLogging(open(config['logfile'], 'a'), 0) ! if config['iterations']>1: ! reporter = reps.BenchmarkTextReporter(sys.stdout) ! elif config['verbose']: reporter = reps.TreeReporter(sys.stdout) elif config['bwverbose']: reporter = reps.VerboseTextReporter(sys.stdout) *************** *** 286,297 **** import profile prof = profile.Profile() try: ! prof.runcall(suite.run, reporter, config['random']) except SystemExit: pass prof.print_stats() else: ! suite.run(reporter, config['random']) sys.exit(not reporter.allPassed()) if __name__ == '__main__': --- 300,311 ---- import profile prof = profile.Profile() try: ! prof.runcall(suite.run, reporter, config['random'], config['iterations']) except SystemExit: pass prof.print_stats() else: ! suite.run(reporter, config['random'], config['iterations']) sys.exit(not reporter.allPassed()) if __name__ == '__main__': Index: twisted/trial/reporter.py =================================================================== RCS file: /cvs/Twisted/twisted/trial/reporter.py,v retrieving revision 1.10 diff -c -r1.10 reporter.py *** twisted/trial/reporter.py 18 May 2003 06:30:07 -0000 1.10 --- twisted/trial/reporter.py 10 Jun 2003 21:44:52 -0000 *************** *** 242,247 **** --- 242,302 ---- self.writeln(words.get(resultType, "[??]")+" "+"(%.02f secs)" % t) Reporter.reportResults(self, testClass, method, resultType, results) + class BenchmarkTextReporter(TextReporter): + def __init__(self, stream=sys.stdout): + self.lasttest=None + self.timesum=0 + self.iteration=0 + self.error=0 + TextReporter.__init__(self, stream) + + def reportStart(self, testClass, method): + if self.lasttest and self.lasttest != (testClass, method): + self.reportTestResults() + self.timesum=self.iteration=0 + self.error=0 + self.lasttest=(testClass, method) + self.testStartedAt = time.time() + if not self.iteration: + self.write('%s (%s) ... ', method.__name__, reflect.qual(testClass)) + + def reportResults(self, testClass, method, resultType, results=None): + stopped = time.time() + t = stopped-self.testStartedAt + self.timesum+=t + self.iteration+=1 + if resultType!=SUCCESS: + self.error=resultType + self.results=results + + def stop(self): + # ensure the final test is reported + if self.lasttest: + self.reportTestResults() + self.lasttest=None + self.timesum=self.iteration=self.error=0 + TextReporter.stop(self) + + def reportTestResults(self): + if self.error: + self.reportErrorResult() + else: + self.reportGoodResult() + + def reportErrorResult(self): + words = {SKIP: '[SKIPPED]', + EXPECTED_FAILURE: '[TODO]', + FAILURE: '[FAIL]', ERROR: '[ERROR]', + UNEXPECTED_SUCCESS: '[SUCCESS!?!]', + SUCCESS: '[OK]'} + self.writeln(words.get(self.error, "[??]")) + Reporter.reportResults(self, self.lasttest[0], self.lasttest[1], self.error, self.results) + + def reportGoodResult(self): + self.writeln("[OK] (%d passes in %.01f secs; %.02f ms/pass)" % + (self.iteration, self.timesum, self.timesum/self.iteration*1000)) + Reporter.reportResults(self, self.lasttest[0], self.lasttest[1], SUCCESS, self.results) + class VerboseTextReporter(TextReporter): def __init__(self, stream=sys.stdout): TextReporter.__init__(self, stream) Index: twisted/trial/runner.py =================================================================== RCS file: /cvs/Twisted/twisted/trial/runner.py,v retrieving revision 1.4 diff -c -r1.4 runner.py *** twisted/trial/runner.py 10 Jun 2003 01:28:33 -0000 1.4 --- twisted/trial/runner.py 10 Jun 2003 21:44:52 -0000 *************** *** 60,72 **** assert method.__name__ == self.methodName method() ! def runTests(self, output): testCase = self.testClass() method = getattr(testCase, self.methodName) ! output.reportStart(self.testClass, method) ! tester = unittest.Tester(self.testClass, testCase, method, self.runTest) ! results = tester.run() ! output.reportResults(self.testClass, method, *results) class TestClassRunner: --- 60,73 ---- assert method.__name__ == self.methodName method() ! def runTests(self, output, iterations = 1): testCase = self.testClass() method = getattr(testCase, self.methodName) ! for x in xrange(iterations): ! output.reportStart(self.testClass, method) ! tester = unittest.Tester(self.testClass, testCase, method, self.runTest) ! results = tester.run() ! output.reportResults(self.testClass, method, *results) class TestClassRunner: *************** *** 98,112 **** assert method.__name__ in self.methodNames method() ! def runTests(self, output): self.testCase = self.testClass() self.testCase.setUpClass() for methodName in self.methodNames: method = getattr(self.testCase, methodName) ! output.reportStart(self.testClass, method) ! results = unittest.Tester(self.testClass, self.testCase, ! method, self.runTest).run() ! output.reportResults(self.testClass, method, *results) self.testCase.tearDownClass() def runTest(method): --- 99,114 ---- assert method.__name__ in self.methodNames method() ! def runTests(self, output, iterations = 1): self.testCase = self.testClass() self.testCase.setUpClass() for methodName in self.methodNames: method = getattr(self.testCase, methodName) ! for x in xrange(iterations): ! output.reportStart(self.testClass, method) ! results = unittest.Tester(self.testClass, self.testCase, ! method, self.runTest).run() ! output.reportResults(self.testClass, method, *results) self.testCase.tearDownClass() def runTest(method): Index: twisted/trial/unittest.py =================================================================== RCS file: /cvs/Twisted/twisted/trial/unittest.py,v retrieving revision 1.75 diff -c -r1.75 unittest.py *** twisted/trial/unittest.py 10 Jun 2003 01:28:33 -0000 1.75 --- twisted/trial/unittest.py 10 Jun 2003 21:44:54 -0000 *************** *** 290,296 **** packageDir = os.path.dirname(package.__file__) os.path.walk(packageDir, self._packageRecurse, None) ! def run(self, output, seed = None): output.start(self.numTests) tests = self.tests tests.sort(lambda x,y: cmp(str(x), str(y))) --- 290,296 ---- packageDir = os.path.dirname(package.__file__) os.path.walk(packageDir, self._packageRecurse, None) ! def run(self, output, seed = None, iterations = 1): output.start(self.numTests) tests = self.tests tests.sort(lambda x,y: cmp(str(x), str(y))) *************** *** 304,310 **** output.writeln('Running tests shuffled with seed %d' % seed) for test in tests: ! test.runTests(output) for name, exc in self.couldNotImport.items(): output.reportImportError(name, exc) --- 304,310 ---- output.writeln('Running tests shuffled with seed %d' % seed) for test in tests: ! test.runTests(output, iterations) for name, exc in self.couldNotImport.items(): output.reportImportError(name, exc)

3 5

[Twisted-Python] Jython
by Andrew Cohen 14 Jun '03

14 Jun '03

I'd like to run twisted under Jython. Any hope? a.

2 1

[Twisted-Python] Re: [Twisted-commits] enum type mapper bugfix - need a test for this
by Donovan Preston 14 Jun '03

14 Jun '03

Thanks for fixing that :-) Did it get closed in the tracker? /me looks... The problem with testing this is that you have to start up a different process than the one which is currently running to observe the bug... Any thoughts on testing stuff like this? dp

1 0

[Twisted-Python] release fever
by Glyph Lefkowitz 13 Jun '03

13 Jun '03

We need a new release to get rolling soon. Itamar and I have pretty much finished the design for newcred (it really feels like it's going to work _nicely_, but we haven't implemented anything yet, so stay tuned) and of course, this is going to involve some serious changes. I think we can maintain backwards compatibility, but there are going to be small changes in lots of places in protocol code (z3p, we need to talk to you) that involve doing authentication. We need to get a 1.0.6 release finalized before this sort of work starts hitting CVS; as soon as newcred is in, I want to start the 1.1 release cycle.

3 2

[Twisted-Python] Updated patch for twisted.web.static.loadMimeTypes()
by alexander.winston＠attbi.com 13 Jun '03

13 Jun '03

Attached is an updated patch for the twisted.web.static.loadMimeTypes() function that now takes a list of mime-types files as an argument. See the .diff for more information and/or clarification.

1 0