Mailman 3 April 2003 - Twisted

[Twisted-Python] Re: Twisted 1.0.4 - Heavy search for `plugins.tml'
by Francois Pinard 28 Apr '03

28 Apr '03

Hi. This is a resend of a message which was rejected, because too big. Wise mailing list system! :-). So, I removed 1255 lines from the middle of the last transcript, showing the first 20 and the last 20 only. You'll merely have to believe me that those lines I removed were there! :-) -- François Pinard http://www.iro.umontreal.ca/~pinard

5 10

[Twisted-Python] Virtual hosting and twisted.mail and twisted.web
by Mukhsein Johari 28 Apr '03

28 Apr '03

Hello all, I'm doing some RnD for eventual migration to a twisted system. I'm not sure how 'production' the various bits of twisted are and I'm also not sure how all the bits would fit together. I'm thinking I'll need: twisted.web (need to do virtual hosts on with this) twisted.mail twisted.names(?) I think the setup I'm planning is quite common on the net but most people use apache and sendmail and something called virtualhostmonster? Users should not need a unix account - for email, I'm thinking of using a db to store their username and passwords and get twisted.mail to check there when they try to authenticate to download their emails. Incidentally, would mbox or a dbms be better here? Of course, each website of these users would be on the same machine with the same ip. They would have different domains though - with the content of their websites stored in (maybe) an rdbms. So: Bob's homepage would be at: http://www.bobshome.com and his email would be: bob(a)bobshome.net I would greatly appreciate pointers/tips to achieve this.

2 1

[Twisted-Python] Twisted 1.0.4 - Heavy search for `plugins.tml'
by Francois Pinard 28 Apr '03

28 Apr '03

Hi, people. I noticed yesterday how heavily Twisted tries to find `plugins.tml'. Being new to the game, and not knowing the motivations, a lot of things surely escape my comprehension, yet at first glance, it looks excessive to me trying many thousands of disk accesses merely to find a configuration file. Instead of a long listing followed by a discussion about what could be spared (like, for example, looking all over in `/usr/bin'), this simple experiment shows the problem -- if you agree that there is a problem! :-) ----------------------------------------------------------------------> $ strace 2>&1 mktap | grep plugins.tml | wc -l 2814 ----------------------------------------------------------------------< -- François Pinard http://www.iro.umontreal.ca/~pinard

4 8

[Twisted-Python] a problem about running php on twisted?
by xlp223 28 Apr '03

28 Apr '03

my system is window me python 2.2.2 twisted 1.0.4 php 4.3.1 mysql phpbb 2.0.4 i want to run phpbb on twisted 1.0.4 under window, when i installed above software on window xp home edition,it was successful. but when i installed above software on window me or window xp profession edition,it failed. Step of my doing is 1)create dir c:\pydoc and copy c:\python22\doc to c:\pydoc create c:\pydoc\phpbb2 and copy phpbb2 to it 2)edit hello.rpy in c:\python22\scripts and save it in this dir from twisted.web import static, twcgi class PHPScript(twcgi.FilteredScript): filter = 'C:\\PHP\\php' resource = static.File("c:\\pydoc") resource.processors[".php"] = PHPScript resource.indexNames = ['index.html','index.php'] 3)run the command: python mktap.py web -p 80 --resource-script=hello.rpy -i index.html,index.php 4)run the command: python twistd.py -f web.tap -r win32 After the fourth step ran,i entered into the ie browser and input http://localhost/ it is ok to show the html. but while i input http://localhost/phpbb2 , it show 500 error. why? who can help me to solve it? ______________________________________ ===================================================================

1 0

[Twisted-Python] Twisted 1.0.4 - admin/runtests failures?
by Francois Pinard 27 Apr '03

27 Apr '03

Hello, Twisted people. Out of the box (yet I already did `python setup.py install --prefix=/usr, as `root'), `admin/runtests' yields a few errors, as shown below. Should these be expected? Reported? This is over a SuSE 8.1 Linux. `pycrypto' 1.9a6 is installed. 17:21:31 0 pinard@alcyon:/usr/tmp/Twisted-1.0.4 $ admin/runtests ...................................................................................................F........S.................................T..............................................................................................................................T......................................................................................................................................SS...........F.......................................................................................................E................................................................. =============================================================================== SKIPPED: testModules (twisted.test.test_doc.DocCoverage) ------------------------------------------------------------------------------- Activate me when you feel like writing docstrings, and fixing GTK crashing bugs. =============================================================================== SKIPPED: testReadLimit (twisted.test.test_policies.ThrottlingTestCase) ------------------------------------------------------------------------------- Inaccurate tests are worse than no tests. =============================================================================== SKIPPED: testWriteLimit (twisted.test.test_policies.ThrottlingTestCase) ------------------------------------------------------------------------------- Inaccurate tests are worse than no tests. =============================================================================== EXPECTED FAILURE: testStor (twisted.test.test_ftp.FTPClientAndServerTests) ------------------------------------------------------------------------------- Traceback (most recent call last): File "/var/tmp/Twisted-1.0.4/twisted/test/test_ftp.py", line 276, in testStor self.assertEquals(open('HelloThere').read(), expectedContent) FailTest: '' != 'Hello\nHello\nHello\nHello\n' =============================================================================== EXPECTED FAILURE: testSneakyHiddenDoom (twisted.test.test_loopback.LoopbackTCPTestCase) ------------------------------------------------------------------------------- Traceback (most recent call last): File "/var/tmp/Twisted-1.0.4/twisted/test/test_loopback.py", line 77, in testSneakyHiddenDoom LoopbackTestCase.testSneakyHiddenDoom(self) File "/var/tmp/Twisted-1.0.4/twisted/test/test_loopback.py", line 71, in testSneakyHiddenDoom self.assertEquals(c.lines, ['DOOM LINE', 'Hello 1', 'Hello 2', 'Hello 3']) FailTest: ['DOOM LINE', 'Hello 1', 'Hello 2'] != ['DOOM LINE', 'Hello 1', 'Hello 2', 'Hello 3'] =============================================================================== FAILURE: testModificationTime (twisted.test.test_dirdbm.ShelfTestCase) ------------------------------------------------------------------------------- Traceback (most recent call last): File "/var/tmp/Twisted-1.0.4/twisted/test/test_dirdbm.py", line 114, in testModificationTime self.assert_(0 <= time.time() - self.dbm.getModificationTime("k") < 1) FailTest =============================================================================== FAILURE: testStderr (twisted.test.test_process.PosixProcessTestCase) ------------------------------------------------------------------------------- Traceback (most recent call last): File "/var/tmp/Twisted-1.0.4/twisted/test/test_process.py", line 386, in testStderr self.assertEquals(lsOut, p.errF.getvalue()) FailTest: '/bin/ls: ZZXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX: Aucun fichier ou r\xe9pertoire de ce type\n' != '/bin/ls: ZZXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX: No such file or directory\n' =============================================================================== ERROR: testMulticast (twisted.test.test_udp.MulticastTestCase) ------------------------------------------------------------------------------- Traceback (most recent call last): File "/var/tmp/Twisted-1.0.4/twisted/trial/unittest.py", line 188, in runOneTest method(testCase) File "/var/tmp/Twisted-1.0.4/twisted/test/test_udp.py", line 186, in testMulticast self.assertEquals(self.server.packets[0][0], "hello world") IndexError: list index out of range ------------------------------------------------------------------------------- Ran 587 tests in 100.385s FAILED (failures=2, errors=1, skips=3, expectedFailures=2) -- François Pinard http://www.iro.umontreal.ca/~pinard

3 4

[Twisted-Python] Twisted 1.0.4 - `mktap --help SERVER'
by Francois Pinard 27 Apr '03

27 Apr '03

Hi, still me. After having quickly glanced over the manual, I'm reading it a bit more carefully now, and if comments like this message continue to pop up, you will observe my progression, or non-progression if I cannot find enough time :-), without my real will. Sigh! OK, let not me be too shy... Page 21 (2.2.3 mktap and tapconvert) says: "For a given server, `mktap --help <name>' shows the possible configuration options.". The following shell script: ----------------------------------------------------------------------> #!/bin/bash for s in coil conch dns ftp im inetd mail manhole news parent pinger ponger \ portforward procmon sibling socks telnet toc web words zoot; do echo $s ===================================== mktap --help $s < /dev/null done ----------------------------------------------------------------------< seems to show that this is not completely true. * For coil, dns, ftp, im, mail, pinger, ponger, portforward, socks, telnet, toc, web, words and zoot, I got no output at all, so I presume this may be interpreted as meaning that these servers use no option. Yet, for all those, a `.tap' file was created, which is probably not what one expect from a mere `--help' option. So maybe the `--help' did not work so well after all. * I also got many DeprecationWarnings, which probably should not be there. Let's see: + conch yields: ----------------------------------------------------------------------> WARNING: exceptions.DeprecationWarning:: setApplication is deprecated, use setServiceCollection instead. file: /usr/lib/python2.2/site-packages/twisted/scripts/mktap.py; line: 217 ----------------------------------------------------------------------< + parent yields: ----------------------------------------------------------------------> WARNING: exceptions.DeprecationWarning:: You have to pass an authorizer separately from an application now. file: /usr/lib/python2.2/site-packages/twisted/sibling/parentserv.py; line: 23 WARNING: exceptions.DeprecationWarning:: Application.authorizer attribute is deprecated, use Service.authorizer instead file: /usr/lib/python2.2/site-packages/twisted/cred/service.py; line: 84 WARNING: exceptions.DeprecationWarning:: setApplication is deprecated, use setServiceCollection instead. file: /usr/lib/python2.2/site-packages/twisted/python/reflect.py; line: 192 WARNING: exceptions.DeprecationWarning:: Application.authorizer attribute is deprecated, use Service.authorizer instead file: /usr/lib/python2.2/site-packages/twisted/spread/pb.py; line: 959 ----------------------------------------------------------------------< + sibling yields: ----------------------------------------------------------------------> WARNING: exceptions.DeprecationWarning:: You have to pass an authorizer separately from an application now. file: /usr/lib/python2.2/site-packages/twisted/sibling/siblingserv.py; line: 68 WARNING: exceptions.DeprecationWarning:: Application.authorizer attribute is deprecated, use Service.authorizer instead file: /usr/lib/python2.2/site-packages/twisted/cred/service.py; line: 84 WARNING: exceptions.DeprecationWarning:: Application.authorizer attribute is deprecated, use Service.authorizer instead file: /usr/lib/python2.2/site-packages/twisted/sibling/siblingserv.py; line: 80 WARNING: exceptions.DeprecationWarning:: Application.authorizer attribute is deprecated, use Service.authorizer instead file: /usr/lib/python2.2/site-packages/twisted/sibling/siblingserv.py; line: 82 WARNING: exceptions.DeprecationWarning:: Application.authorizer attribute is deprecated, use Service.authorizer instead file: /usr/lib/python2.2/site-packages/twisted/spread/pb.py; line: 959 ----------------------------------------------------------------------< and for these three cases as well, a `.tap' file was created. So maybe `--help' does not work as documented for these either. * manhole did ask for supplementary information, like this: ----------------------------------------------------------------------> Password: Confirm: ----------------------------------------------------------------------< While sorting and cleaning out my various tries, I also found another case for `mktap --help manhole' which yielded the following: ----------------------------------------------------------------------> An error unexpected occurred: File "/usr/lib/python2.2/site-packages/twisted/tap/manhole.py", line 45, in opt_password self['password'] = util.getPassword(confirm=1) File "/usr/lib/python2.2/site-packages/twisted/python/util.py", line 154, in getPassword if password[-1] == '\n': IndexError: string index out of range ----------------------------------------------------------------------< yet I do not find back the exact recipe I use for producing this. Maybe the traceback will give hints about another problem? In any case, a `.tap' file was created. * For inetd, I got: ----------------------------------------------------------------------> An error unexpected occurred: File "/usr/lib/python2.2/site-packages/twisted/runner/inetdconf.py", line 90, in parseLine self.parseFields(*line.split()) File "/usr/lib/python2.2/site-packages/twisted/runner/inetdconf.py", line 174, in parseFields raise InvalidServicesConfError, 'Invalid port/protocol:' + \ InvalidServicesConfError: Invalid port/protocol:'3322-3325' ----------------------------------------------------------------------< At least, no `.tap' was created. :-) * Both news and procmon provided the expected help output, and created no `.tap'. However, the help was assorted with an error diagnostic, which is probably not appropriate for a mere help request. + news help output was prefixed with: ----------------------------------------------------------------------> Usage Error: No newsgroups specified ----------------------------------------------------------------------< + procmon help output was suffixed with: ----------------------------------------------------------------------> Wrong number of arguments. ----------------------------------------------------------------------< Even if the errors were expected, they should _ideally_ be presented both before, or both after; and both have the `Usage Error:' prefix, or both not have it. All in all, I'm left with the impression that `--help' does not work, or at least, not as documented in the book. It might be worth, maybe, adding another unit test which makes sure that `mktap --help <name>' produces for all servers, some output (on standard output ideally, not standard error), or no output at all, but surely no traceback, and with an exit status that would be consistently zero. -- François Pinard http://www.iro.umontreal.ca/~pinard

2 2

[Twisted-Python] Joined the bleedin' choir invisible!
by Itamar Shtull-Trauring 27 Apr '03

27 Apr '03

2.1 support is now officially dead. Please don't start changing existing Twisted code to use 2.2 features unless you're actually adding new functionality. We might need to backport some code to 2.1 at some point, though that's pretty unlikely. -- Itamar Shtull-Trauring http://itamarst.org/ http://www.zoteca.com -- Python & Twisted consulting

1 0

[Twisted-Python] Twisted-1.0.4 - Typo in twisted/words/service.py
by Francois Pinard 27 Apr '03

27 Apr '03

Hi. Another nit. In Twisted-1.0.4/twisted/words/service.py, line 562: ----------------------------------------------------------------------> raise KeyError("Pariticpant already exists: %s." % name) ----------------------------------------------------------------------< should be written: ----------------------------------------------------------------------> raise KeyError("Participant already exists: %s." % name) ----------------------------------------------------------------------< P.S. - If there is an email address to use for such details, instead of the mailing list, please tell me. As long as this is email, it's OK for me! :-) -- François Pinard http://www.iro.umontreal.ca/~pinard

2 2

[Twisted-Python] Patch: row (forgot attachment)
by Justin Ryan 27 Apr '03

27 Apr '03

Ooops, forgot the attachment.. -j Index: twisted/enterprise/reflector.py =================================================================== RCS file: /cvs/Twisted/twisted/enterprise/reflector.py,v retrieving revision 1.15 diff -u -r1.15 reflector.py --- twisted/enterprise/reflector.py 12 Feb 2003 14:37:48 -0000 1.15 +++ twisted/enterprise/reflector.py 27 Apr 2003 18:05:15 -0000 @@ -18,7 +18,7 @@ import weakref from twisted.enterprise import adbapi -from twisted.enterprise.util import DBError, getKeyColumn, quote, _TableInfo, _TableRelationship +from twisted.enterprise.util import DBError, getKeyColumn, _TableInfo, _TableRelationship from twisted.enterprise.row import RowObject from twisted.internet import defer Index: twisted/enterprise/row.py =================================================================== RCS file: /cvs/Twisted/twisted/enterprise/row.py,v retrieving revision 1.19 diff -u -r1.19 row.py --- twisted/enterprise/row.py 4 Oct 2002 23:38:47 -0000 1.19 +++ twisted/enterprise/row.py 27 Apr 2003 18:05:15 -0000 @@ -64,6 +64,7 @@ populated = 0 # set on the class when the class is "populated" with SQL dirty = 0 # set on an instance then the instance is out-of-sync with the database + case_sensitive_relations = 0 # set if you want relations (table / column names_ to be treated as case sensitive def assignKeyAttr(self, attrName, value): """Assign to a key attribute. @@ -83,7 +84,7 @@ """Find an attribute by caseless name. """ for attr, type in self.rowColumns: - if string.lower(attr) == string.lower(attrName): + if self.compareRelations(attr,attrName): return getattr(self, attr) raise DBError("Unable to find attribute %s" % attrName) @@ -110,7 +111,7 @@ if getKeyColumn(self.__class__, attr): continue for column, ctype, typeid in self.dbColumns: - if string.lower(column) == string.lower(attr): + if self.compareRelations(column, attr): q = dbTypeMap.get(ctype, None) if q == NOQUOTE: setattr(self, attr, 0) @@ -131,6 +132,18 @@ for keyName, keyType in self.rowKeyColumns: keys.append( getattr(self, keyName) ) return tuple(keys) + + def compareRelations(self, relation, attr): + """Wrap comparisons involving relations + + This allows for case-sensitive or case-insensitive comparisons + involving relations (table or column names), based on the value of + case_sensitive_relations. + """ + if self.case_sensitive_relations: + return relation == attr + else: + return string.lower(relation) == string.lower(attr) class KeyFactory: Index: twisted/enterprise/sqlreflector.py =================================================================== RCS file: /cvs/Twisted/twisted/enterprise/sqlreflector.py,v retrieving revision 1.14 diff -u -r1.14 sqlreflector.py --- twisted/enterprise/sqlreflector.py 12 Jan 2003 06:26:48 -0000 1.14 +++ twisted/enterprise/sqlreflector.py 27 Apr 2003 18:05:16 -0000 @@ -17,7 +17,7 @@ import string from twisted.enterprise import adbapi -from twisted.enterprise.util import DBError, getKeyColumn, quote, _TableInfo, _TableRelationship +from twisted.enterprise.util import DBError, getKeyColumn, quote_value, quote_relation, _TableInfo, _TableRelationship from twisted.enterprise.row import RowObject from twisted.enterprise import reflector @@ -37,11 +37,14 @@ reflector.GREATERTHAN : ">", reflector.LIKE : "like" } - - def __init__(self, dbpool, rowClasses): + quote_relations = 0 + + def __init__(self, dbpool, rowClasses, **kw): """ Initialize me against a database. """ + if 'quote_relations' in kw: + self.quote_relations = kw['quote_relations'] adbapi.Augmentation.__init__(self, dbpool) reflector.Reflector.__init__(self, rowClasses) @@ -87,7 +90,16 @@ @param value: a value to format as data in SQL. @param type: a key in util.dbTypeMap. """ - return quote(value, type, string_escaper=self.escape_string) + return quote_value(value, type, string_escaper = self.escape_string) + + def quote_relation(self, relation): + """Format a relation for use in a SQL statement. + + @param relation: a string to format as a relation for SQL + examples of relations are table / column names. For some + databases, they must be double quoted + """ + return quote_relation(relation, self.quote_relations) def loadObjectsFrom(self, tableName, parentRow=None, data=None, whereClause=None, forceChildren=0): """Load a set of RowObjects from a database. @@ -138,8 +150,8 @@ first = 0 else: sql = sql + "," - sql = sql + " %s" % column - sql = sql + " FROM %s " % (tableName) + sql = sql + " %s" % self.quote_relation(column) + sql = sql + " FROM %s " % self.quote_relation(tableName) if whereClause: sql += " WHERE " first = 1 @@ -151,7 +163,8 @@ (columnName, cond, value) = wItem t = self.findTypeFor(tableName, columnName) quotedValue = self.quote_value(value, t) - sql += "%s %s %s" % (columnName, self.conditionalLabels[cond], quotedValue) + quotedColumn = self.quote_relation(columnName) + sql += "%s %s %s" % (quotedColumn, self.conditionalLabels[cond], quotedValue) # execute the query transaction.execute(sql) @@ -204,7 +217,7 @@ Returns: SQL that is used to contruct a rowObject class. """ - sql = "UPDATE %s SET" % tableInfo.rowTableName + sql = "UPDATE %s SET" % self.quote_relation(tableInfo.rowTableName) # build update attributes first = 1 for column, type in tableInfo.rowColumns: @@ -212,7 +225,7 @@ continue if not first: sql = sql + ", " - sql = sql + " %s = %s" % (column, "%s") + sql = sql + " %s = %s" % (self.quote_relation(column), "%s") first = 0 # build where clause @@ -231,13 +244,13 @@ Returns: SQL that is used to insert a new row for a rowObject instance not created from the database. """ - sql = "INSERT INTO %s (" % tableInfo.rowTableName + sql = "INSERT INTO %s (" % self.quote_relation(tableInfo.rowTableName) # build column list first = 1 for column, type in tableInfo.rowColumns: if not first: sql = sql + ", " - sql = sql + column + sql = sql + self.quote_relation(column) first = 0 sql = sql + " ) VALUES (" @@ -256,23 +269,22 @@ def buildDeleteSQL(self, tableInfo): """Build the SQL to delete a row from the table. """ - sql = "DELETE FROM %s " % tableInfo.rowTableName + sql = "DELETE FROM %s " % self.quote_relation(tableInfo.rowTableName) # build where clause first = 1 sql = sql + " WHERE " for keyColumn, type in tableInfo.rowKeyColumns: if not first: sql = sql + " AND " - sql = sql + " %s = %s " % (keyColumn, "%s") + sql = sql + " %s = %s " % (self.quote_relation(keyColumn), "%s") first = 0 return sql - def updateRowSQL(self, rowObject): """build SQL to update my current state. """ args = [] - tableInfo = self.schema[rowObject.rowTableName] + tableInfo = self.schema[rowObject.rowTableName] # build update attributes for column, type in tableInfo.rowColumns: if not getKeyColumn(rowObject.__class__, column): @@ -313,11 +325,10 @@ """build SQL to delete me from the db. """ args = [] - tableInfo = self.schema[rowObject.rowTableName] + tableInfo = self.schema[rowObject.rowTableName] # build where clause for keyColumn, type in tableInfo.rowKeyColumns: args.append(self.quote_value(rowObject.findAttribute(keyColumn), type)) - return self.getTableInfo(rowObject).deleteSQL % tuple(args) def deleteRow(self, rowObject): Index: twisted/enterprise/util.py =================================================================== RCS file: /cvs/Twisted/twisted/enterprise/util.py,v retrieving revision 1.12 diff -u -r1.12 util.py --- twisted/enterprise/util.py 29 Jan 2003 04:51:19 -0000 1.12 +++ twisted/enterprise/util.py 27 Apr 2003 18:05:16 -0000 @@ -54,7 +54,7 @@ return name return None -def quote(value, typeCode, string_escaper=adbapi.safe): +def quote_value(value, typeCode, string_escaper=adbapi.safe): """Add quotes for text types and no quotes for integer types. NOTE: uses Postgresql type codes.. """ @@ -74,6 +74,18 @@ if type(value) is not types.StringType: value = str(value) return "'%s'" % string_escaper(value) + +def quote_relation(relation, take_action=0): + """Format a relation for use in a SQL statement. + + @param relation: a string to format as a relation for SQL + examples of relations are table / column names. For some + databases, they must be double quoted + """ + if take_action: + return '"%s"' % relation + else: + return str(relation) def makeKW(rowClass, args): """Utility method to construct a dictionary for the attributes

1 0

[Twisted-Python] SURVEY: For Twisted users, please answer
by Itamar Shtull-Trauring 27 Apr '03

27 Apr '03

1. Do you require Python 2.1 support in Twisted? If so, for what reason? How problematic would a switch to 2.2 be for you? Please try to answer within a week so we can have some immediate info. 2. Do you have any Twisted success stories you'd like to share (besides those listed in our success stories page, of course)? Thanks. -- Itamar Shtull-Trauring http://itamarst.org/ http://www.zoteca.com -- Python & Twisted consulting

17 32