Mailman 3 November 2007 - Python-Dev

Re: [Python-Dev] Suggestions for Improvements to namedtuple
by Raymond Hettinger 14 Nov '07

14 Nov '07

> for efficiency I would prefer to avoid using * to break > up the sequences generated directly by the database interface. There are some use cases that would be better served by an alternate design and others that are better served by the current design. For example, it would really suck to have to type-out an an enclosing set of parenthesis to build a named tuple explicitly: opt = StockOption((daysleft/360., strike/100.0, bool(putcall))). The alternate signature was discussed and rejected previously. See some of the details on previous python-dev posting and in the ASPN recipe discussion: at some length in the ASPN recipe: http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/500261 FWIW, the current design does work efficiently with your use case if you use itertools to apply the named tuple cast to large record sets. See the example in the docs: http://docs.python.org/dev/library/collections.html#named-tuple-factory-fun… Also, fwiw, I've had good success using this starmap() approach in some performance critcal applications. Almost every class in Python could be subjected to the same discussion. Why doesn't every class and function accept a tuple of args instead of separate, serial arguments. The * operator and starmap() function were provided specifically to address the inter-conversion between the two approaches. > It would be nice to be able to have default values This came-up before, but I'll take another look at it this weekend. If it significantly complicates the API or impacts performance, then it is a non-starter; otherwise, I'll put together an implementation and float it on ASPN for comments. > In my opinion __replace__ should be able to replace multiple fields. This may be do-able. Will take a look at it. The current design is easily extended for this without impacting performance. The question is whether is makes sense in normal applications to do multiple replacements at once. FWIW, the str.replace function only has one target/replacement pair. > To me, exec is a last resort It was a last resort here also. Earlier versions of the recipe used type() but they were less flexible, slower, had crummy error reporting, and were much less clear. The exec version has the advantage of being able to print-out the template so you can see *exactly* what it is doing. I ended-up putting in a lot f field validation to prevent injection attacks (they are also they to provide more actionable error messages). > crucial stuff like __fields__ and __signature__ fully > read-write. It feels like those should be read-only properties. > ... On the other hand, I'm a recovering Java programmer, Welcome to the Python world of consenting adults. These fields could be made read-only but that is just a matter of taste. Looking through the standard library, you'll see making attributes read-only is not the typical practice. If users demand it, I don't see a problem with it, but until then, I don't see a reason to unnecessarily complicate and slow-down the code. FWIW, you're welcome to email me directly. I've been getting tons of user feedback and have already incorporated the better suggestions. Also, the recipe itself is a combination of the best of prior attempts. Unfortunately, each of several commenters revisit everything from scratch and propose their own complete rewrites that ignore the requests and commments of all those who preceded them. Fortunately, we're homing in on a darned good tool. Raymond

1 0

CPython crash with '%o'
by Mike Stall 14 Nov '07

14 Nov '07

This is my first post, so here's a quick intro: I've recently joined the IronPython team at Microsoft, after about 6 years as a developer on the the .NET runtime (CLR). I'm currently trying to make IronPython match CPython's behavior regarding some % format string to a level of detail not documented by the spec. (http://docs.python.org/lib/typesseq-strings.html) While exploring to determine what CPython's behavior is, I'm hitting a SystemError in CPython. Given the following snippet: class c(long): def __oct__(self): return '100' x=c(5) oct(x) # expected to print 100 '%o' % x # expected to use print '5' It looks like in CPython, '%o' uses __int__ and so it should ignore __oct__ and print 5. However, I'm hitting an SystemError in CPython with this snippet: Python 2.5.1 (r251:54863, Apr 18 2007, 08:51:08) [MSC v.1310 32 bit (Intel)] onwin32 Type "help", "copyright", "credits" or "license" for more information. >>> class c(long): ... def __oct__(self): ... return '100' ... >>> x=c(5) >>> oct(x) # expected to print 100 '100' >>> '%o' % x # expected to use print '5' Traceback (most recent call last): File "<stdin>", line 1, in <module> SystemError: \loewis\25\python\Objects\stringobject.c:4236: bad argument to internal function Note that if c derives from 'int' instead of 'long', everything works as expected. 1. Can somebody confirm that '%o' should not use __oct__ and that is uses __int__ instead, and that the correct output from ('%o' % x) is indeed 5? 2. Should I file a bug for the SystemError exception? Thanks, Mike http://blogs.msdn.com/jmstall

3 3

Suggestions for Improvements to namedtuple
by Isaac Morland 14 Nov '07

14 Nov '07

I was working on something very similar to namedtuple for a project of my own, when it occurred to me that it's generally useful idea and maybe somebody else was working on it too. So I searched, and found Raymond Hettinger's addition to collections.py, and it does pretty much what I want. I have a few suggestions which I hope are improvements. I will discuss each one, and then at the bottom I will put my version of namedtuple. It is not based on the one in Python SVN because it was mostly written before I found out about that one. If my suggestions meet with approval, I could check out a copy of collections.py and make a patch for further comment and eventual submission to somebody with checkin privileges. 1. I think it is important that there be a way to create individual namedtuple instances from an existing sequence that doesn't involve splitting the sequence out into individual parameters and then re-assembling a tuple to pass to the base tuple constructor. In my application, I'm taking database rows and creating named tuples from them, with the named tuple type being automatically created as appropriate. So there will be *lots* of named tuple instances created, so for efficiency I would prefer to avoid using * to break up the sequences generated directly by the database interface. I would like to pass those sequences directly to the base tuple constructor. To restore to my code the feature of being able to use individual parameters as in collections.py, I added a classmethod to the generated classes called __fromvalues__. This uses Signature, my other idea (next message) to convert a call matching a procedure signature of (fieldname1, ...) into a dictionary, and passes that dictionary into another classmethod __fromdict__ which creates a named tuple instance from the dictionary contents. The problem I see with this is that having to say Point.__fromvalues__ (11, y=22) instead of Point (11, y=22) is a little verbose. Perhaps there could be an __fromsequence__ instead for the no-unpacking method of instance creation, as the most common use of direct-from-sequence creation I think is in a more general circumstance. 2. It would be nice to be able to have default values for named tuple fields. Using Signature it's easy to do this - I just specify a dictionary of defaults at named tuple class creation time. 3. In my opinion __replace__ should be able to replace multiple fields. My version takes either two parameters, same as collections.py, or a single dictionary containing replacements. 4. I put as much of the implementation as possible of the named tuple classes into a base class which I've called BaseNamedTuple. This defines the classmethods __fromvalues__ and __fromdict__, as well as the regular methods __repr__, __asdict__, and __replace__. 5. It didn't occur to me to use exec ... in so I just create the new type using the type() function. To me, exec is a last resort, but I'm a Python newbie so I'd be interested to hear what people have to say about this. 6. Not an improvement but a concern about my code: the generated classes and instances have all the crucial stuff like __fields__ and __signature__ fully read-write. It feels like those should be read-only properties. I think that would require namedtuple to be a metaclass instead of just a function (in order for the properties of the generated classes to be read-only). On the other hand, I'm a recovering Java programmer, so maybe it's un-Pythonic to want stuff to be read-only. Here I would especially appreciate any guidance more experienced hands can offer. And now, here is the code, together with a rudimentary example of how this could be used to improve the "addr" functions in email.utils: #!/usr/bin/env python from operator import itemgetter class BaseNamedTuple (tuple): @classmethod def __fromvalues__ (cls, *args, **keys): return cls.__fromdict__ (cls.__signature__.expand_args (*args, **keys)) @classmethod def __fromdict__ (cls, d): return cls ([d[name] for name in cls.__fields__]) def __repr__ (self): return self.__reprtemplate__ % self def __asdict__ (self): return dict (zip (self.__fields__, self)) def __replace__ (self, *args): slist = list (self) if len (args) == 1: sdict = args[0] elif len (args) == 2: sdict = {args[0]: args[1]} else: raise TypeError for key in sdict: slist[self.__indices__[key]] = sdict[key] return self.__class__ (slist) def namedtuple (name, fields, defaults=None): fields = tuple (fields) result = type (name, (BaseNamedTuple,), {}) for i in range (len (fields)): setattr (result, fields[i], property (itemgetter (i), None, result)) result.__fields__ = fields result.__signature__ = Signature (fields, defaults=defaults) result.__reprtemplate__ = "%s(%s)" % (name, ", ".join ("%s=%%r" % name for name in fields)) result.__indices__ = dict ((field, i) for i, field in enumerate (fields)) return result from email.utils import formataddr class test (namedtuple ("test", ("realname", "email"), {'realname': None})): @property def valid (self): return self.email.find ("@") >= 0 __str__ = formataddr if __name__ == "__main__": e1 = test (("Smith, John", "jsmith(a)example.com")) print "e1.realname =", e1.realname print "e1.email =", e1.email print "e1 =", repr (e1) print "str(e1) =", str (e1) e2 = test.__fromvalues__ (email="test(a)example.com") print "e2 =", repr (e2) print "str(e2) =", str (e2) Isaac Morland CSCF Web Guru DC 2554C, x36650 WWW Software Specialist

1 0

Summary of Tracker Issues
by Tracker 14 Nov '07

14 Nov '07

ACTIVITY SUMMARY (11/07/07 - 11/14/07) Tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 1325 open (+18) / 11600 closed (+25) / 12925 total (+43) Open issues with patches: 421 Average duration of open issues: 689 days. Median duration of open issues: 797 days. Open Issues Breakdown open 1320 (+18) pending 5 ( +0) Issues Created Or Reopened (44) _______________________________ test_import breaks on Linux 11/09/07 http://bugs.python.org/issue1377 reopened gvanrossum py3k Py3k's print() flushing problem 11/07/07 http://bugs.python.org/issue1400 created wojtekwalczak py3k urllib2 302 POST 11/07/07 http://bugs.python.org/issue1401 created andresriancho Interpreter cleanup: order of _PyGILState_Fini and PyInterpreter 11/07/07 http://bugs.python.org/issue1402 created ronaldoussoren py_compile and compileall need unit tests 11/08/07 http://bugs.python.org/issue1403 created tiran py3k warnings module bug: BytesWarning: str() on a bytes instance 11/08/07 CLOSED http://bugs.python.org/issue1404 created tiran patch Garbage collection not working correctly in Python 2.3 11/09/07 CLOSED http://bugs.python.org/issue1405 reopened tiran Use widechar api for os.environ 11/08/07 CLOSED http://bugs.python.org/issue1406 created theller py3k, patch [performance] Too many closed() checkings 11/08/07 http://bugs.python.org/issue1407 created wojtekwalczak py3k Inconsistence in multiply list 11/08/07 CLOSED http://bugs.python.org/issue1408 created beco new keyword-only function parameters interact badly with nested 11/08/07 http://bugs.python.org/issue1409 created _doublep py3k BaseHTTPServer cannot accept Unicode data 11/08/07 CLOSED http://bugs.python.org/issue1410 created isonno A typo in tutorial 11/09/07 CLOSED http://bugs.python.org/issue1411 created falsetru test_subprocess fails on SuSE 10 11/09/07 http://bugs.python.org/issue1412 created dvadasz int literal methods inaccessible 11/09/07 CLOSED http://bugs.python.org/issue1413 created mykhal Fix for refleak tests 11/09/07 http://bugs.python.org/issue1414 created tiran py3k, patch py3k: pythonw.exe fails because std streams a missing 11/10/07 CLOSED http://bugs.python.org/issue1415 created tiran py3k @prop.setter decorators 11/10/07 CLOSED http://bugs.python.org/issue1416 created gvanrossum patch Weakref not working properly 11/10/07 CLOSED http://bugs.python.org/issue1417 created MHOOO Python/hypot.c is never used 11/10/07 CLOSED http://bugs.python.org/issue1418 created marketdickinson ssl module version 1.10 causes TypeError when accepting connecti 11/11/07 CLOSED http://bugs.python.org/issue1419 created complex Unicode literals in tokenize.py and tests. 11/11/07 CLOSED http://bugs.python.org/issue1420 created ron_adam py3k, patch python.org: outdated and false information 11/11/07 CLOSED http://bugs.python.org/issue1421 created tiran Writing to an invalid fd doesn't raise an exception 11/11/07 CLOSED http://bugs.python.org/issue1422 created tiran py3k wave sunau aifc 16bit errors 11/11/07 http://bugs.python.org/issue1423 created jeroen py3k: readline and rlcompleter doesn't list choices 11/11/07 CLOSED http://bugs.python.org/issue1424 created tiran py3k readline: no display matches hook set 11/11/07 CLOSED http://bugs.python.org/issue1425 created tiran py3k readline module needs a review 11/11/07 CLOSED http://bugs.python.org/issue1426 created tiran py3k Error in standard module calendar 11/11/07 CLOSED http://bugs.python.org/issue1427 created gdamjan patch Update to property.__doc__ 11/11/07 CLOSED http://bugs.python.org/issue1428 created tiran patch FD leak in SocketServer 11/12/07 http://bugs.python.org/issue1429 created luke-jr Installing on Vista asks to close Explorer (and Nokia PC Suite) 11/12/07 CLOSED http://bugs.python.org/issue1430 created dabarlow pth files not loaded at startup 11/12/07 http://bugs.python.org/issue1431 created gbloisi patch Strange behavior of urlparse.urljoin 11/13/07 http://bugs.python.org/issue1432 created yan marshal roundtripping for unicode 11/13/07 CLOSED http://bugs.python.org/issue1433 created cfbolz SocketServer creates non-blocking files 11/13/07 http://bugs.python.org/issue1434 created luke-jr Support for multiple handlers for the "with" statement 11/13/07 CLOSED http://bugs.python.org/issue1435 created Stavros logging.config.fileConfig, NameError: name 'RotatingFileHandler' 11/13/07 CLOSED http://bugs.python.org/issue1436 created sebastian List member inside a class is shared by all instances of the cla 11/13/07 CLOSED http://bugs.python.org/issue1437 created glubglub Calling base class methods is slow due to __instancecheck__ over 11/13/07 http://bugs.python.org/issue1438 created gvanrossum proposed 3000 patch for socket.py - "socket GC worries" 11/13/07 http://bugs.python.org/issue1439 created janssen py3k, patch Checks for PySys_GetObject("std???") == Py_None 11/14/07 http://bugs.python.org/issue1440 created tiran py3k, patch Cycles through ob_type aren't freed 11/14/07 http://bugs.python.org/issue1441 created rhamphoryncus pythonstartup addition of minor error checking 11/14/07 http://bugs.python.org/issue1442 created JosephArmbruster patch Issues Now Closed (40) ______________________ test_glob fails with UnicodeDecodeError 72 days http://bugs.python.org/issue1042 tiran rfe py3k: corrections for test_subprocess on windows 72 days http://bugs.python.org/issue1047 tiran patch file.seek allows float arguments 68 days http://bugs.python.org/issue1081 tiran py3k test_email failed 67 days http://bugs.python.org/issue1086 tiran rfe py3k os.popen result is not iterable, patch attached 67 days http://bugs.python.org/issue1087 tiran patch Problems with the msi installer - python-3.0a1.msi 64 days http://bugs.python.org/issue1110 tiran No tests for inspect.getfullargspec() 63 days http://bugs.python.org/issue1127 tiran py3k, patch test_urllib2net fails on test_ftp 57 days http://bugs.python.org/issue1157 tiran py3k Should itertools.count work for arbitrary integers? 53 days http://bugs.python.org/issue1165 rhettinger py3k pdb fails to launch some script. 33 days http://bugs.python.org/issue1254 tiran pdb bug with "with" statement 33 days http://bugs.python.org/issue1265 amaury.forgeotdarc py3k Add getsize() to io instances 13 days http://bugs.python.org/issue1351 loewis py3k, patch Can't pickle partial functions 1 days http://bugs.python.org/issue1398 tiran warnings module bug: BytesWarning: str() on a bytes instance 0 days http://bugs.python.org/issue1404 tiran patch Garbage collection not working correctly in Python 2.3 1 days http://bugs.python.org/issue1405 gvanrossum Use widechar api for os.environ 0 days http://bugs.python.org/issue1406 theller py3k, patch Inconsistence in multiply list 1 days http://bugs.python.org/issue1408 georg.brandl BaseHTTPServer cannot accept Unicode data 1 days http://bugs.python.org/issue1410 tiran A typo in tutorial 0 days http://bugs.python.org/issue1411 georg.brandl int literal methods inaccessible 0 days http://bugs.python.org/issue1413 loewis py3k: pythonw.exe fails because std streams a missing 4 days http://bugs.python.org/issue1415 amaury.forgeotdarc py3k @prop.setter decorators 1 days http://bugs.python.org/issue1416 gvanrossum patch Weakref not working properly 4 days http://bugs.python.org/issue1417 gagenellina Python/hypot.c is never used 2 days http://bugs.python.org/issue1418 loewis ssl module version 1.10 causes TypeError when accepting connecti 3 days http://bugs.python.org/issue1419 janssen Unicode literals in tokenize.py and tests. 1 days http://bugs.python.org/issue1420 gvanrossum py3k, patch python.org: outdated and false information 1 days http://bugs.python.org/issue1421 georg.brandl Writing to an invalid fd doesn't raise an exception 1 days http://bugs.python.org/issue1422 gvanrossum py3k py3k: readline and rlcompleter doesn't list choices 1 days http://bugs.python.org/issue1424 tiran py3k readline: no display matches hook set 0 days http://bugs.python.org/issue1425 loewis py3k readline module needs a review 1 days http://bugs.python.org/issue1426 tiran py3k Error in standard module calendar 0 days http://bugs.python.org/issue1427 doerwalter patch Update to property.__doc__ 0 days http://bugs.python.org/issue1428 tiran patch Installing on Vista asks to close Explorer (and Nokia PC Suite) 0 days http://bugs.python.org/issue1430 loewis marshal roundtripping for unicode 0 days http://bugs.python.org/issue1433 loewis Support for multiple handlers for the "with" statement 0 days http://bugs.python.org/issue1435 gvanrossum logging.config.fileConfig, NameError: name 'RotatingFileHandler' 0 days http://bugs.python.org/issue1436 vsajip List member inside a class is shared by all instances of the cla 0 days http://bugs.python.org/issue1437 tiran Intel icc build fails with optimizations -O2 227 days http://bugs.python.org/issue1689617 loewis interpreter crash when multiplying large lists 206 days http://bugs.python.org/issue1704621 gvanrossum patch Top Issues Most Discussed (10) ______________________________ 25 py3k: pythonw.exe fails because std streams a missing 4 days closed http://bugs.python.org/issue1415 21 py3k: duplicated line endings when using read(1) 9 days open http://bugs.python.org/issue1395 11 int literal methods inaccessible 0 days closed http://bugs.python.org/issue1413 8 Parsing a simple script eats all of your memory 67 days open http://bugs.python.org/issue1134 7 Unicode literals in tokenize.py and tests. 1 days closed http://bugs.python.org/issue1420 7 Fix for refleak tests 5 days open http://bugs.python.org/issue1414 7 urllib2 302 POST 7 days open http://bugs.python.org/issue1401 7 pdb bug with "with" statement 33 days closed http://bugs.python.org/issue1265 6 BaseHTTPServer cannot accept Unicode data 1 days closed http://bugs.python.org/issue1410 6 new keyword-only function parameters interact badly with nested 6 days open http://bugs.python.org/issue1409

1 0

Re: [Python-Dev] New python developer
by Raymond Hettinger 14 Nov '07

14 Nov '07

> As you may have seen, I have recently been granted developer > privileges on python svn. Hello Amaury. Welcome aboard. Raymond

1 0

Summary of Tracker Issues
by Tracker 13 Nov '07

13 Nov '07

ACTIVITY SUMMARY (11/06/07 - 11/13/07) Tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 1323 open (+17) / 11597 closed (+23) / 12920 total (+40) Open issues with patches: 418 Average duration of open issues: 689 days. Median duration of open issues: 795 days. Open Issues Breakdown open 1318 (+17) pending 5 ( +0) Issues Created Or Reopened (41) _______________________________ test_import breaks on Linux 11/09/07 http://bugs.python.org/issue1377 reopened gvanrossum py3k Can't pickle partial functions 11/07/07 CLOSED http://bugs.python.org/issue1398 created danhs XML codec 11/07/07 http://bugs.python.org/issue1399 created doerwalter patch Py3k's print() flushing problem 11/07/07 http://bugs.python.org/issue1400 created wojtekwalczak py3k urllib2 302 POST 11/07/07 http://bugs.python.org/issue1401 created andresriancho Interpreter cleanup: order of _PyGILState_Fini and PyInterpreter 11/07/07 http://bugs.python.org/issue1402 created ronaldoussoren py_compile and compileall need unit tests 11/08/07 http://bugs.python.org/issue1403 created tiran py3k warnings module bug: BytesWarning: str() on a bytes instance 11/08/07 CLOSED http://bugs.python.org/issue1404 created tiran patch Garbage collection not working correctly in Python 2.3 11/09/07 CLOSED http://bugs.python.org/issue1405 reopened tiran Use widechar api for os.environ 11/08/07 CLOSED http://bugs.python.org/issue1406 created theller py3k, patch [performance] Too many closed() checkings 11/08/07 http://bugs.python.org/issue1407 created wojtekwalczak py3k Inconsistence in multiply list 11/08/07 CLOSED http://bugs.python.org/issue1408 created beco new keyword-only function parameters interact badly with nested 11/08/07 http://bugs.python.org/issue1409 created _doublep py3k BaseHTTPServer cannot accept Unicode data 11/08/07 CLOSED http://bugs.python.org/issue1410 created isonno A typo in tutorial 11/09/07 CLOSED http://bugs.python.org/issue1411 created falsetru test_subprocess fails on SuSE 10 11/09/07 http://bugs.python.org/issue1412 created dvadasz int literal methods inaccessible 11/09/07 CLOSED http://bugs.python.org/issue1413 created mykhal Fix for refleak tests 11/09/07 http://bugs.python.org/issue1414 created tiran py3k, patch py3k: pythonw.exe fails because std streams a missing 11/10/07 CLOSED http://bugs.python.org/issue1415 created tiran py3k @prop.setter decorators 11/10/07 CLOSED http://bugs.python.org/issue1416 created gvanrossum patch Weakref not working properly 11/10/07 CLOSED http://bugs.python.org/issue1417 created MHOOO Python/hypot.c is never used 11/10/07 CLOSED http://bugs.python.org/issue1418 created marketdickinson ssl module version 1.10 causes TypeError when accepting connecti 11/11/07 CLOSED http://bugs.python.org/issue1419 created complex Unicode literals in tokenize.py and tests. 11/11/07 CLOSED http://bugs.python.org/issue1420 created ron_adam py3k, patch python.org: outdated and false information 11/11/07 CLOSED http://bugs.python.org/issue1421 created tiran Writing to an invalid fd doesn't raise an exception 11/11/07 CLOSED http://bugs.python.org/issue1422 created tiran py3k wave sunau aifc 16bit errors 11/11/07 http://bugs.python.org/issue1423 created jeroen py3k: readline and rlcompleter doesn't list choices 11/11/07 CLOSED http://bugs.python.org/issue1424 created tiran py3k readline: no display matches hook set 11/11/07 CLOSED http://bugs.python.org/issue1425 created tiran py3k readline module needs a review 11/11/07 CLOSED http://bugs.python.org/issue1426 created tiran py3k Error in standard module calendar 11/11/07 CLOSED http://bugs.python.org/issue1427 created gdamjan patch Update to property.__doc__ 11/11/07 CLOSED http://bugs.python.org/issue1428 created tiran patch FD leak in SocketServer 11/12/07 http://bugs.python.org/issue1429 created luke-jr Installing on Vista asks to close Explorer (and Nokia PC Suite) 11/12/07 CLOSED http://bugs.python.org/issue1430 created dabarlow pth files not loaded at startup 11/12/07 http://bugs.python.org/issue1431 created gbloisi patch Strange behavior of urlparse.urljoin 11/13/07 http://bugs.python.org/issue1432 created yan marshal roundtripping for unicode 11/13/07 http://bugs.python.org/issue1433 created cfbolz SocketServer creates non-blocking files 11/13/07 http://bugs.python.org/issue1434 created luke-jr Support for multiple handlers for the "with" statement 11/13/07 http://bugs.python.org/issue1435 created Stavros logging.config.fileConfig, NameError: name 'RotatingFileHandler' 11/13/07 http://bugs.python.org/issue1436 created sebastian List member inside a class is shared by all instances of the cla 11/13/07 CLOSED http://bugs.python.org/issue1437 created glubglub Issues Now Closed (41) ______________________ test_glob fails with UnicodeDecodeError 72 days http://bugs.python.org/issue1042 tiran rfe py3k: corrections for test_subprocess on windows 72 days http://bugs.python.org/issue1047 tiran patch file.seek allows float arguments 68 days http://bugs.python.org/issue1081 tiran py3k test_email failed 67 days http://bugs.python.org/issue1086 tiran rfe py3k os.popen result is not iterable, patch attached 67 days http://bugs.python.org/issue1087 tiran patch Problems with the msi installer - python-3.0a1.msi 64 days http://bugs.python.org/issue1110 tiran No tests for inspect.getfullargspec() 63 days http://bugs.python.org/issue1127 tiran py3k, patch test_urllib2net fails on test_ftp 57 days http://bugs.python.org/issue1157 tiran py3k Should itertools.count work for arbitrary integers? 53 days http://bugs.python.org/issue1165 rhettinger py3k pdb fails to launch some script. 33 days http://bugs.python.org/issue1254 tiran pdb bug with "with" statement 33 days http://bugs.python.org/issue1265 amaury.forgeotdarc py3k Trailing slash in sys.path cause import failure 20 days http://bugs.python.org/issue1293 gvanrossum patch Add getsize() to io instances 13 days http://bugs.python.org/issue1351 loewis py3k, patch py3k-pep3137: patch for mailbox 0 days http://bugs.python.org/issue1396 gvanrossum py3k, patch Can't pickle partial functions 1 days http://bugs.python.org/issue1398 tiran warnings module bug: BytesWarning: str() on a bytes instance 0 days http://bugs.python.org/issue1404 tiran patch Garbage collection not working correctly in Python 2.3 1 days http://bugs.python.org/issue1405 gvanrossum Use widechar api for os.environ 0 days http://bugs.python.org/issue1406 theller py3k, patch Inconsistence in multiply list 1 days http://bugs.python.org/issue1408 georg.brandl BaseHTTPServer cannot accept Unicode data 1 days http://bugs.python.org/issue1410 tiran A typo in tutorial 0 days http://bugs.python.org/issue1411 georg.brandl int literal methods inaccessible 0 days http://bugs.python.org/issue1413 loewis py3k: pythonw.exe fails because std streams a missing 4 days http://bugs.python.org/issue1415 amaury.forgeotdarc py3k @prop.setter decorators 1 days http://bugs.python.org/issue1416 gvanrossum patch Weakref not working properly 1 days http://bugs.python.org/issue1417 MHOOO Python/hypot.c is never used 2 days http://bugs.python.org/issue1418 loewis ssl module version 1.10 causes TypeError when accepting connecti 3 days http://bugs.python.org/issue1419 janssen Unicode literals in tokenize.py and tests. 1 days http://bugs.python.org/issue1420 gvanrossum py3k, patch python.org: outdated and false information 1 days http://bugs.python.org/issue1421 georg.brandl Writing to an invalid fd doesn't raise an exception 1 days http://bugs.python.org/issue1422 gvanrossum py3k py3k: readline and rlcompleter doesn't list choices 1 days http://bugs.python.org/issue1424 tiran py3k readline: no display matches hook set 0 days http://bugs.python.org/issue1425 loewis py3k readline module needs a review 1 days http://bugs.python.org/issue1426 tiran py3k Error in standard module calendar 0 days http://bugs.python.org/issue1427 doerwalter patch Update to property.__doc__ 0 days http://bugs.python.org/issue1428 tiran patch Installing on Vista asks to close Explorer (and Nokia PC Suite) 0 days http://bugs.python.org/issue1430 loewis List member inside a class is shared by all instances of the cla 0 days http://bugs.python.org/issue1437 tiran Error on handling nan 1637 days http://bugs.python.org/issue737648 mike.verdone Intel icc build fails with optimizations -O2 227 days http://bugs.python.org/issue1689617 loewis interpreter crash when multiplying large lists 206 days http://bugs.python.org/issue1704621 gvanrossum patch contextmanager eats StopIteration 199 days http://bugs.python.org/issue1705170 ncoghlan Top Issues Most Discussed (10) ______________________________ 29 py3k: duplicated line endings when using read(1) 8 days open http://bugs.python.org/issue1395 25 py3k: pythonw.exe fails because std streams a missing 4 days closed http://bugs.python.org/issue1415 11 int literal methods inaccessible 0 days closed http://bugs.python.org/issue1413 9 toxml generates output that is not well formed 9 days open http://bugs.python.org/issue1390 9 Trailing slash in sys.path cause import failure 20 days closed http://bugs.python.org/issue1293 7 Unicode literals in tokenize.py and tests. 1 days closed http://bugs.python.org/issue1420 7 Fix for refleak tests 4 days open http://bugs.python.org/issue1414 7 urllib2 302 POST 6 days open http://bugs.python.org/issue1401 7 pdb bug with "with" statement 33 days closed http://bugs.python.org/issue1265 6 BaseHTTPServer cannot accept Unicode data 1 days closed http://bugs.python.org/issue1410

1 0

XML codec?
by Walter Dörwald 13 Nov '07

13 Nov '07

I have a patch ready (http://bugs.python.org/issue1399) that adds an XML codec. This codec implements encoding detection as specified in http://www.w3.org/TR/2004/REC-xml-20040204/#sec-guessing and could be used for the decoding phase of an XML parser. Other use cases are: The codec could be used for transcoding an XML input before passing it to the real parser, if the parser itself doesn't support the encoding in question. A text editor could use the codec to decode an XML file. When the user changes the XML declaration and resaves the file, it would be saved in the correct encoding. I'd like to have this codec in 2.6 and 3.0. Any comments? Servus, Walter

8 49

Fwd: volunteers for a test
by Guido van Rossum 12 Nov '07

12 Nov '07

Please indulge this off-topic post. I know there are a lot of Python developers here whose mother tongue is not English; would those folks mind participating in the experiment below? --Guido ---------- Forwarded message ---------- From: Jose Oriol Lopez Berengueres <jose.oriol.lopez.berengueres(a)cern.ch> Date: Nov 12, 2007 12:22 PM Subject: volunteers for a test To: guido(a)python.org Dear Mr. Guido, A coleague and me at CERN are trying to measure the productivity differential of mothertonge and non-mothertonge programming... it just takes arround 3 minutes and we are looking. for all kinds of expert and non expert people... I was wondering since you are so famous if you know anybody willing to volunteer? http://cern.ch/test-volunteers Thanks a lot. J. oriol -- --Guido van Rossum (home page: http://www.python.org/~guido/)

1 0

Proposal for new 2to23 tool
by Graham Horler 12 Nov '07

12 Nov '07

I have been developing in Python since 1.5, and now have to support 2.1 as a minimum version. I do like to keep my code runnable on newer versions however, and am considering the feasability of forward compatibility with Python 3.0. I also notice the Leo[1] project could use some assistance with forward compatibility. So I was wondering if anyone else had a need for a 2to23.py tool to help make code compatible with 3.0 but not break it for 2.x. Such a tool could also include implementations of new builtins added in python 3.0, or work in tandem with a "py3to2" library. One such function would be "print" (which would have to be renamed to e.g. "prints" as "def print()" is a syntax error in 2.x). This would have the added benefit of staunching the flow of wasted effort into many differing implementations of such things, and maybe direct some of it into development of this tool. Hope this is on topic, and has not already been considered and dismissed. Thanks, Graham [1] http://webpages.charter.net/edreamleo/front.html P.S. a suggested prints() implementation for py3to2.py, including raising a TypeError exception for extra keyword args, and returning None. It works in python 2.1 through to python 3.0a1. def prints(*args, **kw): kw.setdefault('sep', ' ') kw.setdefault('end', '\n') kw.setdefault('file', sys.stdout) if len(kw) > 3: for k in ('sep', 'end', 'file'): del kw[k] if len(kw) > 1: raise TypeError(', '.join(map(repr, kw.keys())) + ' are invalid keyword arguments for this function') else: raise TypeError('%r is an invalid keyword argument for this function' % list(kw.keys())[0]) kw['file'].write(kw['sep'].join(['%s' % a for a in args]) + kw['end'])

6 7

Summary of Tracker Issues
by Tracker 12 Nov '07

12 Nov '07

ACTIVITY SUMMARY (11/05/07 - 11/12/07) Tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 1321 open (+17) / 11592 closed (+21) / 12913 total (+38) Open issues with patches: 418 Average duration of open issues: 689 days. Median duration of open issues: 791 days. Open Issues Breakdown open 1316 (+17) pending 5 ( +0) Issues Created Or Reopened (39) _______________________________ test_import breaks on Linux 11/09/07 http://bugs.python.org/issue1377 reopened gvanrossum py3k function comparing lacks NotImplemented error 11/05/07 http://bugs.python.org/issue1393 created _doublep simple patch, improving unreachable bytecode removing 11/05/07 http://bugs.python.org/issue1394 created _doublep patch py3k: duplicated line endings when using read(1) 11/06/07 http://bugs.python.org/issue1395 created amaury.forgeotdarc py3k py3k-pep3137: patch for mailbox 11/06/07 CLOSED http://bugs.python.org/issue1396 created tiran py3k, patch py3k-pep3137: failing unit test test_bsddb 11/06/07 http://bugs.python.org/issue1397 created tiran py3k Can't pickle partial functions 11/07/07 CLOSED http://bugs.python.org/issue1398 created danhs XML codec 11/07/07 http://bugs.python.org/issue1399 created doerwalter patch Py3k's print() flushing problem 11/07/07 http://bugs.python.org/issue1400 created wojtekwalczak py3k urllib2 302 POST 11/07/07 http://bugs.python.org/issue1401 created andresriancho Interpreter cleanup: order of _PyGILState_Fini and PyInterpreter 11/07/07 http://bugs.python.org/issue1402 created ronaldoussoren py_compile and compileall need unit tests 11/08/07 http://bugs.python.org/issue1403 created tiran py3k warnings module bug: BytesWarning: str() on a bytes instance 11/08/07 CLOSED http://bugs.python.org/issue1404 created tiran patch Garbage collection not working correctly in Python 2.3 11/09/07 CLOSED http://bugs.python.org/issue1405 reopened tiran Use widechar api for os.environ 11/08/07 CLOSED http://bugs.python.org/issue1406 created theller py3k, patch [performance] Too many closed() checkings 11/08/07 http://bugs.python.org/issue1407 created wojtekwalczak py3k Inconsistence in multiply list 11/08/07 CLOSED http://bugs.python.org/issue1408 created beco new keyword-only function parameters interact badly with nested 11/08/07 http://bugs.python.org/issue1409 created _doublep py3k BaseHTTPServer cannot accept Unicode data 11/08/07 CLOSED http://bugs.python.org/issue1410 created isonno A typo in tutorial 11/09/07 CLOSED http://bugs.python.org/issue1411 created falsetru test_subprocess fails on SuSE 10 11/09/07 http://bugs.python.org/issue1412 created dvadasz int literal methods inaccessible 11/09/07 CLOSED http://bugs.python.org/issue1413 created mykhal Fix for refleak tests 11/09/07 http://bugs.python.org/issue1414 created tiran py3k, patch py3k: pythonw.exe fails because std streams a missing 11/10/07 http://bugs.python.org/issue1415 created tiran py3k @prop.setter decorators 11/10/07 CLOSED http://bugs.python.org/issue1416 created gvanrossum patch Weakref not working properly 11/10/07 CLOSED http://bugs.python.org/issue1417 created MHOOO Python/hypot.c is never used 11/10/07 CLOSED http://bugs.python.org/issue1418 created marketdickinson ssl module version 1.10 causes TypeError when accepting connecti 11/11/07 CLOSED http://bugs.python.org/issue1419 created complex Unicode literals in tokenize.py and tests. 11/11/07 CLOSED http://bugs.python.org/issue1420 created ron_adam py3k, patch python.org: outdated and false information 11/11/07 CLOSED http://bugs.python.org/issue1421 created tiran Writing to an invalid fd doesn't raise an exception 11/11/07 CLOSED http://bugs.python.org/issue1422 created tiran py3k wave sunau aifc 16bit errors 11/11/07 http://bugs.python.org/issue1423 created jeroen py3k: readline and rlcompleter doesn't list choices 11/11/07 CLOSED http://bugs.python.org/issue1424 created tiran py3k readline: no display matches hook set 11/11/07 CLOSED http://bugs.python.org/issue1425 created tiran py3k readline module needs a review 11/11/07 http://bugs.python.org/issue1426 created tiran py3k Error in standard module calendar 11/11/07 CLOSED http://bugs.python.org/issue1427 created gdamjan patch Update to property.__doc__ 11/11/07 CLOSED http://bugs.python.org/issue1428 created tiran patch FD leak in SocketServer 11/12/07 http://bugs.python.org/issue1429 created luke-jr Installing on Vista asks to close Explorer (and Nokia PC Suite) 11/12/07 CLOSED http://bugs.python.org/issue1430 created dabarlow Issues Now Closed (41) ______________________ test_glob fails with UnicodeDecodeError 72 days http://bugs.python.org/issue1042 tiran rfe py3k: corrections for test_subprocess on windows 72 days http://bugs.python.org/issue1047 tiran patch file.seek allows float arguments 68 days http://bugs.python.org/issue1081 tiran py3k test_email failed 67 days http://bugs.python.org/issue1086 tiran rfe py3k os.popen result is not iterable, patch attached 67 days http://bugs.python.org/issue1087 tiran patch Problems with the msi installer - python-3.0a1.msi 64 days http://bugs.python.org/issue1110 tiran No tests for inspect.getfullargspec() 63 days http://bugs.python.org/issue1127 tiran py3k, patch test_urllib2net fails on test_ftp 57 days http://bugs.python.org/issue1157 tiran py3k Should itertools.count work for arbitrary integers? 53 days http://bugs.python.org/issue1165 rhettinger py3k pdb fails to launch some script. 33 days http://bugs.python.org/issue1254 tiran Trailing slash in sys.path cause import failure 20 days http://bugs.python.org/issue1293 gvanrossum patch Fix for test_netrc on Windows 9 days http://bugs.python.org/issue1345 tiran py3k, patch Add getsize() to io instances 13 days http://bugs.python.org/issue1351 loewis py3k, patch Windows fix for inspect tests 2 days http://bugs.python.org/issue1384 tiran py3k, patch hmac module violates RFC for some hash functions, e.g. sha512 2 days http://bugs.python.org/issue1385 jowagner py3k py3k-pep3137: struct module is leaking references 1 days http://bugs.python.org/issue1389 gvanrossum py3k py3k-pep3137: issue warnings / errors on str(bytes()) and simila 1 days http://bugs.python.org/issue1392 tiran py3k, patch py3k-pep3137: patch for mailbox 0 days http://bugs.python.org/issue1396 gvanrossum py3k, patch Can't pickle partial functions 1 days http://bugs.python.org/issue1398 tiran warnings module bug: BytesWarning: str() on a bytes instance 0 days http://bugs.python.org/issue1404 tiran patch Garbage collection not working correctly in Python 2.3 1 days http://bugs.python.org/issue1405 gvanrossum Use widechar api for os.environ 0 days http://bugs.python.org/issue1406 theller py3k, patch Inconsistence in multiply list 1 days http://bugs.python.org/issue1408 georg.brandl BaseHTTPServer cannot accept Unicode data 1 days http://bugs.python.org/issue1410 tiran A typo in tutorial 0 days http://bugs.python.org/issue1411 georg.brandl int literal methods inaccessible 0 days http://bugs.python.org/issue1413 loewis @prop.setter decorators 1 days http://bugs.python.org/issue1416 gvanrossum patch Weakref not working properly 1 days http://bugs.python.org/issue1417 MHOOO Python/hypot.c is never used 2 days http://bugs.python.org/issue1418 loewis ssl module version 1.10 causes TypeError when accepting connecti 2 days http://bugs.python.org/issue1419 gvanrossum Unicode literals in tokenize.py and tests. 1 days http://bugs.python.org/issue1420 gvanrossum py3k, patch python.org: outdated and false information 1 days http://bugs.python.org/issue1421 georg.brandl Writing to an invalid fd doesn't raise an exception 1 days http://bugs.python.org/issue1422 gvanrossum py3k py3k: readline and rlcompleter doesn't list choices 1 days http://bugs.python.org/issue1424 tiran py3k readline: no display matches hook set 0 days http://bugs.python.org/issue1425 loewis py3k Error in standard module calendar 0 days http://bugs.python.org/issue1427 doerwalter patch Update to property.__doc__ 0 days http://bugs.python.org/issue1428 tiran patch Installing on Vista asks to close Explorer (and Nokia PC Suite) 0 days http://bugs.python.org/issue1430 loewis Error on handling nan 1637 days http://bugs.python.org/issue737648 mike.verdone Intel icc build fails with optimizations -O2 227 days http://bugs.python.org/issue1689617 loewis contextmanager eats StopIteration 199 days http://bugs.python.org/issue1705170 ncoghlan Top Issues Most Discussed (10) ______________________________ 36 py3k: duplicated line endings when using read(1) 7 days open http://bugs.python.org/issue1395 12 toxml generates output that is not well formed 8 days open http://bugs.python.org/issue1390 11 py3k: pythonw.exe fails because std streams a missing 3 days open http://bugs.python.org/issue1415 11 int literal methods inaccessible 0 days closed http://bugs.python.org/issue1413 9 py3k-pep3137: issue warnings / errors on str(bytes()) and simil 1 days closed http://bugs.python.org/issue1392 9 Trailing slash in sys.path cause import failure 20 days closed http://bugs.python.org/issue1293 7 Unicode literals in tokenize.py and tests. 1 days closed http://bugs.python.org/issue1420 7 urllib2 302 POST 5 days open http://bugs.python.org/issue1401 6 BaseHTTPServer cannot accept Unicode data 1 days closed http://bugs.python.org/issue1410 6 new keyword-only function parameters interact badly with nested 4 days open http://bugs.python.org/issue1409

1 0