Mailman 3 October 2008 - Python-Dev

Suspect intermittent failure in buildbots
by Amaury Forgeot d'Arc Oct. 3, 2008

Oct. 3, 2008

I've noticed an error that comes up from time to time in python 3.0 buildbots. The error is always similar to this one: Traceback (most recent call last): File "E:\cygwin\home\db3l\buildarea\3.0.bolen-windows\build\lib\test\test_io.py", line 900, in testBasicIO self.assertEquals(f.write("abc"), 3) File "E:\cygwin\home\db3l\buildarea\3.0.bolen-windows\build\lib\io.py", line 1486, in write b = encoder.encode(s) File "E:\cygwin\home\db3l\buildarea\3.0.bolen-windows\build\lib\encodings\ascii.py", line 22, in encode return codecs.ascii_encode(input, self.errors)[0] AttributeError: 'NoneType' object has no attribute 'ascii_encode' The most recent is here: http://www.python.org/dev/buildbot/3.0/AMD64%20W2k8%203.0/builds/843/step-t… but this already happened on various buildbots: http://www.google.fr/search?q=%27NoneType%27+object+has+no+attribute+encode… "x86 XP-4 3.0", "amd64 gentoo 3.0", "AMD64 W2k8 3.0", "x86 W2k8 3.0", "g4 osx.4 3.0", "OS X x86 3.0" "x86 XP-3 trunk" yes, even on trunk! Every time, a "codecs" global module variable has been reset to None, either in a codec module (encoding/ascii.py, encoding/mac_roman.py) or in test_io.py. Every time, io.py is not far (which may be normal, it must have the larger usage of encodings written in a .py) I know that modules globals are reset to None on interpreter shutdown, but it does not seem to be the case here: the unit test fail, and fails again when run in verbose mode at the end. I checked that the "codecs" name is a module global: the disassembler shows a LOAD_GLOBAL opcode followed by LOAD_ATTR: 0 LOAD_GLOBAL 0 (codecs) 3 LOAD_ATTR 1 (ascii_decode) ... I fail to imagine a reason, apart from a creeping memory error (in dictionary lookup; chilling idea). Thoughts? -- Amaury Forgeot d'Arc

2 1

Re: [Python-Dev] if-syntax for regular for-loops
by Leif Walsh Oct. 3, 2008

Oct. 3, 2008

On Fri, Oct 3, 2008 at 12:33 PM, Andreas Nilsson <adde(a)trialcode.com> wrote: > Thanks for the pointer! > I don't buy the argument that newlines automagically improves readability > though. You also get increased nesting suggesting something interesting is > happening where it isn't and that hurts readability. > And as Vitor said, all other constructions of the form 'for i in items' can > have if-conditions attached to them, it's really not that far-fetched to > assume that the loop behaves the same way. Consistency good, surprises bad. Yeah, I know what you mean, and I kind of liked the idea of adding the if statement to the for loop (for consistency, if nothing else), but it's been discussed before, and plenty of people have made the same argument. Probably not worth it. -- Cheers, Leif

1 0

Summary of Python tracker Issues
by Python tracker Oct. 3, 2008

Oct. 3, 2008

ACTIVITY SUMMARY (09/26/08 - 10/03/08) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 2074 open (+39) / 13779 closed (+16) / 15853 total (+55) Open issues with patches: 678 Average duration of open issues: 712 days. Median duration of open issues: 1835 days. Open Issues Breakdown open 2058 (+38) pending 16 ( +1) Issues Created Or Reopened (56) _______________________________ pprint._safe_repr is not general enough in one instance 09/26/08 http://bugs.python.org/issue3976 created erickt Check PyInt_AsSsize_t/PyLong_AsSsize_t error 09/26/08 CLOSED http://bugs.python.org/issue3977 created haypo patch ZipFileExt.read() can be incredibly slow 09/26/08 http://bugs.python.org/issue3978 created lightstruk patch Doctest failing when it should pass 09/26/08 CLOSED http://bugs.python.org/issue3979 created pupeno win32file.GetCommState incorrect handling of DCB 09/26/08 CLOSED http://bugs.python.org/issue3980 created jiaailun Python 3, IDLE does not start 09/27/08 CLOSED http://bugs.python.org/issue3981 created dah support .format for bytes 09/27/08 http://bugs.python.org/issue3982 created benjamin.peterson Typos in Documentation 09/28/08 CLOSED http://bugs.python.org/issue3983 created Bk python interpreter import dependency with disutils/util 09/28/08 http://bugs.python.org/issue3984 created tarek patch removed string module from distutils [patch] 09/28/08 http://bugs.python.org/issue3985 created tarek patch removed string and type usage from distutils.cmd [patch] 09/28/08 http://bugs.python.org/issue3986 created tarek patch removed types from distutils.core [patch] 09/28/08 http://bugs.python.org/issue3987 created tarek patch Byte warning mode and b'' != '' 09/28/08 http://bugs.python.org/issue3988 created christian.heimes patch Tools\Scripts\2to3.py broken under 3.0 rc1 Windows 09/28/08 CLOSED http://bugs.python.org/issue3989 created arnaud.faucher The Linux2 platform definition is incorrect for alpha, hppa, mip 09/28/08 http://bugs.python.org/issue3990 created ths patch urllib.request.urlopen does not handle non-ASCII characters 09/28/08 http://bugs.python.org/issue3991 created a.badger removed custom log from distutils 09/28/08 http://bugs.python.org/issue3992 created tarek patch Convert documentation to python 3. 09/29/08 CLOSED http://bugs.python.org/issue3993 created LambertDW import fixer misses some symbols 09/29/08 http://bugs.python.org/issue3994 created mhammond iso-xxx/cp1252 inconsistencies in Python 2.* not in 3.* 09/29/08 CLOSED http://bugs.python.org/issue3995 created jmfauth PyOS_CheckStack does not work 09/29/08 http://bugs.python.org/issue3996 created amaury.forgeotdarc patch zipfile and winzip 09/29/08 http://bugs.python.org/issue3997 created vgeorge List.sort docstring has obsolete cmp reference. 09/29/08 CLOSED http://bugs.python.org/issue3998 created tjreedy easy Real segmentation fault handler 09/30/08 http://bugs.python.org/issue3999 created haypo patch Additional 2to3 documentation updates 09/30/08 http://bugs.python.org/issue4000 created LambertDW 2to3 does relative import for modules not in a package. 09/30/08 CLOSED http://bugs.python.org/issue4001 created mhammond patch A Bug in the Documentation 09/30/08 CLOSED http://bugs.python.org/issue4002 created fretai Reference leak in test_cprofile 09/30/08 CLOSED http://bugs.python.org/issue4003 created amaury.forgeotdarc patch, needs review missing newline in "Could not convert argument %s to string" err 09/30/08 http://bugs.python.org/issue4004 created haypo patch pydoc in web server mode tails at initial request 10/01/08 http://bugs.python.org/issue4005 created prologic patch, needs review os.getenv silently discards env variables with non-UTF-8 values 10/01/08 http://bugs.python.org/issue4006 created a.badger make clean fails to delete .a and .so.X.Y files 10/01/08 http://bugs.python.org/issue4007 created skip.montanaro patch, easy IDLE: checksyntax() doesn't support Unicode? 10/01/08 http://bugs.python.org/issue4008 created haypo patch A Minor Glitch in the Documentation 10/01/08 CLOSED http://bugs.python.org/issue4009 created fretai configure options don't trickle down to distutils 10/01/08 http://bugs.python.org/issue4010 created skip.montanaro patch, easy Create DAG for PEP 101 10/01/08 http://bugs.python.org/issue4011 created brett.cannon Minor errors in multiprocessing docs 10/02/08 http://bugs.python.org/issue4012 created kjohnson Python 2.6 Doc/tools folder bigger than in 2.6rc2 10/02/08 http://bugs.python.org/issue4013 created koen Python-2.6-py2.6.egg-info contains Alpha reference 10/02/08 http://bugs.python.org/issue4014 created koen [patch] make installed scripts executable on windows 10/02/08 http://bugs.python.org/issue4015 created techtonik patch improve linecache: reuse tokenize.detect_encoding() and io.open( 10/02/08 http://bugs.python.org/issue4016 created haypo patch IDLE 2.6 broken on OSX (Leopard) 10/02/08 http://bugs.python.org/issue4017 created fzero "for me" installer problem on x64 Vista 10/02/08 http://bugs.python.org/issue4018 created jpe 2.6 (final) uses old icons in Start Menu 10/02/08 CLOSED http://bugs.python.org/issue4019 created craigneuro hasattr boundary case failure 10/02/08 CLOSED http://bugs.python.org/issue4020 created Xore tokenize.detect_encoding(): raise SyntaxError on codecs.lookup() 10/02/08 http://bugs.python.org/issue4021 created haypo patch, patch, needs review 2.6 dependent on c:\python26\ on windows 10/02/08 http://bugs.python.org/issue4022 created armandorowe convert os.getcwdu() to os.getcwd(), and getcwdu() to getcwd() 10/02/08 http://bugs.python.org/issue4023 created haypo patch float(0.0) singleton 10/03/08 http://bugs.python.org/issue4024 created ldeller patch C99 comments in Python 2.6 break build on AIX 6.1 10/03/08 http://bugs.python.org/issue4025 created drj fcntl extension fails to build on AIX 6.1 10/03/08 http://bugs.python.org/issue4026 created drj wrong page index number in reference book of python documentatio 10/03/08 http://bugs.python.org/issue4027 created ray Problem compiling the multiprocessing module on sunos5 10/03/08 http://bugs.python.org/issue4028 created jr244 Documentation displays incorrectly in iexplore. 10/03/08 http://bugs.python.org/issue4029 created LambertDW msi installer does not requires UAC permission on Vista 10/03/08 CLOSED http://bugs.python.org/issue4030 created willwill Fix for bugs relating to ntpath.expanduser() 10/02/08 http://bugs.python.org/issue957650 reopened christian.heimes patch Issues Now Closed (38) ______________________ Line numbers reported by extract_stack are offset by the #-*- en 138 days http://bugs.python.org/issue2832 benjamin.peterson Release notes for 2.6b2 call it an alpha release 61 days http://bugs.python.org/issue3457 akuchling Site-specific configuration hook documentation incorrect 52 days http://bugs.python.org/issue3510 akuchling Ctypes is confused by bitfields of varying integer types 48 days http://bugs.python.org/issue3547 theller patch, needs review super is a built-in type 33 days http://bugs.python.org/issue3736 rhettinger "make check" suggest a testing target under GNU coding standards 31 days http://bugs.python.org/issue3758 ralph.corderoy patch Integer overflow in _hashopenssl.c (CVE-2008-2316) 9 days http://bugs.python.org/issue3886 benjamin.peterson patch, patch, 64bit imageop issue 12 days http://bugs.python.org/issue3894 benjamin.peterson 2.6 regression in socket.ssl method 10 days http://bugs.python.org/issue3910 janssen patch ftplib.FTP.makeport() bug 8 days http://bugs.python.org/issue3911 benjamin.peterson patch Patch to implement a real ftplib test suite 6 days http://bugs.python.org/issue3939 benjamin.peterson patch Help in IDLE should open the chm file 6 days http://bugs.python.org/issue3941 georg.brandl PyObject_CheckReadBuffer crashes on memoryview object 3 days http://bugs.python.org/issue3946 benjamin.peterson patch, needs review Disable Py_USING_MEMORY_DEBUGGER! 7 days http://bugs.python.org/issue3951 haypo patch turtle.py - bug in Screen.__init__() 5 days http://bugs.python.org/issue3956 loewis patch Section permalink html anchors are wrong 3 days http://bugs.python.org/issue3960 georg.brandl bytearray().count() 1 days http://bugs.python.org/issue3967 amaury.forgeotdarc patch, needs review s_push: parser stack overflow MemoryError 1 days http://bugs.python.org/issue3971 benjamin.peterson collections.namedtuple uses exec to create new classes 5 days http://bugs.python.org/issue3974 rhettinger patch Check PyInt_AsSsize_t/PyLong_AsSsize_t error 3 days http://bugs.python.org/issue3977 benjamin.peterson patch Doctest failing when it should pass 0 days http://bugs.python.org/issue3979 georg.brandl win32file.GetCommState incorrect handling of DCB 0 days http://bugs.python.org/issue3980 loewis Python 3, IDLE does not start 1 days http://bugs.python.org/issue3981 dah Typos in Documentation 0 days http://bugs.python.org/issue3983 georg.brandl Tools\Scripts\2to3.py broken under 3.0 rc1 Windows 3 days http://bugs.python.org/issue3989 loewis Convert documentation to python 3. 0 days http://bugs.python.org/issue3993 georg.brandl iso-xxx/cp1252 inconsistencies in Python 2.* not in 3.* 2 days http://bugs.python.org/issue3995 rpetrov List.sort docstring has obsolete cmp reference. 0 days http://bugs.python.org/issue3998 benjamin.peterson easy 2to3 does relative import for modules not in a package. 0 days http://bugs.python.org/issue4001 benjamin.peterson patch A Bug in the Documentation 0 days http://bugs.python.org/issue4002 georg.brandl Reference leak in test_cprofile 0 days http://bugs.python.org/issue4003 brett.cannon patch, needs review A Minor Glitch in the Documentation 0 days http://bugs.python.org/issue4009 georg.brandl 2.6 (final) uses old icons in Start Menu 1 days http://bugs.python.org/issue4019 loewis hasattr boundary case failure 0 days http://bugs.python.org/issue4020 benjamin.peterson msi installer does not requires UAC permission on Vista 0 days http://bugs.python.org/issue4030 loewis Traceback error when compiling Regex 921 days http://bugs.python.org/issue1456280 timehorse Use flush() before os.exevp() 711 days http://bugs.python.org/issue1579477 akuchling asyncore/asynchat patches 476 days http://bugs.python.org/issue1736190 giampaolo.rodola patch Top Issues Most Discussed (10) ______________________________ 27 os.listdir can return byte strings 101 days open http://bugs.python.org/issue3187 18 test_multiprocessing fails on systems with HAVE_SEM_OPEN=0 30 days open http://bugs.python.org/issue3770 12 "for me" installer problem on x64 Vista 1 days open http://bugs.python.org/issue4018 10 Regexp 2.7 (modifications to current re 2.2.2) 171 days open http://bugs.python.org/issue2636 9 Byte warning mode and b'' != '' 5 days open http://bugs.python.org/issue3988 9 support .format for bytes 6 days open http://bugs.python.org/issue3982 8 configure --with-threads on cygwin => crash on thread related t 10 days open http://bugs.python.org/issue3947 8 Multi-process 2to3 70 days open http://bugs.python.org/issue3448 7 Minor errors in multiprocessing docs 2 days open http://bugs.python.org/issue4012 7 configure options don't trickle down to distutils 2 days open http://bugs.python.org/issue4010

1 0

if-syntax for regular for-loops
by Andreas Nilsson Oct. 3, 2008

Oct. 3, 2008

Hi. First post so here it goes. My name is Adde, and I'm a Swedish software developer. I've been programming for about 23 years now since starting with Basic on the C64. I've been through most well known and a couple of lesser known languages in search of the perfect one. At the moment I'm writing a custom ctypes interface to the Firebird database (need access to advanced features, portability to Windows and I definitely don't enjoy setting up GCC on Windows). I've programmed a lot of C/C++ in my days so I thought I'd at least join the list and see if anything piques my interest enough to dive in. With that out of the way, on to todays subject: I use list comprehensions and generator expressions a lot and lately I've found myself writing a lot of code like this: for i in items if i.some_field == some_value: i.do_something() Naturally it won't work but it seems like a pretty straight-forward extension to allow compressing simple loops to fit on one line. The alternative, in my eyes, suggests there's something more happening than a simple include-test which makes it harder to comprehend. for i in items: if i.some_field == some_value: i.do_something() One possibility of course is to use a generator-expression but that makes it look like there are two for loops and it feels like a waste setting up a generator just for filtering. for i in (i for i in items if some_field == some_value): i.do_something() Stupid idea? Am I missing some obviously better way of achieving the same result? Thanks, Adde

3 2

c99 comments in the 2.6 code base?
by Fredrik Lundh Oct. 2, 2008

Oct. 2, 2008

http://drj11.wordpress.com/2008/10/02/python-and-bragging-about-c89/ mentions that Objects/frameobject.c contains a C99-style comment, which means that Python 2.6 won't build on AIX. shouldn't we use a suitable gcc option for the buildbots to prevent that from happening? </F>

5 7

2to3 bug fixes
by Benjamin Peterson Oct. 2, 2008

Oct. 2, 2008

What should the policy on 2to3 bug fixes be for the maintenance branch? I'm asking because I remember vaguely someone suggesting that new 2to3 fixers could fit into that category. So, should I only merge "pure" bug fixes, or do I get to stretch the definition a little? -- Cheers, Benjamin Peterson "There's no place like 127.0.0.1."

3 3

RELEASED Python 2.6 final
by Barry Warsaw Oct. 2, 2008

Oct. 2, 2008

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On behalf of the Python development team and the Python community, I am happy to announce the release of Python 2.6 final. This is the production-ready version of the latest in the Python 2 series. There are many new features and modules, improvements, bug fixes, and other changes in Python 2.6. Please see the "What's new" page for details http://docs.python.org/dev/whatsnew/2.6.html as well as PEP 361 http://www.python.org/dev/peps/pep-0361/ While Python 2.6 is backward compatible with earlier versions of Python, 2.6 has many tools and features that will help you migrate to Python 3. Wherever possible, Python 3.0 features have been added without affecting existing code. In other cases, the new features can be enabled through the use of __future__ imports and command line switches. Python 3.0 is currently in release candidate and will be available later this year. Both Python 2 and Python 3 will be supported for the foreseeable future. Source tarballs, Windows installers, and Mac disk images can be downloaded from the Python 2.6 page: http://www.python.org/download/releases/2.6/ (Please note that due to quirks in the earth's time zones, the Windows installers will be available shortly.) Bugs can be reported in the Python bug tracker: http://bugs.python.org Enjoy, - -Barry Barry Warsaw barry(a)python.org Python 2.6/3.0 Release Manager (on behalf of the entire python-dev team) -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) iQCVAwUBSOREJ3EjvBPtnXfVAQLAigP/aEnrdvAqk7wbNQLFbmBonIr2YQbd1vEu TyTr5imYXFWGNfv1/JMeMBjMfwpHi1bgPEDTLEZdhDRNj/G1h4NqqnpfJS0lfIaU 4JBKwnsO80se/RGyupcs5f09UdKxOljhbFKEw46CHDkd9lE+cqy2yhetEwyx3c3+ AVC11sjcO54= =Oxo3 -----END PGP SIGNATURE-----

6 7

python docs website not accessible!
by itconsense＠gmail.com Oct. 2, 2008

Oct. 2, 2008

Hi, I'm not sure, if this is the right place to post. The python-docs on www.python.org are not accessible. The overview http://docs.python.org/lib/lib.html works fine, but no link on the page i have tried works. http://docs.python.org/lib/doctest-unittest-api.html http://docs.python.org/lib/profile-instant.html Is python ceasing to be open source with 2.6? ;-) Thanks for caring, -Tom

2 1

self signing a py2exe winxp executable with signtool
by William Heath Oct. 1, 2008

Oct. 1, 2008

Hi All, I am trying to figure out how to self sign a py2exe winxp executable with signtool. Anyone know? I saw this which looked kind of promising: http://markmail.org/message/zj5nzechzgmjuu7c#query:signtool%20python+page:1… -Tim P.S. Python rocks!

2 1

Re: [Python-Dev] [Python-3000] New proposition for Python3 bytes filename issue
by Victor Stinner Oct. 1, 2008

Oct. 1, 2008

Le Monday 29 September 2008 18:45:28 Georg Brandl, vous avez écrit : > If I had to choose, I'd still argue for the modified UTF-8 as filesystem > encoding (if it were UTF-8 otherwise), despite possible surprises when a > such-encoded filename escapes from Python. If I understand correctly this solution. The idea is to change the default file system encoding, right? Eg. if your filesystem is UTF-8, use ISO-8859-1 to make sure that UTF-8 conversion will never fail. Let's try with an ugly directory on my UTF-8 file system: $ find . ./têste ./ô ./a?b ./dossié ./dossié/abc ./dir?name ./dir?name/xyz Python3 using encoding=ISO-8859-1: >>> import os; os.listdir(b'.') [b't\xc3\xaaste', b'\xc3\xb4', b'a\xffb', b'dossi\xc3\xa9', b'dir\xffname'] >>> files=os.listdir('.'); files ['tÃªste', 'Ã´', 'aÿb', 'dossiÃ©', 'dirÿname'] >>> open(files[0]).close() >>> os.listdir(files[-1]) ['xyz'] Ok, I have unicode filenames and I'm able to open a file and list a directory. The problem is now to display correctly the filenames. For me "unicode" sounds like "text (characters) encoded in the correct charset". In this case, unicode is just a storage for *bytes* in a custom charset. How can we mix <custom unicode (bytes encoded in ISO-8859-1)> with <real unicode>? Eg. os.path.join('dossiÃ©', "fichié") : first argument is encoded in ISO-8859-1 whereas the second argument is encoding in Unicode. It's something like that: str(b'dossi\xc3\xa9', 'ISO-8859-1') + '/' + 'fichi\xe9' Whereas the correct (unicode) result should be: 'dossié/fichié' as bytes in ISO-8859-1: b'dossi\xc3\xa9/fichi\xc3\xa9' as bytes in UTF-8: b'dossi\xe9/fichi\xe9' Change the default file system encoding to store bytes in Unicode is like introducing a new Python type: <fake Unicode for filename hacks>. -- Victor Stinner aka haypo http://www.haypocalc.com/blog/

11 26