Mailman 3 September 2012 - Python-Dev

Issue 15906; regression in argparse in Python 3.3, 3.2, and 2.7
by Barry Warsaw 11 Sep '12

11 Sep '12

Issue 15906 describes a problem with argparse that is breaking lots of code in Ubuntu. This is a recent regression caused by the fix for issue 12776, and it affects Python 2.7, 3.2, and 3.3. I posted a diff that should fix the problem, but at the heart of it is a semantic ambiguity in argparse that needs clarification. This needs to be cleared up before a proper patch can be applied. I have submitted a patch for what *I* think reasonable semantics should be, but let's see what you think. Issue 12776 tried to fix a problem illustrated by this example: -----snip snip----- import argparse parser = argparse.ArgumentParser() parser.add_argument('--file', type=open, default='/etc/passwd') args = parser.parse_args() print(args.file.read()) args = parser.parse_args(['--file', '/etc/group']) print(args.file.read()) -----snip snip----- What this code is (IMO, sensibly) trying to do is say that args.file will always be an open file, regardless of whether the path comes from the default value or is given on the command line. The problem is that this breaks some other, also sensible code: -----snip snip----- import argparse parser = argparse.ArgumentParser() parser.add_argument("--test", dest="test", type=str, default=[], action='append') args = parser.parse_args(['--test', 'bar']) args.test.append('baz') args = parser.parse_args() args.test.append('baz') -----snip snip----- This code is saying, I want to accumulate string arguments into a list, regardless of whether any arguments are given on the command line. The fix for issue 12776 broke the last two lines of the second example, because in the no-command-line-arguments-given case, arg.test is the *string* "[]" and not the actual empty list object. It seems to me that the semantics could reasonably be implied to mean that the type converter should only be applied to the default value when action='store', as is the default. Then in the second example, because action='append', the type conversion would not be applied (it makes no sense to do so). I have attached a diff to issue 15906 that implements these semantics. If you agree, then I will apply this to all of 3.3, 3.2, and 2.7, which are all affected by this bug (because the original fix for 12776 was applied to all three branches). Georg, I would like to apply this to the 3.3 branch. Cheers, -Barry

5 13

Re: [Python-Dev] [RELEASED] Python 3.3.0 release candidate 2
by Perica Zivkovic 11 Sep '12

11 Sep '12

Just a small note, MD5 for RC2 file python-3.3.0rc2.msi is not correct on http://python.org/download/releases/3.3.0/ it would be nice if someone can update it cheers, Perica On Sunday, September 9, 2012 4:25:39 AM UTC-5, Georg Brandl wrote: > -----BEGIN PGP SIGNED MESSAGE----- > > Hash: SHA1 > > > > On behalf of the Python development team, I'm delighted to announce the > > second release candidate of Python 3.3.0. > > > > This is a preview release, and its use is not recommended in > > production settings. > > > > Python 3.3 includes a range of improvements of the 3.x series, as well > > as easier porting between 2.x and 3.x. Major new features and changes > > in the 3.3 release series are: > > > > * PEP 380, syntax for delegating to a subgenerator ("yield from") > > * PEP 393, flexible string representation (doing away with the > > distinction between "wide" and "narrow" Unicode builds) > > * A C implementation of the "decimal" module, with up to 80x speedup > > for decimal-heavy applications > > * The import system (__import__) now based on importlib by default > > * The new "lzma" module with LZMA/XZ support > > * PEP 397, a Python launcher for Windows > > * PEP 405, virtual environment support in core > > * PEP 420, namespace package support > > * PEP 3151, reworking the OS and IO exception hierarchy > > * PEP 3155, qualified name for classes and functions > > * PEP 409, suppressing exception context > > * PEP 414, explicit Unicode literals to help with porting > > * PEP 418, extended platform-independent clocks in the "time" module > > * PEP 412, a new key-sharing dictionary implementation that > > significantly saves memory for object-oriented code > > * PEP 362, the function-signature object > > * The new "faulthandler" module that helps diagnosing crashes > > * The new "unittest.mock" module > > * The new "ipaddress" module > > * The "sys.implementation" attribute > > * A policy framework for the email package, with a provisional (see > > PEP 411) policy that adds much improved unicode support for email > > header parsing > > * A "collections.ChainMap" class for linking mappings to a single unit > > * Wrappers for many more POSIX functions in the "os" and "signal" > > modules, as well as other useful functions such as "sendfile()" > > * Hash randomization, introduced in earlier bugfix releases, is now > > switched on by default > > > > In total, almost 500 API items are new or improved in Python 3.3. > > For a more extensive list of changes in 3.3.0, see > > > > http://docs.python.org/3.3/whatsnew/3.3.html > > > > To download Python 3.3.0 visit: > > > > http://www.python.org/download/releases/3.3.0/ > > > > Please consider trying Python 3.3.0 with your code and reporting any bugs > > you may notice to: > > > > http://bugs.python.org/ > > > > > > Enjoy! > > > > - -- > > Georg Brandl, Release Manager > > georg at python.org > > (on behalf of the entire python-dev team and 3.3's contributors) > > -----BEGIN PGP SIGNATURE----- > > Version: GnuPG v2.0.19 (GNU/Linux) > > > > iEYEARECAAYFAlBMYJMACgkQN9GcIYhpnLCc5ACfcufn57tkNBPFU7qCpZ74GzjW > > msMAn3sIwWHLdqixypnnyMBOw1ijILjo > > =+e0e > > -----END PGP SIGNATURE-----

2 1

Snakebite v0.1: ready for beta testing.
by Trent Nelson 11 Sep '12

11 Sep '12

Quick start: % cd ~ && svn co http://svn.snakebite.net/.snakebite && cd .snakebite && sh snakebite.subr If all goes well, you should see something like this: A .snakebite/snakebite.subr A .snakebite/ssh_config_ext A .snakebite/ssh_known_hosts U .snakebite Checked out revision 58. Created link for 'sb'. Created link for 'sbx'. Created link for 'sby'. Created link for 'sbctl'. Fixed permissions for /Users/Trent/.snakebite/snakebite.subr. The following commands can now be executed directly: sb sbx sby sbctl Testing connection.........done. Getting a list of your projects...done. Looking up your username for project 'cpython'...done. Getting project details for 'trent.nelson@cpython'...done. Setting current project to 'cpython'...done. Trent, you're now configured for cpython. Enjoy! +---------------------------------------+ | Available Hosts | | (Last Update: 2012-09-11 11:08:01Z) | +---------------------------------------+ | Alias | OS | Arch | +-------|--------------------|----------+ | a7|AIX 7.1 | Power4 | | d3|DragonFlyBSD 3.0.2 | x64 | | d3x|DragonFlyBSD 3.0.2 | x86 | | h2|HP-UX 11iv2 | PA-RISC | | h3|HP-UX 11iv3 | Itanium2 | | i6|IRIX 6.5.30 | MIPS | | n51|NetBSD 5.1.2 | x64 | | n51x|NetBSD 5.1.2 | x86 | | o51x|OpenBSD 5.1 | x86 | | o51|OpenBSD 5.1 | x64 | | s10|Solaris 10 | SPARC | | s9|Solaris 9 | SPARC | +---------------------------------------+ Enter alias: Simply enter any of the aliases in the table and it'll ssh you into that box as cpython@, i.e.: Enter alias: a7 AIX arsenic 1 7 000BF95F4C00 :::. :::::::.. .::::::. .,:::::: :::. :::. ::: .,-::::: ;;`;; ;;;;``;;;; ;;;` ` ;;;;'''' `;;;;, `;;; ;;; ,;;;'````' ,[[ '[[, [[[,/[[[' '[==/[[[[, [[cccc [[[[[. '[[ [[[ [[[ c$$$cc$$$c $$$$$$c ''' $ $$"""" $$$ "Y$c$$ $$$ $$$ 888 888, 888b "88bo, 88b dP 888oo,__ 888 Y88 888 `88bo,__,o, YMM ""` MMMM "W" "YMmMY" """"YUMMM MMM YM MMM "YUMMMMMP" AIX 7.1 IBM IntelliStation 9114-275 2 x 1.4GHz Power4 CPUs 2 x 2Gbps LP9802 FC HBAs 8GB RAM, 4 x 36GB [cpython@arsenic]~% General notes: - Almost all of the hosts have a corresponding cpython build slave, which always lives in ~/buildslave. - You're more than welcome to set up local builds on each box. Keep everything in ~/hg. Some hosts already have a ~/hg dir, others don't. The layout should be: ~/hg/3.x ~/hg/3.2 ~/hg/2.7 If they don't exist, feel free to create them. It's going to be easiest to just clone the corresponding build directory from ~/buildslave, i.e. if you want a local 3.x area but no ~/hg/3.x exists: % cd ~/hg % hg clone ~/buildslave/3.x-*/build 3.x Once a base repo has been created, you can clone a local copy: hg clone 3.x 3.x.trent.issue2811 Try follow that naming convention as it'll make it easier for other developers to figure out what each directory is for. Also, try and keep tabs on local builds and remove things you don't need once you're done. I haven't finished hooking up the SAN yet so everything is on local disks at the moment; disk space is a bit light in some places. - If you're not used to vi shell key bindings, you're going to have a bad time :-) - Almost all of the hosts (except for the *BSDs) have been set up to use a common ~/.zsh and ~/.vim: http:/svn.snakebite.net/home/trunk/ http:/svn.snakebite.net/skel/trunk/ They're both based on random dotfile hacking I've done over the years and are far from elegant -- so, suggestions welcome. If I'm awake and working, I'll be on #python-dev, so that'll be the best place to get me if you need immediate assistance. So, log in and have a play around! Oh, X11 forwarding works, too, just invoke `sbx` (or `sby`) instead of `sb` and it'll invoke ssh with -X or -Y respectively. All the proprietary UNIX hosts have X11 installed, complete with glorious circa-late-nineties Motif eye candy. For those looking for tangible things to do... take a look at the current buildslaves with [SB] in the name -- almost all of them are failing in some way/shape/form, so there's plenty of stuff to get your teeth stuck into :-) Trent.

3 5

creating Lib/tests/cmath_testcases.txt for 64 bit complex numbers (text)
by Matti Picus 10 Sep '12

10 Sep '12

(I apologize for posting HTML mail. Retrying.) Hi. I am implementing complex numbers for pypy's version of numpy. Numpy has both 128 bit (based on 64 bit floats) and 64 bit (based on 32 bit floats) complex numbers, where afaict cmath uses strictly 128 bit complex numbers. I made sure the 128 bit numpy complex numbers in pypy pass the tests in Lib/tests/cmath_testcases.txt. I would like to generate a similar file to cmath_testcases.txt for 64 bit complex numbers. I found the earliest commit of the file at http://hg.python.org/cpython/file/b69f443ef480/Lib/test/cmath_testcases.txt Can the authors of the original file help me reconstruct the scripts or programs used to generate it, and reformulate them for 32 bit floats? Since there are more than 2000 cases, and many need rewriting, I prefer an automated method to error-prone hand coding. By the way, the level of testing is most impressive. Thanks for any help or tips, Matti Picus

2 1

creating Lib/tests/cmath_testcases.txt for 64 bit complex numbers
by Matti Picus 10 Sep '12

10 Sep '12

1 0

Re: [Python-Dev] cpython: Fixed out-of-bounce write to rawmode buffer. The fixed size buffer wasn't
by Christian Heimes 10 Sep '12

10 Sep '12

Am 10.09.2012 03:50, schrieb christian.heimes: > http://hg.python.org/cpython/rev/85cb90f79cbf > changeset: 78946:85cb90f79cbf > user: Christian Heimes <christian(a)cheimes.de> > date: Mon Sep 10 03:50:48 2012 +0200 > summary: > Fixed out-of-bounce write to rawmode buffer. The fixed size buffer wasn't enlarged for the new 'x' flag. The buffer may contain the 5 flags xrwa+ and the \0 byte > > files: > Modules/_io/_iomodule.c | 2 +- > 1 files changed, 1 insertions(+), 1 deletions(-) > > > diff --git a/Modules/_io/_iomodule.c b/Modules/_io/_iomodule.c > --- a/Modules/_io/_iomodule.c > +++ b/Modules/_io/_iomodule.c > @@ -229,7 +229,7 @@ > int creating = 0, reading = 0, writing = 0, appending = 0, updating = 0; > int text = 0, binary = 0, universal = 0; > > - char rawmode[5], *m; > + char rawmode[6], *m; > int line_buffering, isatty; > > PyObject *raw, *modeobj = NULL, *buffer = NULL, *wrapper = NULL; Georg, this looks rather severe and should be included in the next release, too. Christian

1 0

Re: [Python-Dev] [Python-checkins] devguide: Update committers list location.
by Brett Cannon 09 Sep '12

09 Sep '12

Did you mean to use http://docs.python.org/devguide/developers.html instead of http://hg.python.org/committers.txt as the former lists why while the latter just lists usernames? On Sun, Sep 9, 2012 at 3:19 AM, georg.brandl <python-checkins(a)python.org>wrote: > http://hg.python.org/devguide/rev/b40bfc99c54f > changeset: 548:b40bfc99c54f > user: Georg Brandl <georg(a)python.org> > date: Sun Sep 09 09:20:23 2012 +0200 > summary: > Update committers list location. > > files: > coredev.rst | 4 ++-- > faq.rst | 2 +- > 2 files changed, 3 insertions(+), 3 deletions(-) > > > diff --git a/coredev.rst b/coredev.rst > --- a/coredev.rst > +++ b/coredev.rst > @@ -25,7 +25,7 @@ > able to commit them without supervision. > > A complete list of core developer usernames can be found at > -http://www.python.org/dev/committers. :ref:`developers` lists when and > why > +http://hg.python.org/committers.txt. :ref:`developers` lists when and why > someone received commit privileges. > > > @@ -68,7 +68,7 @@ > This should match your username on the issue tracker. > > You can verify your commit access by looking at > -http://www.python.org/dev/committers which lists all core developers by > +http://hg.python.org/committers.txt which lists all core developers by > username. If you want to practice, there is a `test repository > <http://hg.python.org/test/>`_ where you can freely commit and push any > changes you like:: > diff --git a/faq.rst b/faq.rst > --- a/faq.rst > +++ b/faq.rst > @@ -96,7 +96,7 @@ > On the `issue tracker`_, most core developers will have the Python logo > appear next to their name. > > -.. _full list of developers: http://www.python.org/dev/committers > +.. _full list of developers: http://hg.python.org/committers.txt > > > What standards of behaviour are expected in these communication channels? > > -- > Repository URL: http://hg.python.org/devguide > > _______________________________________________ > Python-checkins mailing list > Python-checkins(a)python.org > http://mail.python.org/mailman/listinfo/python-checkins > >

1 0

Re: [Python-Dev] cpython (3.2): Issue #15881: Fixed atexit hook in multiprocessing.
by Antoine Pitrou 09 Sep '12

09 Sep '12

On Sun, 9 Sep 2012 19:28:07 +0200 (CEST) alexander.belopolsky <python-checkins(a)python.org> wrote: > http://hg.python.org/cpython/rev/27d410dd5431 > changeset: 78922:27d410dd5431 > branch: 3.2 > parent: 78895:adc5e6aca251 > user: Alexander Belopolsky <alexander.belopolsky(a)gmail.com> > date: Sun Sep 09 13:16:15 2012 -0400 > summary: > Issue #15881: Fixed atexit hook in multiprocessing. > > files: > Doc/ACKS.txt | 1 + > Lib/multiprocessing/util.py | 50 ++++++++++++++++++------- > 2 files changed, 37 insertions(+), 14 deletions(-) > > > diff --git a/Doc/ACKS.txt b/Doc/ACKS.txt > --- a/Doc/ACKS.txt > +++ b/Doc/ACKS.txt > @@ -236,3 +236,4 @@ > * Moshe Zadka > * Milan Zamazal > * Cheng Zhang > + * Chris McDonough You really want to credit code contributions in Misc/ACKS, not Doc/ACKS.txt. Furthermore, the entries should probably be inserted in (rough) alphabetical order. Regards Antoine. -- Software development and contracting: http://pro.pitrou.net

2 1

[RELEASED] Python 3.3.0 release candidate 2
by Georg Brandl 09 Sep '12

09 Sep '12

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On behalf of the Python development team, I'm delighted to announce the second release candidate of Python 3.3.0. This is a preview release, and its use is not recommended in production settings. Python 3.3 includes a range of improvements of the 3.x series, as well as easier porting between 2.x and 3.x. Major new features and changes in the 3.3 release series are: * PEP 380, syntax for delegating to a subgenerator ("yield from") * PEP 393, flexible string representation (doing away with the distinction between "wide" and "narrow" Unicode builds) * A C implementation of the "decimal" module, with up to 80x speedup for decimal-heavy applications * The import system (__import__) now based on importlib by default * The new "lzma" module with LZMA/XZ support * PEP 397, a Python launcher for Windows * PEP 405, virtual environment support in core * PEP 420, namespace package support * PEP 3151, reworking the OS and IO exception hierarchy * PEP 3155, qualified name for classes and functions * PEP 409, suppressing exception context * PEP 414, explicit Unicode literals to help with porting * PEP 418, extended platform-independent clocks in the "time" module * PEP 412, a new key-sharing dictionary implementation that significantly saves memory for object-oriented code * PEP 362, the function-signature object * The new "faulthandler" module that helps diagnosing crashes * The new "unittest.mock" module * The new "ipaddress" module * The "sys.implementation" attribute * A policy framework for the email package, with a provisional (see PEP 411) policy that adds much improved unicode support for email header parsing * A "collections.ChainMap" class for linking mappings to a single unit * Wrappers for many more POSIX functions in the "os" and "signal" modules, as well as other useful functions such as "sendfile()" * Hash randomization, introduced in earlier bugfix releases, is now switched on by default In total, almost 500 API items are new or improved in Python 3.3. For a more extensive list of changes in 3.3.0, see http://docs.python.org/3.3/whatsnew/3.3.html To download Python 3.3.0 visit: http://www.python.org/download/releases/3.3.0/ Please consider trying Python 3.3.0 with your code and reporting any bugs you may notice to: http://bugs.python.org/ Enjoy! - -- Georg Brandl, Release Manager georg at python.org (on behalf of the entire python-dev team and 3.3's contributors) -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (GNU/Linux) iEYEARECAAYFAlBMYJMACgkQN9GcIYhpnLCc5ACfcufn57tkNBPFU7qCpZ74GzjW msMAn3sIwWHLdqixypnnyMBOw1ijILjo =+e0e -----END PGP SIGNATURE-----

1 0

Re: [Python-Dev] devguide: Add Eric Snow.
by Antoine Pitrou 09 Sep '12

09 Sep '12

On Sun, 9 Sep 2012 09:11:08 +0200 (CEST) georg.brandl <python-checkins(a)python.org> wrote: > > diff --git a/developers.rst b/developers.rst > --- a/developers.rst > +++ b/developers.rst > @@ -26,9 +26,12 @@ > > - Daniel Holth was given push privileges on Sep 9 2012 by GFB, for PEP editing. > > -- Peter Moody was given push privileges on May 20 2012 by Antoine Pitrou > - for authorship and maintenance of the ipaddress module (accepted in PEP > - 3144 by Nick Coghlan). > +- Eric Snow was given push privileges on Sep 5 2012 by Antoine Pitrou for > + general contributions, on recommendation by Nick Coghlan. Oops, sorry, I had forgotten to update the developers list. Regards Antoine. -- Software development and contracting: http://pro.pitrou.net

1 0