Mailman 3 August 2011 - Python-Dev

Re: [Python-Dev] [Python-checkins] cpython (3.2): Use real word in English text (i.e. not code)
by Éric Araujo 13 Aug '11

13 Aug '11

Hi, >> summary: >> Use real word in English text (i.e. not code) > I agree that 'arg' for 'argument is email/twitter-speak, not proper > document prose. >> - :synopsis: Command-line option and argument-parsing library. >> + :synopsis: Command-line option and argument parsing library. > However, 'argument-parsing' could/should be left hyphenated as a > compound adjective for the same reason 'command-line' is. With all due respect to the fact that you’re a native speaker and I’m not, here I disagree because I parse the sentence in this way (using parens to group things by precedence, if you want): (((command-line (option and argument)) parsing) library) To paraphrase, it’s a library to parse options and arguments from the command line, not a library to parse arguments and (missing verb-ing) options from the command line. (I’m not sure I’m clear.) > An arg you missed Yes, I looked for all instances of args but not arg. Will do. Regards

4 3

[PEPs] Rebooting PEP 394 (aka Support the /usr/bin/python2 symlink upstream)
by Kerrick Staley 13 Aug '11

13 Aug '11

Hi, These are two emails I sent a short while ago about finalizing PEP 394. There was no response, so in case the messages didn't go through, I'm resending them. Thanks, Kerrick Staley ---------- Forwarded message ---------- From: Kerrick Staley <mail(a)kerrickstaley.com> Date: Sat, Jul 9, 2011 at 7:45 PM Subject: Re: [Python-Dev] [PEPs] Support the /usr/bin/python2 symlink upstream To: python-dev(a)python.org Sorry that I dropped the ball on this. I'd still like to see this get implemented, but I got distracted with school and forgot about it. Updates I have made to the PEP will be sent as a patch immediately after this email. Here's a summary of what was happenening when we left off: * The draft SVN version from March 4 was pretty much complete. * Some were concerned about addressing Windows, but it was generally agreed to leave the Windows issue to another PEP. PEP 397 was started on March 15 to address the Windows side of the issue. PEP 397 recommends that the Windows Python launcher read the shebang and use it to determine which Python version to use; this allows one syntax for both operating systems that is compatible with the current PEP 394 recommendation. * There were concerns from Ned Deily about the naming of other binaries such as idle, pydoc, and python-config; these need to be created as idle2, pydoc2, and python2-config, with links created at the locations of the original binaries. * There were concerns from Glenn Linderman that the shebang line doesn't encode enough information to flexibly handle Windows launching (or even launching in general). ==== Here are my thoughts: * For Ned's comments, I agree. Although the issue isn't as large with these programs, there's no reason we can't handle them in the same way. I updated the PEP. * For Glenn's comments, I think the method you propose adds too much complexity. Regardless, if the #@ syntax is implemented, it can be described in PEP 397; it won't have an impact on the contents of this PEP. I think, though, that having multiple syntaxes may cause many scripts to be incompatible with multiple platforms when they don't have to be, since Unix coders will rarely add a #@ line, and Windows coders will likely forget the #! line. Also, #@ really ignores the purpose of a shebang: shebangs simply indicate an interpreter that works with the script; the shebang allows users to run arbitrary scripts without worrying about which interpreter they should specify. There's no reason that a script should use one interpreter on Unix, but be incompatible with that interpreter on Windows yet compatible with another. The name of the Unix binary is enough to determine the implementation and version of the interpreter to be used on Unix, and a Windows launcher should always invoke the same implementation/version on Windows (and this won't require hard-coding anything into the launcher if done right). If you want the script to run with a specific interpreter and version, possibly contingent on which operating system you're running the script under, then you can just invoke the interpreter by name with the script as an argument (e.g. python3 myprogram.py). TL;DR: shebangs encode a default implementation/version, and if you need something special, you can just manually run python3 myprogram.py or use a .bat file. ==== Also, I updated the PEP with the clarification that commands like python3 should be hard links (because they'll be invoked from code and are more efficient; also, hard links are just as flexible as symlinks here), while commands like python should be soft links (because this makes it clear to sysadmins that they can be "switched", and it's needed for flexibility if python3 changes). This really doesn't matter, but can we keep it this way unless there are serious objections? Regards, Kerrick Staley ---------- Forwarded message ---------- From: Kerrick Staley <mail(a)kerrickstaley.com> Date: Sat, Jul 9, 2011 at 7:46 PM Subject: Re: [Python-Dev] [PEPs] Support the /usr/bin/python2 symlink upstream To: python-dev(a)python.org $ svn diff Index: pep-0394.txt =================================================================== --- pep-0394.txt (revision 88860) +++ pep-0394.txt (working copy) @@ -1,5 +1,5 @@ PEP: 394 -Title: The "python" command on Unix-Like Systems +Title: The "python" Command on Unix-Like Systems Version: $Revision$ Last-Modified: $Date$ Author: Kerrick Staley <mail(a)kerrickstaley.com>, @@ -53,10 +53,14 @@ * When reinvoking the interpreter from a Python script, querying ``sys.executable`` to avoid hardcoded assumptions regarding the interpreter location remains the preferred approach. +* The ``idle``, ``pydoc``, and ``python-config`` binaries from Python 2.0 +should likewise be available as ``idle2``, ``pydoc2``, and ``python2-config``, +with the original commands invoking these binaries by default, but possibly +invoking the Python 3.0 versions instead. These recommendations are the outcome of the relevant python-dev discussion in -March 2011 [1] (NOTE: More accurately, they will be such once that "Draft" -status disappears from the PEP header, it has been moved into the "Other +March to July 2011 [1] (NOTE: More accurately, they will be such once that +"Draft" status disappears from the PEP header, it has been moved into the "Other Informational PEP" section in PEP 0 and this note has been deleted) @@ -144,11 +148,16 @@ While technically a new feature, the ``make install`` command and the Mac OS X installer in the 2.7 version of CPython will be adjusted to create the -new ``python2`` command in addition to the existing ``python`` and -``python2.7`` commands. This feature will first appear in CPython 2.7.2. +``python2.7``, ``idle2.7``, ``pydoc2.7``, and ``python2.7-config`` binaries, +with ``python2``, ``idle2``, ``pydoc2``, and ``python2-config`` as hard links +to the respective binaries, and ``python``, ``idle``, ``pydoc``, and +``python-config`` as symbolic links to the respective hard links. This feature +will first appear in CPython 2.7.2. -The ``make install`` command in the CPython 3.x series will continue to -install only the ``python3`` symlink for the foreseeable future. +The ``make install`` command in the CPython 3.x series will similarly install +the ``python3.x``, ``idle3.x``, ``pydoc3.x``, and ``python3.x-config`` binaries +(with appropriate ``x``), and ``python3``, ``idle3``, ``pydoc3``, and +``python3-config`` as hard links. Impact on PYTHON* Environment Variables @@ -166,27 +175,12 @@ Exclusions of MS Windows ======================== -This PEP deliberately excludes any proposals relating to Microsoft Windows. -The use of parallel installs on Windows suffers from numerous issues, -including the "last installed wins" behaviour for handling of file -associations, a lack of universal robust symlink support for easy aliasing of -commands, the fact that the Python executable is not available on ``PATH`` by -default, the fact that the ``python.exe`` and ``pythonw.exe`` names are -used for both Python 2 and Python 3 binaries and the lack of distinction -between the different Python versions when the Start menu shortcuts are -divorced from their containing folders (e.g. when they appear in the -"Recently Used" list. +This PEP deliberately excludes any proposals relating to Microsoft Windows: +devising an equivalent solution for Windows was deemed too complex to handle +here. PEP 397 and the related discussion on the python-dev mailing list address +this issue. -While these questions are well worth addressing, they do not have easy -answers. The authors of this particular PEP aren't inclined to even begin -trying to answer them, but anyone that wants to tackle them should feel free -to start working on their own PEP. -Note that, while the topic has been excluded from this PEP, there is plenty of -material in the linked python-dev discussion that may be useful in the design -and implementation of a Windows-specific solution. - - References ==========

14 33

Review request issue 12178
by Catalin Iacob 12 Aug '11

12 Aug '11

Could a core developer please review the patch I proposed for issue 12178 "csv writer doesn't escape escapechar"? Thanks!

1 0

Summary of Python tracker Issues
by Python tracker 12 Aug '11

12 Aug '11

ACTIVITY SUMMARY (2011-08-05 - 2011-08-12) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 2923 (+24) closed 21602 (+23) total 24525 (+47) Open issues with patches: 1264 Issues opened (35) ================== #12032: Tools/Scripts/crlf.py needs updating for python 3+ http://bugs.python.org/issue12032 reopened by eric.araujo #12701: Apple's clang 2.1 (xcode 4.1, OSX 10.7) optimizer miscompiles http://bugs.python.org/issue12701 opened by deadshort #12702: shutil.copytree() should use os.lutimes() to copy the metadata http://bugs.python.org/issue12702 opened by petri.lehtinen #12703: Improve error reporting for packaging.util.resolve_name http://bugs.python.org/issue12703 opened by Natim #12704: Language References does not specify exception raised by final http://bugs.python.org/issue12704 opened by Nikratio #12705: Make compile('1\n2\n', '', 'single') raise an exception instea http://bugs.python.org/issue12705 opened by Devin Jeanpierre #12706: timeout sentinel in ftplib and poplib documentation http://bugs.python.org/issue12706 opened by orsenthil #12707: Deprecate addinfourl getters http://bugs.python.org/issue12707 opened by ezio.melotti #12708: multiprocessing.Pool is missing a starmap[_async]() method. http://bugs.python.org/issue12708 opened by hynek #12711: Explain tracker components in devguide http://bugs.python.org/issue12711 opened by eric.araujo #12712: weave build_tools library identification http://bugs.python.org/issue12712 opened by Tim.Holme #12713: argparse: allow abbreviation of sub commands by users http://bugs.python.org/issue12713 opened by pwil3058 #12716: Reorganize os docs for files/dirs/fds http://bugs.python.org/issue12716 opened by benjamin.peterson #12720: Expose linux extended filesystem attributes http://bugs.python.org/issue12720 opened by benjamin.peterson #12721: Chaotic use of helper functions in test_shutil for reading and http://bugs.python.org/issue12721 opened by hynek #12723: Provide an API in tkSimpleDialog for defining custom validatio http://bugs.python.org/issue12723 opened by rabbidous #12725: Docs: Odd phrase "floating seconds" in socket.html http://bugs.python.org/issue12725 opened by Cris.Simpson #12726: explain why locale.getlocale() does not read system's locales http://bugs.python.org/issue12726 opened by alexis #12728: Python re lib fails case insensitive matches on Unicode data http://bugs.python.org/issue12728 opened by tchrist #12729: Python lib re cannot handle Unicode properly due to narrow/wid http://bugs.python.org/issue12729 opened by tchrist #12730: Python's casemapping functions are untrustworthy due to narrow http://bugs.python.org/issue12730 opened by tchrist #12731: python lib re uses obsolete sense of \w in full violation of U http://bugs.python.org/issue12731 opened by tchrist #12732: Can't portably use Unicode in Python identifiers http://bugs.python.org/issue12732 opened by tchrist #12733: Request for grapheme support in Python re lib http://bugs.python.org/issue12733 opened by tchrist #12734: Request for property support in Python re lib http://bugs.python.org/issue12734 opened by tchrist #12735: request full Unicode collation support in std python library http://bugs.python.org/issue12735 opened by tchrist #12737: string.title() is overzealous by upcasing combining marks ina http://bugs.python.org/issue12737 opened by tchrist #12738: Bug in multiprocessing.JoinableQueue() implementation on Ubunt http://bugs.python.org/issue12738 opened by Michael.Hall #12739: read stuck with multithreading and simultaneous subprocess.Pop http://bugs.python.org/issue12739 opened by SAPikachu #12740: Add struct.Struct.nmemb http://bugs.python.org/issue12740 opened by skrah #12741: Implementation of shutil.move http://bugs.python.org/issue12741 opened by David.Townshend #12742: Add support for CESU-8 encoding http://bugs.python.org/issue12742 opened by adalx #12743: C API marshalling doc contains XXX http://bugs.python.org/issue12743 opened by JJeffries #12715: Add symlink support to shutil functions http://bugs.python.org/issue12715 opened by petri.lehtinen #12736: Request for python casemapping functions to use full not simpl http://bugs.python.org/issue12736 opened by tchrist Most recent 15 issues with no replies (15) ========================================== #12743: C API marshalling doc contains XXX http://bugs.python.org/issue12743 #12742: Add support for CESU-8 encoding http://bugs.python.org/issue12742 #12741: Implementation of shutil.move http://bugs.python.org/issue12741 #12740: Add struct.Struct.nmemb http://bugs.python.org/issue12740 #12739: read stuck with multithreading and simultaneous subprocess.Pop http://bugs.python.org/issue12739 #12737: string.title() is overzealous by upcasing combining marks ina http://bugs.python.org/issue12737 #12736: Request for python casemapping functions to use full not simpl http://bugs.python.org/issue12736 #12735: request full Unicode collation support in std python library http://bugs.python.org/issue12735 #12733: Request for grapheme support in Python re lib http://bugs.python.org/issue12733 #12732: Can't portably use Unicode in Python identifiers http://bugs.python.org/issue12732 #12731: python lib re uses obsolete sense of \w in full violation of U http://bugs.python.org/issue12731 #12730: Python's casemapping functions are untrustworthy due to narrow http://bugs.python.org/issue12730 #12728: Python re lib fails case insensitive matches on Unicode data http://bugs.python.org/issue12728 #12726: explain why locale.getlocale() does not read system's locales http://bugs.python.org/issue12726 #12725: Docs: Odd phrase "floating seconds" in socket.html http://bugs.python.org/issue12725 Most recent 15 issues waiting for review (15) ============================================= #12740: Add struct.Struct.nmemb http://bugs.python.org/issue12740 #12723: Provide an API in tkSimpleDialog for defining custom validatio http://bugs.python.org/issue12723 #12721: Chaotic use of helper functions in test_shutil for reading and http://bugs.python.org/issue12721 #12720: Expose linux extended filesystem attributes http://bugs.python.org/issue12720 #12711: Explain tracker components in devguide http://bugs.python.org/issue12711 #12708: multiprocessing.Pool is missing a starmap[_async]() method. http://bugs.python.org/issue12708 #12691: tokenize.untokenize is broken http://bugs.python.org/issue12691 #12684: profile does not dump stats on exception like cProfile does http://bugs.python.org/issue12684 #12668: 3.2 What's New: it's integer->string, not the opposite http://bugs.python.org/issue12668 #12666: map semantic change not documented in What's New http://bugs.python.org/issue12666 #12656: test.test_asyncore: add tests for AF_INET6 and AF_UNIX sockets http://bugs.python.org/issue12656 #12652: Keep test.support docs out of the global docs index http://bugs.python.org/issue12652 #12650: Subprocess leaks fd upon kill() http://bugs.python.org/issue12650 #12646: zlib.Decompress.decompress/flush do not raise any exceptions w http://bugs.python.org/issue12646 #12639: msilib Directory.start_component() fails if keyfile is not Non http://bugs.python.org/issue12639 Top 10 most discussed issues (10) ================================= #12682: Meaning of 'accepted' resolution as documented in devguide http://bugs.python.org/issue12682 10 msgs #12301: Use :data:`sys.thing` instead of ``sys.thing`` throughout http://bugs.python.org/issue12301 9 msgs #12191: Add shutil.chown to allow to use user and group name (and not http://bugs.python.org/issue12191 8 msgs #12666: map semantic change not documented in What's New http://bugs.python.org/issue12666 7 msgs #12672: Some problems in documentation extending/newtypes.html http://bugs.python.org/issue12672 7 msgs #2857: Add "java modified utf-8" codec http://bugs.python.org/issue2857 6 msgs #12721: Chaotic use of helper functions in test_shutil for reading and http://bugs.python.org/issue12721 6 msgs #12541: Accepting Badly formed headers in urllib HTTPBasicAuth http://bugs.python.org/issue12541 5 msgs #12701: Apple's clang 2.1 (xcode 4.1, OSX 10.7) optimizer miscompiles http://bugs.python.org/issue12701 5 msgs #12715: Add symlink support to shutil functions http://bugs.python.org/issue12715 5 msgs Issues closed (24) ================== #10087: HTML calendar is broken http://bugs.python.org/issue10087 closed by python-dev #10741: PyGILState_GetThisThreadState() lacks a doc entry http://bugs.python.org/issue10741 closed by sandro.tosi #12437: _ctypes.dlopen does not include errno in OSError http://bugs.python.org/issue12437 closed by pitrou #12575: add a AST validator http://bugs.python.org/issue12575 closed by python-dev #12608: crash in PyAST_Compile when running Python code http://bugs.python.org/issue12608 closed by meador.inge #12661: Add a new shutil.cleartree function to shutil module http://bugs.python.org/issue12661 closed by chin #12662: Add support for duplicate options in configparser http://bugs.python.org/issue12662 closed by lukasz.langa #12677: Turtle, fix right/left rotation orientation http://bugs.python.org/issue12677 closed by sandro.tosi #12687: Python 3.2 fails to load protocol 0 pickle http://bugs.python.org/issue12687 closed by pitrou #12694: crlf.py script from Tools doesn't work with Python 3.2 http://bugs.python.org/issue12694 closed by r.david.murray #12697: timeit documention still refers to the timeit.py script http://bugs.python.org/issue12697 closed by python-dev #12698: urllib does not use no_proxy when it has blanks http://bugs.python.org/issue12698 closed by python-dev #12699: strange behaviour of locale.getlocale() -> None, None http://bugs.python.org/issue12699 closed by ned.deily #12700: test_faulthandler fails on Mac OS X Lion http://bugs.python.org/issue12700 closed by haypo #12709: In multiprocessing, error_callback isn't documented for map_as http://bugs.python.org/issue12709 closed by sandro.tosi #12710: GTK crash http://bugs.python.org/issue12710 closed by sandro.tosi #12714: argparse.ArgumentParser.add_argument() documentation error http://bugs.python.org/issue12714 closed by r.david.murray #12717: ConfigParser._Chainmap error in 2.7.2 http://bugs.python.org/issue12717 closed by rhettinger #12718: Logical mistake of importer method in logging.config.BaseConfi http://bugs.python.org/issue12718 closed by vinay.sajip #12719: Direct access to tp_dict can lead to stale attributes http://bugs.python.org/issue12719 closed by python-dev #12722: Link to heapq source from docs.python.org not working http://bugs.python.org/issue12722 closed by python-dev #12724: Add Py_RETURN_NOTIMPLEMENTED http://bugs.python.org/issue12724 closed by brian.curtin #12727: "make" always reruns asdl_c.py http://bugs.python.org/issue12727 closed by python-dev #11047: Bad description for an entry in whatsnew/2.7 http://bugs.python.org/issue11047 closed by python-dev

1 0

Re: [Python-Dev] [Python-checkins] cpython (2.7): Fix closes Issue12722 - link heapq source in the text format in the
by Sandro Tosi 11 Aug '11

11 Aug '11

On Wed, Aug 10, 2011 at 21:55, Terry Reedy <tjreedy(a)udel.edu> wrote: > >> >> Latest version of the `heapq Python source code >> >> -<http://svn.python.org/view/python/branches/release27-maint/Lib/heapq.py?vie…>`_ >> >> +<http://svn.python.org/view/*checkout*/python/branches/release27-maint/Lib/h…>`_ > > Should links be to the hg repository instead of svn? > Is svn updated from hg? > I thought is was (mostly) historical read-only. I made the same remark to Senthil on IRC, and came out that web frontend for hg.p.o doesn't allow for a nice way to specify a branch (different than 'default'), it's something like hg.python.org/cpython/<last cset id on a given branch>/path/to/file.py which is almost always outdated :) What do we use to provide the web part of hg.p.o? maybe we can just ask the developers of this tool to provide (or advertize) a proper way to select a branch. If some can provide me some info, I can do the "ask the devs" part. Cheers, -- Sandro Tosi (aka morph, morpheus, matrixhasu) My website: http://matrixhasu.altervista.org/ Me at Debian: http://wiki.debian.org/SandroTosi

7 7

Re: [Python-Dev] cpython: News item for #12724
by Georg Brandl 11 Aug '11

11 Aug '11

Am 11.08.2011 03:34, schrieb brian.curtin: > http://hg.python.org/cpython/rev/3a6782f2a4a8 > changeset: 71811:3a6782f2a4a8 > user: Brian Curtin <brian(a)python.org> > date: Wed Aug 10 20:32:10 2011 -0500 > summary: > News item for #12724 > > files: > Misc/NEWS | 2 ++ > 1 files changed, 2 insertions(+), 0 deletions(-) If it gets a NEWS entry, why isn't it documented? Georg

2 1

Moving forward with the concurrent package
by Brian Curtin 11 Aug '11

11 Aug '11

Now that we have concurrent.futures, is there any plan for multiprocessing to follow suit? PEP 3148 mentions a hope to add or move things in the future [0], which would be now. [0] http://www.python.org/dev/peps/pep-3148/#naming

7 11

urllib bug in Python 3.2.1?
by MRAB 09 Aug '11

09 Aug '11

Someone over at StackOverflow has a problem with urlopen in Python 3.2.1: http://stackoverflow.com/questions/6892573/problem-with-urlopen/6892843#689… This is the code: from urllib.request import urlopen f = urlopen('http://online.wsj.com/mdc/public/page/2_3020-tips.html?mod=topnav_2_3000') page = f.read() f.close() With Python 3.1 and Python 3.2.1 it works OK, but with Python 3.2.1 the read returns an empty string (I checked it myself).

7 8

GIL removal question
by Марк Коренберг 09 Aug '11

09 Aug '11

Probably I want to re-invent a bicycle. I want developers to say me why we can not remove GIL in that way: 1. Remove GIL completely with all current logick. 2. Add it's own RW-locking to all mutable objects (like list or dict) 3. Add RW-locks to every context instance 4. use RW-locks when accessing members of object instances Only one reason, I see, not do that -- is performance of singlethreaded applications. Why not to fix locking functions for this 4 cases to stubs when only one thread present? For atomicity, locks may be implemented as this: For example for this source: -------------------------------- import threading def x(): i=1000 while i: i-- a = threading.Thread(target=x) b = threading.Thread(target=x) a.start() b.start() a.join() b.join() -------------------------------- in my case it will be fully parallel, as common object is not locked much (only global context when a.xxxx = yyyy executed). I think, performance of such code will be higher that using GIL. Other significant reason of not using my case, as I think, is a plenty of atomic processor instructions in each thread, which affect kernel performance. Also, I know about incompatibility my variant with existing code. In a summary: Please say clearly why, actually, my variant is not still implemented. Thanks. -- Segmentation fault

2 1

"Meet the Team" on Python Insider
by Doug Hellmann 09 Aug '11

09 Aug '11

[Renewing this request for participation since there are a few new members since the original request went out.] We are running a series of interviews with the Python developers on the python-dev blog (http://blog.python.org). There is a short list of questions below this message. If you would like to be included in the series, please reply directly to me with your answers. We will be doing one or two posts per week, depending on the number of responses and availability of other information to post. We'll have to wait until we have several responses before we start, so we don't announce a new series and then post two messages before it peters out. Please help us by sending your answers as quickly as you can so we can tell what we'll be dealing with. Posts will be published in roughly the order the responses are received, with the text exactly as you send it (unedited, except for formatting it as HTML). If the questions don't apply to you, you can't remember the answer, or don't have an answer, then you can either leave that question blank or interpret it more broadly and give some related information. Blank questions will be omitted from the posts. Thanks, Doug Personal information: name location (city, country, whatever you want to give--we don't need your mailing address) home page or blog url Questions: 1. How long have you been using Python? 2. How long have you been a core committer? 3. How did you get started as a core developer? Do you remember your first commit? 4. Which parts of Python are you working on now? 5. What do you do with Python when you aren't doing core development work? (day job, other projects, etc.) 6. What do you do when you aren't programming?

1 1