Mailman 3 February 2012 - Python-Dev

Summary of Python tracker Issues
by Python tracker 03 Feb '12

03 Feb '12

ACTIVITY SUMMARY (2012-01-27 - 2012-02-03) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 3248 (+14) closed 22466 (+29) total 25714 (+43) Open issues with patches: 1392 Issues opened (30) ================== #13892: distutils handling of windows manifest isn't optimal http://bugs.python.org/issue13892 opened by jackjansen #13893: Make CGIHTTPServer capable of redirects (and status other than http://bugs.python.org/issue13893 opened by Giovanni.Funchal #13896: shelf doesn't work with 'with' http://bugs.python.org/issue13896 opened by gruszczy #13897: Move fields relevant to coroutine/generators out of frame into http://bugs.python.org/issue13897 opened by Mark.Shannon #13898: Ignored exception in test_ssl http://bugs.python.org/issue13898 opened by nadeem.vawda #13899: re pattern r"[\A]" should work like "A" but matches nothing. D http://bugs.python.org/issue13899 opened by sjmachin #13902: Sporadic test_threading failure on FreeBSD 6.4 buildbot http://bugs.python.org/issue13902 opened by nadeem.vawda #13903: New shared-keys dictionary implementation http://bugs.python.org/issue13903 opened by Mark.Shannon #13904: Generator as *args: TypeError replaced http://bugs.python.org/issue13904 opened by july #13905: Built-in Types Comparisons should mention rich comparison meth http://bugs.python.org/issue13905 opened by catalin.iacob #13907: test_pprint relies on set/dictionary repr() ordering http://bugs.python.org/issue13907 opened by Mark.Shannon #13909: Ordering of free variables in dis is dependent on dict orderin http://bugs.python.org/issue13909 opened by Mark.Shannon #13910: test_packaging is dependent on dict ordering. http://bugs.python.org/issue13910 opened by Mark.Shannon #13911: test_trace depends on dict repr() ordering http://bugs.python.org/issue13911 opened by Mark.Shannon #13912: ImportError using __import__ and relative level 1 http://bugs.python.org/issue13912 opened by jason.coombs #13913: utf-8 or utf8 or utf-8 (codec display name inconsistency) http://bugs.python.org/issue13913 opened by kennyluck #13915: Update Tutorial 6.1.3 for PEP 3145 http://bugs.python.org/issue13915 opened by terry.reedy #13916: disallow the "surrogatepass" handler for non utf-* encodings http://bugs.python.org/issue13916 opened by kennyluck #13918: locale.atof documentation is missing func argument http://bugs.python.org/issue13918 opened by ced #13921: sqlite3: OptimizedUnicode doesn't work in Py3k http://bugs.python.org/issue13921 opened by petri.lehtinen #13922: argparse handling multiple "--" in args improperly http://bugs.python.org/issue13922 opened by Warren.Turkal #13923: new formatter for argparse http://bugs.python.org/issue13923 opened by Warren.Turkal #13924: Mercurial robots.txt should let robots crawl landing pages. http://bugs.python.org/issue13924 opened by Ivaylo.Popov #13926: pydoc - stall when requesting a list of available modules in t http://bugs.python.org/issue13926 opened by Jeroen #13927: Extra spaces in the output of time.ctime http://bugs.python.org/issue13927 opened by Roger.Caldwell #13928: bug in asyncore.dispatcher_with_send http://bugs.python.org/issue13928 opened by adamhj #13929: fnmatch to support escape characters http://bugs.python.org/issue13929 opened by fruch #13930: lib2to3 ability to output files into a different directory and http://bugs.python.org/issue13930 opened by gregory.p.smith #13932: If some test module fails to import another module unittest re http://bugs.python.org/issue13932 opened by sbarthelemy #13933: IDLE:not able to complete the hashlib module http://bugs.python.org/issue13933 opened by ramchandra.apte Most recent 15 issues with no replies (15) ========================================== #13933: IDLE:not able to complete the hashlib module http://bugs.python.org/issue13933 #13932: If some test module fails to import another module unittest re http://bugs.python.org/issue13932 #13930: lib2to3 ability to output files into a different directory and http://bugs.python.org/issue13930 #13929: fnmatch to support escape characters http://bugs.python.org/issue13929 #13923: new formatter for argparse http://bugs.python.org/issue13923 #13922: argparse handling multiple "--" in args improperly http://bugs.python.org/issue13922 #13916: disallow the "surrogatepass" handler for non utf-* encodings http://bugs.python.org/issue13916 #13915: Update Tutorial 6.1.3 for PEP 3145 http://bugs.python.org/issue13915 #13911: test_trace depends on dict repr() ordering http://bugs.python.org/issue13911 #13910: test_packaging is dependent on dict ordering. http://bugs.python.org/issue13910 #13909: Ordering of free variables in dis is dependent on dict orderin http://bugs.python.org/issue13909 #13907: test_pprint relies on set/dictionary repr() ordering http://bugs.python.org/issue13907 #13904: Generator as *args: TypeError replaced http://bugs.python.org/issue13904 #13902: Sporadic test_threading failure on FreeBSD 6.4 buildbot http://bugs.python.org/issue13902 #13893: Make CGIHTTPServer capable of redirects (and status other than http://bugs.python.org/issue13893 Most recent 15 issues waiting for review (15) ============================================= #13930: lib2to3 ability to output files into a different directory and http://bugs.python.org/issue13930 #13921: sqlite3: OptimizedUnicode doesn't work in Py3k http://bugs.python.org/issue13921 #13905: Built-in Types Comparisons should mention rich comparison meth http://bugs.python.org/issue13905 #13904: Generator as *args: TypeError replaced http://bugs.python.org/issue13904 #13903: New shared-keys dictionary implementation http://bugs.python.org/issue13903 #13897: Move fields relevant to coroutine/generators out of frame into http://bugs.python.org/issue13897 #13896: shelf doesn't work with 'with' http://bugs.python.org/issue13896 #13893: Make CGIHTTPServer capable of redirects (and status other than http://bugs.python.org/issue13893 #13889: str(float) and round(float) issues with FPU precision http://bugs.python.org/issue13889 #13886: readline-related test_builtin failure http://bugs.python.org/issue13886 #13884: IDLE 2.6.5 Recent Files undocks http://bugs.python.org/issue13884 #13882: PEP 410: Use decimal.Decimal type for timestamps http://bugs.python.org/issue13882 #13879: Argparse does not support subparser aliases in 2.7 http://bugs.python.org/issue13879 #13872: socket.detach doesn't mark socket._closed http://bugs.python.org/issue13872 #13857: Add textwrap.indent() as counterpart to textwrap.dedent() http://bugs.python.org/issue13857 Top 10 most discussed issues (10) ================================= #13703: Hash collision security issue http://bugs.python.org/issue13703 30 msgs #13882: PEP 410: Use decimal.Decimal type for timestamps http://bugs.python.org/issue13882 18 msgs #6210: Exception Chaining missing method for suppressing context http://bugs.python.org/issue6210 14 msgs #10181: Problems with Py_buffer management in memoryobject.c (and else http://bugs.python.org/issue10181 14 msgs #13609: Add "os.get_terminal_size()" function http://bugs.python.org/issue13609 11 msgs #13889: str(float) and round(float) issues with FPU precision http://bugs.python.org/issue13889 11 msgs #13734: Add a generic directory walker method to avoid symlink attacks http://bugs.python.org/issue13734 10 msgs #13856: xmlrpc / httplib changes to allow for certificate verification http://bugs.python.org/issue13856 10 msgs #11457: os.stat(): add new fields to get timestamps as Decimal objects http://bugs.python.org/issue11457 9 msgs #13912: ImportError using __import__ and relative level 1 http://bugs.python.org/issue13912 9 msgs Issues closed (27) ================== #5231: Change format of a memoryview http://bugs.python.org/issue5231 closed by skrah #8828: Atomic function to rename a file http://bugs.python.org/issue8828 closed by pitrou #13402: Document absoluteness of sys.executable http://bugs.python.org/issue13402 closed by python-dev #13506: IDLE sys.path does not contain Current Working Directory http://bugs.python.org/issue13506 closed by terry.reedy #13676: sqlite3: Zero byte truncates string contents http://bugs.python.org/issue13676 closed by python-dev #13777: socket: communicating with Mac OS X KEXT controls http://bugs.python.org/issue13777 closed by loewis #13806: Audioop decompression frames size check fix http://bugs.python.org/issue13806 closed by pitrou #13817: deadlock in subprocess while running several threads using Pop http://bugs.python.org/issue13817 closed by neologix #13836: Define key failed http://bugs.python.org/issue13836 closed by terry.reedy #13848: io.open() doesn't check for embedded NUL characters http://bugs.python.org/issue13848 closed by pitrou #13851: Packaging distutils2 for Fedora http://bugs.python.org/issue13851 closed by eric.araujo #13868: Add hyphen doc fix http://bugs.python.org/issue13868 closed by georg.brandl #13874: test_faulthandler: read_null test fails with current clang http://bugs.python.org/issue13874 closed by haypo #13890: test_importlib failures under Windows http://bugs.python.org/issue13890 closed by brett.cannon #13891: CPU DoS With Python's socket module http://bugs.python.org/issue13891 closed by neologix #13894: threading._CRLock should not be tested if _thread.RLock isn't http://bugs.python.org/issue13894 closed by neologix #13895: test_ssl hangs on Ubuntu http://bugs.python.org/issue13895 closed by pitrou #13900: documentation page on email.parser contains self-referential n http://bugs.python.org/issue13900 closed by georg.brandl #13901: test_get_outputs (test_distutils) failure with --enable-shared http://bugs.python.org/issue13901 closed by ned.deily #13906: mimetypes.py under windows - bad exception catch http://bugs.python.org/issue13906 closed by r.david.murray #13908: PyType_FromSpec() lacks PyType_Ready() call http://bugs.python.org/issue13908 closed by python-dev #13914: In module re the repeat interval {} doesn't accept numbers gre http://bugs.python.org/issue13914 closed by haypo #13917: Python 2.7.2 and 3.2.2 execl crash http://bugs.python.org/issue13917 closed by pitrou #13919: invalid http://bugs.python.org/issue13919 closed by nadeem.vawda #13920: intern() doc wrong spelling http://bugs.python.org/issue13920 closed by brian.curtin #13925: making assignments to an empty two dimensional list http://bugs.python.org/issue13925 closed by mark.dickinson #13931: os.path.exists inconsistent between 32 bit and 64 bit http://bugs.python.org/issue13931 closed by zxw

1 0

Python 3 optimizations, continued, continued again...
by stefan brunthaler 03 Feb '12

03 Feb '12

Hi guys, while there is at least some interest in incorporating my optimizations, response has still been low. I figure that the changes are probably too much for a single big incorporation step. On a recent flight, I thought about cutting it down to make it more easily digestible. The basic idea is to remove the optimized interpreter dispatch loop and advanced instruction format and use the existing ones. Currently (rev. ca8a0dfb2176), opcode.h uses 109 of potentially available 255 instructions using the current instruction format. Hence, up to 149 instruction opcodes could be given to optimized instruction derivatives. Consequently, a possible change would require to change: a) opcode.h to add new instruction opcodes, b) ceval.c to include the new instruction opcodes in PyEval_EvalFrameEx, c) abstract.c, object.c (possible other files) to add the quickening/rewriting function calls. If this is more interesting, I could start evaluating which instruction opcodes should be allocated to which derivatives to get the biggest benefit. This is a lot easier to implement (because I can re-use the existing instruction implementations) and can easily be made to be conditionally compile-able, similar to the computed-gotos option. Since the changes are minimal it is also simpler to understand and deal with for everybody else, too. On the "downside", however, not all optimizations are possible and/or make sense in the given limit of instructions (no data-object inlining and no reference-count elimination.) How does that sound? Have a nice day, --stefan

11 23

open issues on accepted PEPs
by Ethan Furman 03 Feb '12

03 Feb '12

I was looking at the other Open Issues on PEP 3134, think I might try to resolve them as well, and discovered via testing that they have already been taken care of. Is there an established way to get information like that? I realize that PEPs are partly historical documents, but it would it make sense to add a note after an Open Issue (or any other section) that was refined, resolved, or whatever in a later PEP or bug or patch or ...* ~Ethan~ *Yes, I am volunteering to tackle that project.

2 2

Switching to Visual Studio 2010
by "Martin v. Löwis" 01 Feb '12

01 Feb '12

It seems a number of people are interested that the Python trunk switches to Visual Studio 2010 *now*. I've been hesitant to agree to such a change, as I still hope that Python can skip over VS 2010 (a.k.a. VS 10), and go straight to VS 11. However, I just learned that VS 11 supposed ready VS 10 project files just fine, with no need of conversion. So I'd be willing to agree to converting the Python trunk now. It will surely cause all kinds of issues, as any switching of Visual Studio releases has caused in the past. Since a number of people have already started with such a project, I'd like to ask for a volunteer who will lead this project. You get the honor to commit the changes, and you will be in charge if something breaks, hopefully finding out solutions in a timely manner (not necessarily implementing the solutions yourself). Any volunteers? Regards, Martin P.S. Here is my personal list of requirements and non-requirements: - must continue to live in PCbuild, and must replace the VS 9 project files "for good" - may or may not support automatic conversion to VS 9. If it turns out that conversion to old project files is not feasible, we could either decide to maintain old project files manually (in PC/VS9), or just give up on maintaining build support for old VS releases. - must generate binaries that run on Windows XP - must support x86 and AMD64 builds - must support debug and no-debug builds - must support PGO builds - must support buildbot - must support building all extensions that we currently build - may break existing buildbot installations until they upgrade to a new VS release - must support PCbuild/rt.bat - should support Tools/msi. If it doesn't, I'll look into it. - must nearly pass the test suite (i.e. number of additional failures due to VS 2010 should be "small")

5 12

docs fixes and PEP 409
by Ethan Furman 01 Feb '12

01 Feb '12

I'm looking at the docs to make the relevant changes due to PEP 409, and I'm noticing some problems. E.g. The PyException_Get|Set_Context|Cause all talk about using NULL to clear the related attribute, when actually in should be Py_None. Only PyException_GetCause is directly related to PEP 409 -- should I only fix that one, and open up a new issue on the tracker for the other three, or should I fix all four now? ~Ethan~

2 2

PEP 409 - now properly formatted (sorry for the noise)
by Ethan Furman 01 Feb '12

01 Feb '12

PEP: 409 Title: Suppressing exception context Version: $Revision$ Last-Modified: $Date$ Author: Ethan Furman <ethan(a)stoneleaf.us> Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 26-Jan-2012 Post-History: 30-Aug-2002, 01-Feb-2012 Abstract ======== One of the open issues from PEP 3134 is suppressing context: currently there is no way to do it. This PEP proposes one. Rationale ========= There are two basic ways to generate exceptions: 1) Python does it (buggy code, missing resources, ending loops, etc.) 2) manually (with a raise statement) When writing libraries, or even just custom classes, it can become necessary to raise exceptions; moreover it can be useful, even necessary, to change from one exception to another. To take an example from my dbf module:: try: value = int(value) except Exception: raise DbfError(...) Whatever the original exception was (``ValueError``, ``TypeError``, or something else) is irrelevant. The exception from this point on is a ``DbfError``, and the original exception is of no value. However, if this exception is printed, we would currently see both. Alternatives ============ Several possibilities have been put forth: * ``raise as NewException()`` Reuses the ``as`` keyword; can be confusing since we are not really reraising the originating exception * ``raise NewException() from None`` Follows existing syntax of explicitly declaring the originating exception * ``exc = NewException(); exc.__context__ = None; raise exc`` Very verbose way of the previous method * ``raise NewException.no_context(...)`` Make context suppression a class method. All of the above options will require changes to the core. Proposal ======== I proprose going with the second option:: raise NewException from None It has the advantage of using the existing pattern of explicitly setting the cause:: raise KeyError() from NameError() but because the 'cause' is ``None`` the previous context, while retained, is not displayed by the default exception printing routines. Language Details ================ Currently, ``__context__`` and ``__cause__`` start out as None, and then get set as exceptions occur. To support ``from None``, ``__context__`` will stay as it is, but ``__cause__`` will start out as ``False``, and will change to ``None`` when the ``raise ... from None`` method is used. The default exception printing routine will then: * If ``__cause__`` is ``False`` the ``__context__`` (if any) will be printed. * If ``__cause__`` is ``None`` the ``__context__`` will not be printed. * if ``__cause__`` is anything else, ``__cause__`` will be printed. This has the benefit of leaving the ``__context__`` intact for future logging, querying, etc., while suppressing its display if it is not caught. This is important for those times when trying to debug poorly written libraries with `bad error messages`_. Patches ======= There is a patch for CPython implementing this attached to `Issue 6210`_. References ========== Discussion and refinements in this `thread on python-dev`_. .. _bad error messages: http://bugs.python.org/msg152294 .. _Issue 6210: http://bugs.python.org/issue6210 .. _thread on python-dev: http://mail.python.org/pipermail/python-dev/2012-January/115838.html Copyright ========= This document has been placed in the public domain. .. Local Variables: mode: indented-text indent-tabs-mode: nil sentence-end-double-space: t fill-column: 70 coding: utf-8 End:

1 1