Mailman 3 June 2015 - Python-Dev

Summary of Python tracker Issues
by Python tracker 05 Jun '15

05 Jun '15

ACTIVITY SUMMARY (2015-05-29 - 2015-06-05) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 4853 ( +9) closed 31295 (+54) total 36148 (+63) Open issues with patches: 2225 Issues opened (30) ================== #23239: SSL match_hostname does not accept IP Address http://bugs.python.org/issue23239 reopened by christian.heimes #24325: Speedup types.coroutine() http://bugs.python.org/issue24325 opened by yselivanov #24329: __qualname__ and __slots__ http://bugs.python.org/issue24329 opened by yselivanov #24330: "Configure Idle" not in "Options" http://bugs.python.org/issue24330 opened by Yellow #24331: *** Error in `/usr/bin/python': double free or corruption (!pr http://bugs.python.org/issue24331 opened by krichter #24334: SSLSocket extra level of indirection http://bugs.python.org/issue24334 opened by christian.heimes #24336: Allow arbitrary keywords to @contextmanager functions http://bugs.python.org/issue24336 opened by vadmium #24337: Implement `http.client.HTTPMessage.__repr__` to make debugging http://bugs.python.org/issue24337 opened by cool-RR #24338: In argparse adding wrong arguments makes malformed namespace http://bugs.python.org/issue24338 opened by py.user #24339: iso6937 encoding missing http://bugs.python.org/issue24339 opened by John Helour #24340: co_stacksize estimate can be highly off http://bugs.python.org/issue24340 opened by arigo #24341: Test suite emits many DeprecationWarnings about sys.exc_clear( http://bugs.python.org/issue24341 opened by serhiy.storchaka #24343: Installing 3.4.3 gives error codes 2503 and 2502 on windows http://bugs.python.org/issue24343 opened by lac #24351: string.Template documentation incorrectly references "identifi http://bugs.python.org/issue24351 opened by july #24352: Provide a way for assertLogs to optionally not hide the loggin http://bugs.python.org/issue24352 opened by r.david.murray #24355: Provide a unittest api for controlling verbosity in tests http://bugs.python.org/issue24355 opened by r.david.murray #24356: venv documentation incorrect / misleading http://bugs.python.org/issue24356 opened by Graham.Oliver #24358: Should compression file-like objects provide .fileno(), mislea http://bugs.python.org/issue24358 opened by josh.r #24360: improve argparse.Namespace __repr__ for invalid identifiers. http://bugs.python.org/issue24360 opened by mbussonn #24362: Simplify the fast nodes resize logic in C OrderedDict. http://bugs.python.org/issue24362 opened by eric.snow #24363: httplib fails to handle semivalid HTTP headers http://bugs.python.org/issue24363 opened by mgdelmonte #24364: Not all defects pass through email policy http://bugs.python.org/issue24364 opened by r.david.murray #24370: OrderedDict behavior is unclear with misbehaving keys. http://bugs.python.org/issue24370 opened by eric.snow #24372: Documentation for ssl.wrap_socket's ssl_version parameter is o http://bugs.python.org/issue24372 opened by eric.smith #24379: slice.literal notation http://bugs.python.org/issue24379 opened by llllllllll #24380: Got warning when compiling _scproxy.c on Mac http://bugs.python.org/issue24380 opened by vajrasky #24381: Got warning when compiling ffi.c on Mac http://bugs.python.org/issue24381 opened by vajrasky #24383: consider implementing __await__ on concurrent.futures.Future http://bugs.python.org/issue24383 opened by yselivanov #24384: difflib.SequenceMatcher faster quick_ratio with lower bound sp http://bugs.python.org/issue24384 opened by floyd #24385: libpython27.a in python-2.7.10 i386 (windows msi release) cont http://bugs.python.org/issue24385 opened by Jan Harkes Most recent 15 issues with no replies (15) ========================================== #24381: Got warning when compiling ffi.c on Mac http://bugs.python.org/issue24381 #24380: Got warning when compiling _scproxy.c on Mac http://bugs.python.org/issue24380 #24370: OrderedDict behavior is unclear with misbehaving keys. http://bugs.python.org/issue24370 #24364: Not all defects pass through email policy http://bugs.python.org/issue24364 #24352: Provide a way for assertLogs to optionally not hide the loggin http://bugs.python.org/issue24352 #24351: string.Template documentation incorrectly references "identifi http://bugs.python.org/issue24351 #24341: Test suite emits many DeprecationWarnings about sys.exc_clear( http://bugs.python.org/issue24341 #24340: co_stacksize estimate can be highly off http://bugs.python.org/issue24340 #24329: __qualname__ and __slots__ http://bugs.python.org/issue24329 #24324: Remove -Wunreachable-code flag http://bugs.python.org/issue24324 #24322: Hundreds of linker warnings on Windows http://bugs.python.org/issue24322 #24319: Crash during "make coverage-report" http://bugs.python.org/issue24319 #24307: pip error on windows whose current user name contains non-asci http://bugs.python.org/issue24307 #24302: Dead Code of Handler check in function faulthandler_fatal_erro http://bugs.python.org/issue24302 #24300: Code Refactoring in function nis_mapname() http://bugs.python.org/issue24300 Most recent 15 issues waiting for review (15) ============================================= #24383: consider implementing __await__ on concurrent.futures.Future http://bugs.python.org/issue24383 #24381: Got warning when compiling ffi.c on Mac http://bugs.python.org/issue24381 #24380: Got warning when compiling _scproxy.c on Mac http://bugs.python.org/issue24380 #24379: slice.literal notation http://bugs.python.org/issue24379 #24362: Simplify the fast nodes resize logic in C OrderedDict. http://bugs.python.org/issue24362 #24360: improve argparse.Namespace __repr__ for invalid identifiers. http://bugs.python.org/issue24360 #24336: Allow arbitrary keywords to @contextmanager functions http://bugs.python.org/issue24336 #24334: SSLSocket extra level of indirection http://bugs.python.org/issue24334 #24325: Speedup types.coroutine() http://bugs.python.org/issue24325 #24320: Remove a now-unnecessary workaround from importlib._bootstrap. http://bugs.python.org/issue24320 #24318: Better documentaiton of profile-opt (and release builds in gen http://bugs.python.org/issue24318 #24314: irrelevant cross-link in documentation of user-defined functio http://bugs.python.org/issue24314 #24303: OSError 17 due to _multiprocessing/semaphore.c assuming a one- http://bugs.python.org/issue24303 #24302: Dead Code of Handler check in function faulthandler_fatal_erro http://bugs.python.org/issue24302 #24300: Code Refactoring in function nis_mapname() http://bugs.python.org/issue24300 Top 10 most discussed issues (10) ================================= #24363: httplib fails to handle semivalid HTTP headers http://bugs.python.org/issue24363 15 msgs #18003: lzma module very slow with line-oriented reading. http://bugs.python.org/issue18003 10 msgs #23237: Interrupts are lost during readline PyOS_InputHook processing http://bugs.python.org/issue23237 8 msgs #24338: In argparse adding wrong arguments makes malformed namespace http://bugs.python.org/issue24338 8 msgs #19543: Add -3 warnings for codec convenience method changes http://bugs.python.org/issue19543 7 msgs #24360: improve argparse.Namespace __repr__ for invalid identifiers. http://bugs.python.org/issue24360 7 msgs #24379: slice.literal notation http://bugs.python.org/issue24379 7 msgs #24303: OSError 17 due to _multiprocessing/semaphore.c assuming a one- http://bugs.python.org/issue24303 6 msgs #24320: Remove a now-unnecessary workaround from importlib._bootstrap. http://bugs.python.org/issue24320 6 msgs #24336: Allow arbitrary keywords to @contextmanager functions http://bugs.python.org/issue24336 6 msgs Issues closed (53) ================== #5497: openssl compileerror with original source http://bugs.python.org/issue5497 closed by zach.ware #5633: fix for timeit when the statement is a string and the setup is http://bugs.python.org/issue5633 closed by serhiy.storchaka #5843: Normalization error in urlunparse http://bugs.python.org/issue5843 closed by vadmium #15009: urlsplit can't round-trip relative-host urls. http://bugs.python.org/issue15009 closed by vadmium #16991: Add OrderedDict written in C http://bugs.python.org/issue16991 closed by eric.snow #21853: Fix inspect in unicodeless build http://bugs.python.org/issue21853 closed by serhiy.storchaka #22203: inspect.getargspec() returns wrong spec for builtins http://bugs.python.org/issue22203 closed by yselivanov #22357: inspect module documentation makes no reference to __qualname_ http://bugs.python.org/issue22357 closed by yselivanov #23659: csv.register_dialect doc string http://bugs.python.org/issue23659 closed by berker.peksag #23934: inspect.signature reporting "()" for all builtin & extension t http://bugs.python.org/issue23934 closed by yselivanov #24115: Unhandled error results of C API functions http://bugs.python.org/issue24115 closed by serhiy.storchaka #24148: 'cum' not a valid sort key for pstats.Stats.sort_stats http://bugs.python.org/issue24148 closed by berker.peksag #24264: imageop Unsafe Arithmetic http://bugs.python.org/issue24264 closed by serhiy.storchaka #24267: test_venv.EnsurePipTest.test_with_pip triggers version check o http://bugs.python.org/issue24267 closed by python-dev #24270: PEP 485 (math.isclose) implementation http://bugs.python.org/issue24270 closed by berker.peksag #24284: Inconsistency in startswith/endswith http://bugs.python.org/issue24284 closed by serhiy.storchaka #24308: Test failure: test_with_pip (test.test_venv.EnsurePipTest in 3 http://bugs.python.org/issue24308 closed by ned.deily #24317: Change installer Customize default to match quick settings http://bugs.python.org/issue24317 closed by steve.dower #24323: Typo in Mutable Sequence Types documentation. http://bugs.python.org/issue24323 closed by rhettinger #24326: Audioop: weightB not divided by GCD, weightA divided twice http://bugs.python.org/issue24326 closed by serhiy.storchaka #24327: yield unpacking http://bugs.python.org/issue24327 closed by serhiy.storchaka #24328: Extension modules with single-letter names can't be loaded http://bugs.python.org/issue24328 closed by python-dev #24332: urllib.parse should not discard delimiters when associated com http://bugs.python.org/issue24332 closed by vadmium #24333: urllib2 HTTPS connection over a digest auth enabled proxy give http://bugs.python.org/issue24333 closed by vadmium #24335: Provide __list__(self) along the lines of __str__(self) http://bugs.python.org/issue24335 closed by ethan.furman #24342: coroutine wrapper reentrancy http://bugs.python.org/issue24342 closed by yselivanov #24344: Overlap display issue in windows installer http://bugs.python.org/issue24344 closed by steve.dower #24345: Py_tp_finalize is missing http://bugs.python.org/issue24345 closed by python-dev #24346: TypeError at List in Tuple concatenation http://bugs.python.org/issue24346 closed by r.david.murray #24347: unchecked return value in C OrderedDict http://bugs.python.org/issue24347 closed by eric.snow #24348: incorrect decref in C OrderedDict http://bugs.python.org/issue24348 closed by eric.snow #24349: Null pointer dereferences in C OrderedDict http://bugs.python.org/issue24349 closed by eric.snow #24350: dict({'a':'aa'},a='bb') raises segmentation fault on Mac http://bugs.python.org/issue24350 closed by Graham Klyne #24353: NameError: name 'path_separators' is not defined http://bugs.python.org/issue24353 closed by ionelmc #24354: Requests Library get issue http://bugs.python.org/issue24354 closed by r.david.murray #24357: Change socket.getaddrinfo example to show IPv6 connectivity http://bugs.python.org/issue24357 closed by ned.deily #24359: C OrderedDict needs to check for changes during iteration http://bugs.python.org/issue24359 closed by eric.snow #24361: OrderedDict: crash with threads http://bugs.python.org/issue24361 closed by eric.snow #24365: Conditionalize 3.5 additions to the stable ABI http://bugs.python.org/issue24365 closed by yselivanov #24366: Simple indentation http://bugs.python.org/issue24366 closed by yselivanov #24367: Idle hangs when you close the debugger while debugging http://bugs.python.org/issue24367 closed by terry.reedy #24368: Some C OrderedDict methods need to support keyword arguments. http://bugs.python.org/issue24368 closed by eric.snow #24369: Using OrderedDict.move_to_end during iteration is problematic. http://bugs.python.org/issue24369 closed by eric.snow #24371: configparser hate dot in option like eth2.6 http://bugs.python.org/issue24371 closed by zach.ware #24373: Use traverse & finalize in xxlimited and in PEP 489 tests http://bugs.python.org/issue24373 closed by ncoghlan #24374: Plug refleak in set_coroutine_wrapper http://bugs.python.org/issue24374 closed by yselivanov #24375: Performance regression relative to 2.7 http://bugs.python.org/issue24375 closed by yselivanov #24376: xxlimited.c errors when building 32 and 64 bit on Windows http://bugs.python.org/issue24376 closed by zach.ware #24377: Refleak in OrderedDict.__repr__ when an item is not found. http://bugs.python.org/issue24377 closed by eric.snow #24378: dir(dictobject) returns empty list when __getattribute__ is ov http://bugs.python.org/issue24378 closed by r.david.murray #24382: Fail to build time module on Mac http://bugs.python.org/issue24382 closed by zach.ware #24386: Bug Tracker emails going to gmail spam http://bugs.python.org/issue24386 closed by r.david.murray #24387: json.loads should be idempotent when the argument is a diction http://bugs.python.org/issue24387 closed by r.david.murray

1 0

Unable to build regex module against Python 3.5 32-bit
by MRAB 05 Jun '15

05 Jun '15

As the subject says, I've been unable to build the regex module against Python 3.5b1 for 32-bit. MingGW says: skipping incompatible .../libpython35.a when searching for -lpython35 It builds without a problem against Python 3.5 for 64-bit. Any ideas? Should I just wait until beta 2?

6 18

Mingw help
by Steve Dower 04 Jun '15

04 Jun '15

If you have an interest in linking to the Windows builds of Python 2.7 and 3.5+ using mingw, please visit http://bugs.python.org/issue24385 Unless someone can provide me with the One True Way to generate a lib that will work for everyone, I'm going to replace the lib file with instructions on how to generate it with your own tools. I've done enough guessing and need someone who actually uses mingw to step up and help out. Thanks, Steve

2 1

Re: [Python-Dev] zipimport
by Rose Ames 04 Jun '15

04 Jun '15

On 06/03/2015 08:56 AM, Antoine Pitrou wrote: > Le 03/06/2015 14:34, Rose Ames a écrit : >> >> >> On 06/03/2015 04:59 AM, Antoine Pitrou wrote: >>> On Tue, 02 Jun 2015 21:20:10 +0000 >>> Brett Cannon <brett(a)python.org> wrote: >>>> >>>> I vaguely remember people suggesting writing the minimal zip reading code >>>> in C but I can't remember why since we have I/O access in importlib through >>>> _io and thus it's really just the pulling apart of the zip file to get at >>>> the files to import and thus should be doable in pure Python. >>> >>> You would need other modules, such as struct and zlib, right? >>> >> zlib is already required for compressed zips: >> >> https://github.com/python/cpython/blob/master/Modules/zipimport.c#L1030 > > Ah, the C code already importing the zlib module? Then I guess it's fine :-) > >> Do some companies >> zip the standard library or something? > > I don't know. If they do so, they probably exclude the zlib module in > some way. > > Regards > > Antoine. Sounds like I can just add a zipimporter to Lib/importlib/_bootstrap.py and remove zipimport.c entirely, is that right?

2 1

Fwd: zipimport
by Rose Ames 03 Jun '15

03 Jun '15

At pycon I talked with a few people about bugs.python.org/issue19699. The consensus seemed to be that zipimport wants a lot of work, possibly a rewrite. I'll have some time to work on this over the next couple of months, but I want to be working on the right thing. Could the people who were involved in that conversation remind me of their concerns with zipimport? What exactly would the goal of a rewrite be? Thanks, Rose

4 5

Avoiding reference leaks in heap types with custom tp_dealloc
by Petr Viktorin 02 Jun '15

02 Jun '15

Hello, The new test_importlib.extension.test_loader is currently leaking references, (issue24268). There is a simple hack to stop this, but I'm inclined to not apply quick hacks and rather dig into the root cause. (It's a test module, the refleaks are relatively harmless.) The tests are based directly on the "xxlimited" example, xxlimited.Xxo, which exhibits the same bug -- it's just not tested. It's is caused by a combination of a few factors, but I'm not sure what's a bug and what's just undocumented behavior, so I'm asking for input to put me on the right track. As reported in issue16690, heap types with a naïve custom tp_dealloc leak references to the type when instantiated. According to [0], it seems that tp_dealloc should check if it has been overridden, and if so, decref the type. This needs to be documented (regardless of the solution to the other problems), and I intend to document it. We can change xxlimited to do the check and decref, but isn't it too ugly for a module that showcases the extension module API? (xxlimited.Xxo can technically skip the check, since it doesn't allow subclasses, but that would be setting a nasty trap for anyone learning from that example.) The nice way out would be taking advantage of PEP 442: xxlimited.Xxo can ditch tp_dealloc in favor of tp_traverse and tp_finalize (the former of which it needs anyway to behave correctly). Unfortunately, tp_finalize is not available in the stable ABI (issue24345). I think it should be added; is it too late for 3.5? Another problem is that xxlimited is untested. It's only built for non-debug builds, because Py_LIMITED_API and Py_DEBUG are incompatible. Would it make sense to build and test it without Py_LIMITED_API in debug mode, instead of not building it at all? [0] http://bugs.python.org/issue15653#msg168449

3 7

Re: [Python-Dev] cpython (2.7): Issue #24357: Change host in socket.getaddrinfo example to one that
by Serhiy Storchaka 01 Jun '15

01 Jun '15

On 02.06.15 04:58, ned.deily wrote: > https://hg.python.org/cpython/rev/30da21d2fa4f > changeset: 96458:30da21d2fa4f > branch: 2.7 > parent: 96454:5e8fa1b13516 > user: Ned Deily <nad(a)acm.org> > date: Mon Jun 01 18:45:49 2015 -0700 > summary: > Issue #24357: Change host in socket.getaddrinfo example to one that > does support IPv6 and IPv4; www.python.org currently does not. > > files: > Doc/library/socket.rst | 8 ++++---- > 1 files changed, 4 insertions(+), 4 deletions(-) > > > diff --git a/Doc/library/socket.rst b/Doc/library/socket.rst > --- a/Doc/library/socket.rst > +++ b/Doc/library/socket.rst > @@ -262,12 +262,12 @@ > method. > > The following example fetches address information for a hypothetical TCP > - connection to ``www.python.org`` on port 80 (results may differ on your > + connection to ``google.com`` on port 80 (results may differ on your > system if IPv6 isn't enabled):: example.org does support IPv6 and IPv4 too, and is not commercial name.

2 1

RM for 3.6?
by Serhiy Storchaka 01 Jun '15

01 Jun '15

Isn't it a time to assign release manager for 3.6-3.7?

8 8

Re: [Python-Dev] [python-committers] Ned Deily is release manager for Python 3.6
by Larry Hastings 01 Jun '15

01 Jun '15

On 06/01/2015 11:09 AM, Barry Warsaw wrote: > Please welcome Ned Deily as RM for Python 3.6. > > https://www.python.org/dev/peps/pep-0494/ We're in good hands. For two versions now Benjamin and Ned have been quietly cleaning up my mistakes after (nearly) every release. My guess is, Ned won't bother making the mistakes in the first place! //arry/

1 0

Python 3 migration status update across some key subcommunities (was Re: 2.7 is here until 2020, please don't call it a waste.)
by Nick Coghlan 01 Jun '15

01 Jun '15

On 31 May 2015 at 19:07, Ludovic Gasc <gmludo(a)gmail.com> wrote: > About Python 3 migration, I think that one of our best control stick is > newcomers, and by extension, Python trainers/teachers. > If newcomers learn first Python 3, when they will start to work > professionally, they should help to rationalize the Python 3 migration > inside existing dev teams, especially because they don't have an interest > conflict based on the fact that they haven't written plenty of code with > Python 2. > 2020 is around the corner, 5 years shouldn't be enough to change the > community mind, I don't know. The education community started switching a while back - if you watch Carrie-Anne Philbin's PyCon UK 2014 keynote, one of her requests for the broader Python community was for everyone else to just catch up already in order to reduce student's confusion (she phrased it more politely than that, though). Educators need to tweak examples and exercises to account for a version switch, but that's substantially easier than migrating hundreds of thousands or even millions of lines of production code. And yes, if you learn Python 3 first, subsequently encountering Python 2's quirks and cruft is likely to encourage folks that know both versions of the language to start advocating for a version upgrade :) After accounting for the "Wow, the existing Python 2 install base is even larger than we realised" factour, the migration is actually in a pretty good place overall these days. The "enterprise" crowd really are likely to be the only ones that might need the full remaining 5 years of migration time (and they may potentially have even more time, if they're relying on a commercial redistributor). Web frameworks have allowed Python 3 development for a while now, and with Django switching their tutorial to Python 3 by default, Django downloads via pip show one of the highest proportions of Python 3 adoption on PyPI. www.python.org itself is now a production Python 3 Django web service, and the next generation of pypi.python.org will be a Pyramid application that's also running on Python 3. The dedicated async/await syntax in 3.5 represents a decent carrot to encourage migration for anyone currently using yield (or yield from) based coroutines, since the distinct syntax not only allows for easier local reasoning about whether something is an iterator or a coroutine, it also provides a much improved user experience for asynchronous iterators and context managers (including finally handling the "asynchronous database transaction as a context manager" case, which previous versions of Python couldn't really do at all). The matrix multiplication operator is similarly a major improvement for the science and data analysis part of the Python community. In terms of reducing *barriers* to adoption, after inviting them to speak at the 2014 language summit, we spent a fair bit of time with the Twisted and Mercurial folks over the past year or so working through "What's still missing from Python 3 for your use cases?", as Python 3.4 was still missing some features for binary data manipulation where we'd been a bit too ruthless in pruning back the binary side of things when deciding what counted as text-only features, and what was applicable to binary data as well. So 3.5 brings back binary interpolation, adds a hex() method to bytes, and adds binary data support directly to a couple of standard library modules (tempfile, difflib). If I understand the situation correctly, the work Guido et al have been doing on PEP 484 and type hinting standardisation is also aimed at reducing barriers to Python 3 adoption, by making it possible to develop better migration tools that are more semantically aware than the existing syntax focused tools. The type hinting actually acts as a carrot as well, since it's a feature that mainly shows its value when attempting to scale a *team* to larger sizes (as it lets you delegate more of the code review process to an automated tool, letting the human reviewers spend more time focusing on higher level semantic concerns). Finally, both Debian/Ubuntu and Fedora are well advanced in their efforts to replace Python 2 with Python 3 in their respective default images (but keeping Py2 available in their package repos). That work is close to finished now (myself, Slavek Kabrda, Barry Warsaw, and Matthias Klose had some good opportunities to discuss that at PyCon), although there are still some significant rough edges to figure out (such as coming up with a coherent cross-platform story for what we're going to do with the Python symlink), as well as a few more key projects to either migrate entirely, or at least finish porting to the source compatible subset of Python 2 & 3 (e.g. Samba). Cheers, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

6 5