Mailman 3 October 2017 - Python-Dev

Summary of Python tracker Issues
by Python tracker Oct. 6, 2017

Oct. 6, 2017

ACTIVITY SUMMARY (2017-09-29 - 2017-10-06) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 6225 (+17) closed 37243 (+62) total 43468 (+79) Open issues with patches: 2393 Issues opened (53) ================== #11063: Rework uuid module: lazy initialization and add a new C extens https://bugs.python.org/issue11063 reopened by haypo #31178: [EASY] subprocess: TypeError: can't concat str to bytes, in _e https://bugs.python.org/issue31178 reopened by haypo #31415: Add -X option to show import time https://bugs.python.org/issue31415 reopened by terry.reedy #31639: http.server and SimpleHTTPServer hang after a few requests https://bugs.python.org/issue31639 opened by mattpr #31640: Document exit() from parse_args https://bugs.python.org/issue31640 opened by CharlesMerriam #31642: None value in sys.modules no longer blocks import https://bugs.python.org/issue31642 opened by christian.heimes #31643: test_uuid: test_getnode and test_windll_getnode fail if connec https://bugs.python.org/issue31643 opened by Ivan.Pozdeev #31645: openssl build fails in win32 if .pl extension is not associate https://bugs.python.org/issue31645 opened by Ivan.Pozdeev #31647: asyncio: StreamWriter write_eof() after close raises mysteriou https://bugs.python.org/issue31647 opened by twisteroid ambassador #31650: implement PEP 552 https://bugs.python.org/issue31650 opened by benjamin.peterson #31652: make install fails: no module _ctypes https://bugs.python.org/issue31652 opened by Dandan Lee #31653: Don't release the GIL if we can acquire a multiprocessing sema https://bugs.python.org/issue31653 opened by Daniel Colascione #31654: ctypes should support atomic operations https://bugs.python.org/issue31654 opened by Daniel Colascione #31655: SimpleNamespace accepts non-string keyword names https://bugs.python.org/issue31655 opened by serhiy.storchaka #31658: xml.sax.parse won't accept path objects https://bugs.python.org/issue31658 opened by craigh #31659: ssl module should not use textwrap for wrapping PEM format. https://bugs.python.org/issue31659 opened by inada.naoki #31660: sys.executable different in os.execv'd python3.6 virtualenv se https://bugs.python.org/issue31660 opened by Stephen Moore #31664: Add support of new crypt methods https://bugs.python.org/issue31664 opened by serhiy.storchaka #31665: Edit "Setting [windows] environmental variables" https://bugs.python.org/issue31665 opened by terry.reedy #31666: Pandas_datareader Error Message - ModuleNotFoundError: No modu https://bugs.python.org/issue31666 opened by Scott Tucholka #31667: Wrong links in the gettext.NullTranslations class https://bugs.python.org/issue31667 opened by linkid #31668: "fixFirefoxAnchorBug" function in doctools.js causes navigatin https://bugs.python.org/issue31668 opened by fireattack #31670: Associate .wasm with application/wasm https://bugs.python.org/issue31670 opened by flagxor #31672: string.Template should use re.ASCII flag https://bugs.python.org/issue31672 opened by inada.naoki #31674: Buildbots: random "Failed to connect to github.com port 443: C https://bugs.python.org/issue31674 opened by haypo #31676: test.test_imp.ImportTests.test_load_source has side effects https://bugs.python.org/issue31676 opened by serhiy.storchaka #31678: Incorrect C Function name for timedelta https://bugs.python.org/issue31678 opened by phobosmir #31680: Expose curses library name and version on Python level https://bugs.python.org/issue31680 opened by serhiy.storchaka #31681: pkgutil.get_data() leaks open files in Python 2.7 https://bugs.python.org/issue31681 opened by Elvis.Pranskevichus #31683: a stack overflow on windows in faulthandler._fatal_error() https://bugs.python.org/issue31683 opened by Oren Milman #31684: Scientific formatting of decimal 0 different from float 0 https://bugs.python.org/issue31684 opened by Aaron.Meurer #31686: GZip library doesn't properly close files https://bugs.python.org/issue31686 opened by Jake Lever #31687: test_semaphore_tracker() of test_multiprocessing_spawn fails r https://bugs.python.org/issue31687 opened by haypo #31690: Make RE "a", "L" and "u" inline flags local https://bugs.python.org/issue31690 opened by serhiy.storchaka #31691: Include missing info on required build steps and how to build https://bugs.python.org/issue31691 opened by Ivan.Pozdeev #31692: [2.7] Test `test_huntrleaks()` of test_regrtest fails in debug https://bugs.python.org/issue31692 opened by ishcherb #31694: Running Windows installer with LauncherOnly=1 should not regis https://bugs.python.org/issue31694 opened by uranusjr #31695: Improve bigmem tests https://bugs.python.org/issue31695 opened by serhiy.storchaka #31698: Add REQ_NAME to the node.h API https://bugs.python.org/issue31698 opened by Jelle Zijlstra #31699: Deadlocks in `concurrent.futures.ProcessPoolExecutor` with pic https://bugs.python.org/issue31699 opened by tomMoral #31700: one-argument version for Generator.typing https://bugs.python.org/issue31700 opened by srittau #31701: faulthandler dumps 'Windows fatal exception: code 0xe06d7363' https://bugs.python.org/issue31701 opened by Fynn Be #31702: Allow to specify the number of rounds for SHA-* hashing in cry https://bugs.python.org/issue31702 opened by serhiy.storchaka #31704: HTTP check lowercase response from proxy https://bugs.python.org/issue31704 opened by alvaromunoz #31705: test_sha256 from test_socket fails on ppc64le arch https://bugs.python.org/issue31705 opened by cstratak #31706: urlencode should accept generator as values for mappings when https://bugs.python.org/issue31706 opened by freitafr #31710: setup.py: _ctypes won't getbuilt when system ffi is only in $P https://bugs.python.org/issue31710 opened by pmpp #31711: ssl.SSLSocket.send(b"") fails https://bugs.python.org/issue31711 opened by joernheissler #31712: subprocess with stderr=subprocess.STDOUT hang https://bugs.python.org/issue31712 opened by l4mer #31713: python3 python-config script generates invalid includes https://bugs.python.org/issue31713 opened by matthewlweber #31714: Improve re documentation https://bugs.python.org/issue31714 opened by serhiy.storchaka #31715: Add mimetype for extension .mjs https://bugs.python.org/issue31715 opened by bradleymeck #31717: Socket documentation threading misstep? https://bugs.python.org/issue31717 opened by apoplexy Most recent 15 issues with no replies (15) ========================================== #31717: Socket documentation threading misstep? https://bugs.python.org/issue31717 #31715: Add mimetype for extension .mjs https://bugs.python.org/issue31715 #31713: python3 python-config script generates invalid includes https://bugs.python.org/issue31713 #31711: ssl.SSLSocket.send(b"") fails https://bugs.python.org/issue31711 #31705: test_sha256 from test_socket fails on ppc64le arch https://bugs.python.org/issue31705 #31704: HTTP check lowercase response from proxy https://bugs.python.org/issue31704 #31702: Allow to specify the number of rounds for SHA-* hashing in cry https://bugs.python.org/issue31702 #31700: one-argument version for Generator.typing https://bugs.python.org/issue31700 #31699: Deadlocks in `concurrent.futures.ProcessPoolExecutor` with pic https://bugs.python.org/issue31699 #31698: Add REQ_NAME to the node.h API https://bugs.python.org/issue31698 #31695: Improve bigmem tests https://bugs.python.org/issue31695 #31691: Include missing info on required build steps and how to build https://bugs.python.org/issue31691 #31687: test_semaphore_tracker() of test_multiprocessing_spawn fails r https://bugs.python.org/issue31687 #31686: GZip library doesn't properly close files https://bugs.python.org/issue31686 #31681: pkgutil.get_data() leaks open files in Python 2.7 https://bugs.python.org/issue31681 Most recent 15 issues waiting for review (15) ============================================= #31715: Add mimetype for extension .mjs https://bugs.python.org/issue31715 #31714: Improve re documentation https://bugs.python.org/issue31714 #31706: urlencode should accept generator as values for mappings when https://bugs.python.org/issue31706 #31691: Include missing info on required build steps and how to build https://bugs.python.org/issue31691 #31690: Make RE "a", "L" and "u" inline flags local https://bugs.python.org/issue31690 #31683: a stack overflow on windows in faulthandler._fatal_error() https://bugs.python.org/issue31683 #31681: pkgutil.get_data() leaks open files in Python 2.7 https://bugs.python.org/issue31681 #31678: Incorrect C Function name for timedelta https://bugs.python.org/issue31678 #31676: test.test_imp.ImportTests.test_load_source has side effects https://bugs.python.org/issue31676 #31672: string.Template should use re.ASCII flag https://bugs.python.org/issue31672 #31670: Associate .wasm with application/wasm https://bugs.python.org/issue31670 #31667: Wrong links in the gettext.NullTranslations class https://bugs.python.org/issue31667 #31664: Add support of new crypt methods https://bugs.python.org/issue31664 #31659: ssl module should not use textwrap for wrapping PEM format. https://bugs.python.org/issue31659 #31645: openssl build fails in win32 if .pl extension is not associate https://bugs.python.org/issue31645 Top 10 most discussed issues (10) ================================= #31654: ctypes should support atomic operations https://bugs.python.org/issue31654 13 msgs #11063: Rework uuid module: lazy initialization and add a new C extens https://bugs.python.org/issue11063 11 msgs #31622: Make threading.get_ident() return an opaque type https://bugs.python.org/issue31622 11 msgs #31672: string.Template should use re.ASCII flag https://bugs.python.org/issue31672 10 msgs #31589: Links for French documentation PDF is broken: LaTeX issue with https://bugs.python.org/issue31589 9 msgs #31630: math.tan has poor accuracy near pi/2 on OpenBSD https://bugs.python.org/issue31630 9 msgs #31619: Strange error when convert hexadecimal with underscores to int https://bugs.python.org/issue31619 7 msgs #31415: Add -X option to show import time https://bugs.python.org/issue31415 6 msgs #31684: Scientific formatting of decimal 0 different from float 0 https://bugs.python.org/issue31684 6 msgs #31583: 2to3 call for file in current directory yields error https://bugs.python.org/issue31583 5 msgs Issues closed (60) ================== #20323: Argument Clinic: docstring_prototype output causes build failu https://bugs.python.org/issue20323 closed by zach.ware #21411: Enable Treat Warning as Error on 32-bit Windows https://bugs.python.org/issue21411 closed by zach.ware #23283: Backport Tools/clinic to 3.4 https://bugs.python.org/issue23283 closed by zach.ware #25153: PCbuild/*.vcxproj* should use CRLF line endings https://bugs.python.org/issue25153 closed by zach.ware #25658: PyThread assumes pthread_key_t is an integer, which is against https://bugs.python.org/issue25658 closed by ncoghlan #27494: 2to3 parser failure caused by a comma after a generator expres https://bugs.python.org/issue27494 closed by benjamin.peterson #29041: Reference leaks on Windows https://bugs.python.org/issue29041 closed by zach.ware #30397: Expose regular expression and match objects types in the re mo https://bugs.python.org/issue30397 closed by serhiy.storchaka #30404: Make stdout and stderr truly unbuffered when using -u option https://bugs.python.org/issue30404 closed by serhiy.storchaka #30406: async and await should be keywords in 3.7 https://bugs.python.org/issue30406 closed by yselivanov #30465: FormattedValue expressions have wrong lineno and col_offset in https://bugs.python.org/issue30465 closed by eric.smith #30872: Update curses docs to Python 3 https://bugs.python.org/issue30872 closed by serhiy.storchaka #31158: test_pty: test_basic() fails randomly on Travis CI https://bugs.python.org/issue31158 closed by haypo #31285: a SystemError and an assertion failure in warnings.warn_explic https://bugs.python.org/issue31285 closed by serhiy.storchaka #31336: Speed up _PyType_Lookup() for class creation https://bugs.python.org/issue31336 closed by serhiy.storchaka #31353: Implement PEP 553 - built-in breakpoint() https://bugs.python.org/issue31353 closed by barry #31460: IDLE: Revise ModuleBrowser API https://bugs.python.org/issue31460 closed by terry.reedy #31478: assertion failure in random.seed() in case the seed argument h https://bugs.python.org/issue31478 closed by serhiy.storchaka #31510: test_many_processes() of test_multiprocessing_spawn failed on https://bugs.python.org/issue31510 closed by haypo #31516: current_thread() becomes "dummy" thread during shutdown https://bugs.python.org/issue31516 closed by pitrou #31540: Adding context in concurrent.futures.ProcessPoolExecutor https://bugs.python.org/issue31540 closed by pitrou #31555: Windows pyd slower when not loaded via load_dynamic https://bugs.python.org/issue31555 closed by steve.dower #31556: asyncio.wait_for can cancel futures faster with timeout==0 https://bugs.python.org/issue31556 closed by yselivanov #31574: Add dtrace hook for importlib https://bugs.python.org/issue31574 closed by lukasz.langa #31581: Reduce the number of imports for functools https://bugs.python.org/issue31581 closed by inada.naoki #31592: assertion failure in Python/ast.c in case of a bad unicodedata https://bugs.python.org/issue31592 closed by serhiy.storchaka #31596: expose pthread_getcpuclockid in time module https://bugs.python.org/issue31596 closed by benjamin.peterson #31602: assertion failure in zipimporter.get_source() in case of a bad https://bugs.python.org/issue31602 closed by brett.cannon #31627: test_mailbox fails if the hostname is empty https://bugs.python.org/issue31627 closed by serhiy.storchaka #31634: Consider installing wheel in ensurepip by default https://bugs.python.org/issue31634 closed by ncoghlan #31638: zipapp module should support compression https://bugs.python.org/issue31638 closed by paul.moore #31641: concurrent.futures.as_completed() no longer accepts arbitrary https://bugs.python.org/issue31641 closed by ned.deily #31644: bug in datetime.datetime.timestamp https://bugs.python.org/issue31644 closed by eric.smith #31646: bug in time.mktime https://bugs.python.org/issue31646 closed by r.david.murray #31648: Improve ElementPath https://bugs.python.org/issue31648 closed by serhiy.storchaka #31649: IDLE: Make _htest, _utest parameters keyword-only. https://bugs.python.org/issue31649 closed by terry.reedy #31651: io.FileIO cannot write more than 2GB (-4096) bytes??? must be https://bugs.python.org/issue31651 closed by benjamin.peterson #31656: Bitwise operations for bytes-type https://bugs.python.org/issue31656 closed by r.david.murray #31657: unit test for optimization levels does not cover __debug__ cas https://bugs.python.org/issue31657 closed by Mariatta #31661: Issues with request rate in robotparser https://bugs.python.org/issue31661 closed by berker.peksag #31662: trivial typos in Tools/msi/uploadrelease.bat https://bugs.python.org/issue31662 closed by steve.dower #31663: pyautogui.typewrite() method doesn't work as expected. https://bugs.python.org/issue31663 closed by terry.reedy #31669: string.Template: code, docs and PEP all disagree on definition https://bugs.python.org/issue31669 closed by serhiy.storchaka #31671: IntFlag makes re.compile slower https://bugs.python.org/issue31671 closed by inada.naoki #31673: Fix the name of Tkinter's adderrorinfo method https://bugs.python.org/issue31673 closed by serhiy.storchaka #31675: Tkinter: memory leak in splitlines() and split() https://bugs.python.org/issue31675 closed by serhiy.storchaka #31677: email.header uses re.IGNORECASE without re.ASCII https://bugs.python.org/issue31677 closed by inada.naoki #31679: pydot missing write, write_png, etc https://bugs.python.org/issue31679 closed by zach.ware #31682: Exception: Cannot import `win32api`! https://bugs.python.org/issue31682 closed by zach.ware #31685: Cannot connect to CE path `127.0.0.1:8010` https://bugs.python.org/issue31685 closed by zach.ware #31688: scope error https://bugs.python.org/issue31688 closed by r.david.murray #31689: random.choices does not work with negative weights https://bugs.python.org/issue31689 closed by rhettinger #31693: Document Py_GETENV https://bugs.python.org/issue31693 closed by barry #31696: don't mention GCC in sys.version when built with Clang https://bugs.python.org/issue31696 closed by benjamin.peterson #31697: Regression in futures.as_completed with ProcessPoolExecutor. https://bugs.python.org/issue31697 closed by coady #31703: [EASY] Running test_builtin twice fails on input tty tests https://bugs.python.org/issue31703 closed by serhiy.storchaka #31707: Irrational fractions https://bugs.python.org/issue31707 closed by mark.dickinson #31708: Allow use of asynchronous generator expressions in synchronous https://bugs.python.org/issue31708 closed by yselivanov #31709: Drop support for asynchronous __aiter__ https://bugs.python.org/issue31709 closed by yselivanov #31716: os.path.isdir returns true for dots https://bugs.python.org/issue31716 closed by morha13

1 0

how/where is open() implemented ?
by Yubin Ruan Oct. 6, 2017

Oct. 6, 2017

Hi, I am looking for the implementation of open() in the src, but so far I am not able to do this. >From my observation, the implementation of open() in python2/3 does not employ the open(2) system call. However without open(2) how can one possibly obtain a file descriptor? Yubin

3 2

PEP 553; the interaction between $PYTHONBREAKPOINT and -E
by Barry Warsaw Oct. 5, 2017

Oct. 5, 2017

Victor brings up a good question in his review of the PEP 553 implementation. https://github.com/python/cpython/pull/3355 https://bugs.python.org/issue31353 The question is whether $PYTHONBREAKPOINT should be ignored if -E is given? I think it makes sense for $PYTHONBREAKPOINT to be sensitive to -E, but in thinking about it some more, it might make better sense for the semantics to be that when -E is given, we treat it like PYTHONBREAKPOINT=0, i.e. disable the breakpoint, rather than fallback to the `pdb.set_trace` default. My thinking is this: -E is often used in production environments to prevent stray environment settings from affecting the Python process. In those environments, you probably also want to prevent stray breakpoints from stopping the process, so it’s more helpful to disable breakpoint processing when -E is given rather than running pdb.set_trace(). If you have a strong opinion either way, please follow up here, on the PR, or on the bug tracker. Cheers, -Barry

6 10

Inheritance vs composition in backcompat (PEP521)
by Koos Zevenhoven Oct. 5, 2017

Oct. 5, 2017

Hi all, It was suggested that I start a new thread, because the other thread drifted away from its original topic. So here, in case someone is interested: On Oct 2, 2017 17:03, "Koos Zevenhoven <k7hoven(a)gmail.com> wrote: On Mon, Oct 2, 2017 at 6:42 AM, Guido van Rossum <guido(a)python.org> wrote: On Sun, Oct 1, 2017 at 1:52 PM, Koos Zevenhoven <k7hoven(a)gmail.com> wrote: On Oct 1, 2017 19:26, "Guido van Rossum" <guido(a)python.org> wrote: Your PEP is currently incomplete. If you don't finish it, it is not even a contender. But TBH it's not my favorite anyway, so you could also just withdraw it. I can withdraw it if you ask me to, but I don't want to withdraw it without any reason. I haven't changed my mind about the big picture. OTOH, PEP 521 is elegant and could be used to implement PEP 555, but 521 is almost certainly less performant and has some problems regarding context manager wrappers that use composition instead of inheritance. It is my understanding that PEP 521 (which proposes to add optional __suspend__ and __resume__ methods to the context manager protocol, to be called whenever a frame is suspended or resumed inside a `with` block) is no longer a contender because it would be way too slow. I haven't read it recently or thought about it, so I don't know what the second issue you mention is about (though it's presumably about the `yield` in a context manager implemented using a generator decorated with `(a)contextlib.contextmanager`). Well, it's not completely unrelated to that. The problem I'm talking about is perhaps most easily seen from a simple context manager wrapper that uses composition instead of inheritance: class Wrapper: def __init__(self): self._wrapped = SomeContextManager() def __enter__(self): print("Entering context") return self._wrapped.__enter__() def __exit__(self): self._wrapped.__exit__() print("Exited context") Now, if the wrapped contextmanager becomes a PEP 521 one with __suspend__ and __resume__, the Wrapper class is broken, because it does not respect __suspend__ and __resume__. So actually this is a backwards compatiblity issue. But if the wrapper is made using inheritance, the problem goes away: class Wrapper(SomeContextManager): def __enter__(self): print("Entering context") return super().__enter__() def __exit__(self): super().__exit__() print("Exited context") Now the wrapper cleanly inherits the new optional __suspend__ and __resume__ from the wrapped context manager type. ––Koos -- + Koos Zevenhoven + http://twitter.com/k7hoven +

3 12

PEP 544
by VERY ANONYMOUS Oct. 4, 2017

Oct. 4, 2017

i want to learn

2 1

[RELEASE] Python 3.6.3 is now available
by Ned Deily Oct. 3, 2017

Oct. 3, 2017

On behalf of the Python development community and the Python 3.6 release team, I am happy to announce the availability of Python 3.6.3, the third maintenance release of Python 3.6. Detailed information about the changes made in 3.6.3 can be found in the change log here: https://docs.python.org/3.6/whatsnew/changelog.html#python-3-6-3-final Please see "What’s New In Python 3.6" for more information about the new features in Python 3.6: https://docs.python.org/3.6/whatsnew/3.6.html You can download Python 3.6.3 here: https://www.python.org/downloads/release/python-363/ The next maintenance release of Python 3.6 is expected to follow in about 3 months, around the end of 2017-12. More information about the 3.6 release schedule can be found here: https://www.python.org/dev/peps/pep-0494/ Enjoy! -- Ned Deily nad(a)python.org -- []

2 1

Make re.compile faster
by INADA Naoki Oct. 3, 2017

Oct. 3, 2017

Before deferring re.compile, can we make it faster? I profiled `import string` and small optimization can make it 2x faster! (but it's not backward compatible) Before optimize: import time: self [us] | cumulative | imported package import time: 2339 | 9623 | string string module took about 2.3 ms to import. I found: * RegexFlag.__and__ and __new__ is called very often. * _optimize_charset is slow, because re.UNICODE | re.IGNORECASE diff --git a/Lib/sre_compile.py b/Lib/sre_compile.py index 144620c6d1..7c662247d4 100644 --- a/Lib/sre_compile.py +++ b/Lib/sre_compile.py @@ -582,7 +582,7 @@ def isstring(obj): def _code(p, flags): - flags = p.pattern.flags | flags + flags = int(p.pattern.flags) | int(flags) code = [] # compile info block diff --git a/Lib/string.py b/Lib/string.py index b46e60c38f..fedd92246d 100644 --- a/Lib/string.py +++ b/Lib/string.py @@ -81,7 +81,7 @@ class Template(metaclass=_TemplateMetaclass): delimiter = '$' idpattern = r'[_a-z][_a-z0-9]*' braceidpattern = None - flags = _re.IGNORECASE + flags = _re.IGNORECASE | _re.ASCII def __init__(self, template): self.template = template patched: import time: 1191 | 8479 | string Of course, this patch is not backward compatible. [a-z] doesn't match with 'ı' or 'ſ' anymore. But who cares? (in sre_compile.py) # LATIN SMALL LETTER I, LATIN SMALL LETTER DOTLESS I (0x69, 0x131), # iı # LATIN SMALL LETTER S, LATIN SMALL LETTER LONG S (0x73, 0x17f), # sſ There are some other `re.I(GNORECASE)` options in stdlib. I'll check them. More optimization can be done with implementing sre_parse and sre_compile in C. But I have no time for it in this year. Regards, -- Inada Naoki <songofacandy(a)gmail.com>

6 8

Re: [Python-Dev] bpo-30806 netrc.__repr__() is broken for writing to file (GH-2491)
by Serhiy Storchaka Oct. 1, 2017

Oct. 1, 2017

30.09.17 10:10, INADA Naoki пише: > https://github.com/python/cpython/commit/b24cd055ecb3eea9a15405a6ca72dafc73… > commit: b24cd055ecb3eea9a15405a6ca72dafc739e6531 > branch: master > author: James Sexton <TwistedLadder(a)gmail.com> > committer: INADA Naoki <methane(a)users.noreply.github.com> > date: 2017-09-30T16:10:31+09:00 > summary: > > bpo-30806 netrc.__repr__() is broken for writing to file (GH-2491) > > netrc file format doesn't support quotes and escapes. > > See https://linux.die.net/man/5/netrc The commit message looks confusing to me. Is netrc.__repr__() is broken now? Or this change makes netrc file format supporting quotes and escapes now? Please read the following thread: https://mail.python.org/pipermail/python-dev/2011-May/111303.html.

1 0