Mailman 3 September 2017 - Python-Dev

pythonhosted.org doc upload no longer works
by Giampaolo Rodola' 20 Sep '17

20 Sep '17

I know pythonhosted.org was deprecated long ago in favor of readthedocs but I kept postponing it and my doc for psutil is still hosted on https://pythonhosted.org/psutil/. http://pythonhosted.org/ web page still recommends this: <<To upload documentation, go to your package edit page ( http://pypi.python.org/pypi?%3Aaction=pkg_edit&name=yourpackage), and fill out the form at the bottom of the page.>> I took a look at: https://pypi.python.org/pypi?:action=pkg_edit&name=psutil ...but the form to upload the doc in zip format is gone. The only available option is the "destroy documentation" button. I would like to at least upload a static HTML page redirecting to the new doc which I will soon move on readthedocs. Is that possible? Thanks in advance. -- Giampaolo - http://grodola.blogspot.com

3 2

Does Cygwin still have broken slot initialization?
by Stefan Krah 20 Sep '17

20 Sep '17

Hi, The docs have this rule for slot initialization for the benefit of Cygwin: https://github.com/python/cpython/commit/db6a569de7ae595ada53b618fce6bbbd1c… Synopsis -------- - PyType_GenericNew, /* tp_new */ + noddy_NoddyType.tp_new = PyType_GenericNew; + if (PyType_Ready(&noddy_NoddyType) < 0) + return; This is absolutely not required by C99 (and probably never was). 'PyType_GenericNew' is an address constant, and MSVC supports it just fine -- at least since VS 2008. Does anyone know if Cygwin still misbehaves? I would like to get rid of this arcane rule. https://bugs.python.org/issue31443 Stefan Krah

1 0

PEP 553, v3
by Barry Warsaw 19 Sep '17

19 Sep '17

Here’s an update to PEP 553, which makes $PYTHONBREAKPOINT a first class feature. I’ve also updated PR #3355 with the implementation to match. Cheers, -Barry PEP: 553 Title: Built-in breakpoint() Author: Barry Warsaw <barry(a)python.org> Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 2017-09-05 Python-Version: 3.7 Post-History: 2017-09-05, 2017-09-07, 2017-09-13 Abstract ======== This PEP proposes adding a new built-in function called ``breakpoint()`` which enters a Python debugger at the point of the call. Additionally, two new names are added to the ``sys`` module to make the debugger pluggable. Rationale ========= Python has long had a great debugger in its standard library called ``pdb``. Setting a break point is commonly written like this:: foo() import pdb; pdb.set_trace() bar() Thus after executing ``foo()`` and before executing ``bar()``, Python will enter the debugger. However this idiom has several disadvantages. * It's a lot to type (27 characters). * It's easy to typo. The PEP author often mistypes this line, e.g. omitting the semicolon, or typing a dot instead of an underscore. * It ties debugging directly to the choice of pdb. There might be other debugging options, say if you're using an IDE or some other development environment. * Python linters (e.g. flake8 [linters]_) complain about this line because it contains two statements. Breaking the idiom up into two lines further complicates the use of the debugger, These problems can be solved by modeling a solution based on prior art in other languages, and utilizing a convention that already exists in Python. Proposal ======== The JavaScript language provides a ``debugger`` statement [java]_ which enters the debugger at the point where the statement appears. This PEP proposes a new built-in function called ``breakpoint()`` which enters a Python debugger at the call site. Thus the example above would be written like so:: foo() breakpoint() bar() Further, this PEP proposes two new name bindings for the ``sys`` module, called ``sys.breakpointhook()`` and ``sys.__breakpointhook__``. By default, ``sys.breakpointhook()`` implements the actual importing and entry into ``pdb.set_trace()``, and it can be set to a different function to change the debugger that ``breakpoint()`` enters. ``sys.__breakpointhook__`` then stashes the default value of ``sys.breakpointhook()`` to make it easy to reset. This exactly models the existing ``sys.displayhook()`` / ``sys.__displayhook__`` and ``sys.excepthook()`` / ``sys.__excepthook__`` [hooks]_. The signature of the built-in is ``breakpoint(*args, **kws)``. The positional and keyword arguments are passed straight through to ``sys.breakpointhook()`` and the signatures must match or a ``TypeError`` will be raised. The return from ``sys.breakpointhook()`` is passed back up to, and returned from ``breakpoint()``. Since ``sys.breakpointhook()`` by default calls ``pdb.set_trace()`` by default it accepts no arguments. Environment variable ==================== The default implementation of ``sys.breakpointhook()`` consults a new environment variable called ``PYTHONBREAKPOINT``. This environment variable can have various values: * ``PYTHONBREAKPOINT=0`` disables debugging. Specifically, with this value ``sys.breakpointhook()`` returns ``None`` immediately. * ``PYTHONBREAKPOINT= `` (i.e. the empty string). This is the same as not setting the environment variable at all, in which case ``pdb.set_trace()`` is run as usual. * ``PYTHONBREAKPOINT=some.importable.callable``. In this case, ``sys.breakpointhook()`` imports the ``some.importable`` module and gets the ``callable`` object from the resulting module, which it then calls. The value may be a string with no dots, in which case it names a built-in callable, e.g. ``PYTHONBREAKPOINT=int``. (Guido has expressed the preference for normal Python dotted-paths, not setuptools-style entry point syntax [syntax]_.) This environment variable allows external processes to control how breakpoints are handled. Some uses cases include: * Completely disabling all accidental ``breakpoint()`` calls pushed to production. This could be accomplished by setting ``PYTHONBREAKPOINT=0`` in the execution environment. Another suggestion by reviewers of the PEP was to set ``PYTHONBREAKPOINT=sys.exit`` in this case. * IDE integration with specialized debuggers for embedded execution. The IDE would run the program in its debugging environment with ``PYTHONBREAKPOINT`` set to their internal debugging hook. ``PYTHONBREAKPOINT`` is re-interpreted every time ``sys.breakpointhook()`` is reached. This allows processes to change its value during the execution of a program and have ``breakpoint()`` respond to those changes. It is not considered a performance critical section since entering a debugger by definition stops execution. (Of note, the implementation fast-tracks the ``PYTHONBREAKPOINT=0`` case.) Overriding ``sys.breakpointhook`` defeats the default consultation of ``PYTHONBREAKPOINT``. It is up to the overriding code to consult ``PYTHONBREAKPOINT`` if they want. If access to the ``PYTHONBREAKPOINT`` callable fails in any way (e.g. the import fails, or the resulting module does not contain the callable), a ``RuntimeWarning`` is issued, and no breakpoint function is called. Open issues =========== Confirmation from other debugger vendors ---------------------------------------- We want to get confirmation from at least one alternative debugger implementation (e.g. PyCharm) that the hooks provided in this PEP will be useful to them. Evaluation of $PYTHONBREAKPOINT ------------------------------- There has been some mailing list discussion around this topic. The basic behavior as described above does not appear to be controversial. Guido has expressed a preference for ``$PYTHONBREAKPOINT`` consultation happening in the default implementation of ``sys.breakpointhook`` [envar]_. The one point of discussion relates to whether the value of ``$PYTHONBREAKPOINT`` should be loaded on interpreter start, and whether its value should be cached the first time it's accessed. It is the PEP author's opinion that the environment variable need only be looked up at the time of use. It is also the author's opinion that the value of the environment variable can be accessed each time ``sys.breakpointhook`` is run, to allow for maximum functional flexibility. Because this feature enters the debugger, any performance improvements for caching will be negligible and do not outweigh the flexibility. Further, because the special case of ``PYTHONBREAKPOINT=0`` is fast-tracked, the no-op code path is quite fast, and should be in the noise given the function calls of ``breakpoint()`` -> ``sys.breakpointhook()``. Breakpoint bytecode ------------------- Related, there has been an idea to add a bytecode that calls ``sys.breakpointhook()``. Whether built-in ``breakpoint()`` emits this bytecode (or gets peephole optimized to the bytecode) is an open issue. The bytecode is useful for debuggers that actively modify bytecode streams to trampoline into their own debugger. Having a "breakpoint" bytecode might allow them to avoid bytecode modification in order to invoke this trampoline. *NOTE*: It probably makes sense to split this idea into a separate PEP. Call a fancier object by default -------------------------------- Some folks want to be able to use other ``pdb`` interfaces such as ``pdb.pm()``. Although this is a less commonly used API, it could be supported by binding ``sys.breakpointhook`` to an object that implements ``__call__()``. Calling this object would call ``pdb.set_trace()``, but the object could expose other methods, such as ``pdb.pm()``, making invocation of it as handy as ``breakpoint.pm()``. Implementation ============== A pull request exists with the proposed implementation [impl]_. Rejected alternatives ===================== A new keyword ------------- Originally, the author considered a new keyword, or an extension to an existing keyword such as ``break here``. This is rejected on several fronts. * A brand new keyword would require a ``__future__`` to enable it since almost any new keyword could conflict with existing code. This negates the ease with which you can enter the debugger. * An extended keyword such as ``break here``, while more readable and not requiring a ``__future__`` would tie the keyword extension to this new feature, preventing more useful extensions such as those proposed in PEP 548. * A new keyword would require a modified grammar and likely a new bytecode. Each of these makes the implementation more complex. A new built-in breaks no existing code (since any existing module global would just shadow the built-in) and is quite easy to implement. sys.breakpoint() ---------------- Why not ``sys.breakpoint()``? Requiring an import to invoke the debugger is explicitly rejected because ``sys`` is not imported in every module. That just requires more typing and would lead to:: import sys; sys.breakpoint() which inherits several of the problems this PEP aims to solve. Version History =============== * 2017-09-13 * The ``PYTHONBREAKPOINT`` environment variable is made a first class feature. * 2017-09-07 * ``debug()`` renamed to ``breakpoint()`` * Signature changed to ``breakpoint(*args, **kws)`` which is passed straight through to ``sys.breakpointhook()``. References ========== .. [linters] http://flake8.readthedocs.io/en/latest/ .. [java] https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Statement… .. [hooks] https://docs.python.org/3/library/sys.html#sys.displayhook .. [syntax] http://setuptools.readthedocs.io/en/latest/setuptools.html?highlight=consol… .. [impl] https://github.com/python/cpython/pull/3355 .. [envar] https://mail.python.org/pipermail/python-dev/2017-September/149447.html Copyright ========= This document has been placed in the public domain. .. Local Variables: mode: indented-text indent-tabs-mode: nil sentence-end-double-space: t fill-column: 70 coding: utf-8 End:

2 2

[RELEASE] Python 3.6.3rc1 and 3.7.0a1 are now available for testing and more
by Ned Deily 19 Sep '17

19 Sep '17

The Python build factories have been busy the last several weeks preparing our fall lineup of releases. Today we are happy to announce three additions: 3.6.3rc1, 3.7.0a1, and 3.3.7 final, which join last weekend's 2.7.14 and last month's 3.5.4 bug-fix releases and 3.4.7 security-fix update (https://www.python.org/downloads/). 1. Python 3.6.3rc1 is the first release candidate for Python 3.6.3, the next maintenance release of Python 3.6. While 3.6.3rc1 is a preview release and, thus, not intended for production environments, we encourage you to explore it and provide feedback via the Python bug tracker (https://bugs.python.org). 3.6.3 is planned for final release on 2017-10-02 with the next maintenance release expected to follow in about 3 months. You can find Python 3.6.3rc1 and more information here: https://www.python.org/downloads/release/python-363rc1/ 2. Python 3.7.0a1 is the first of four planned alpha releases of Python 3.7, the next feature release of Python. During the alpha phase, Python 3.7 remains under heavy development: additional features will be added and existing features may be modified or deleted. Please keep in mind that this is a preview release and its use is not recommended for production environments. The next preview release, 3.6.0a2, is planned for 2017-10-16. You can find Python 3.7.0a1 and more information here: https://www.python.org/downloads/release/python-370a1/ 3. Python 3.3.7 is also now available. It is a security-fix source-only release and is expected to be the final release of any kind for Python 3.3.x before it reaches end-of-life status on 2017-09-29, five years after its initial release. Because 3.3.x has long been in security-fix mode, 3.3.7 may no longer build correctly on all current operating system releases and some tests may fail. If you are still using Python 3.3.x, we **strongly** encourage you to upgrade now to a more recent, fully supported version of Python 3. You can find Python 3.3.7 here: https://www.python.org/downloads/release/python-337/ -- Ned Deily nad(a)python.org -- []

1 0

Why aren't decorators just expressions?
by Larry Hastings 18 Sep '17

18 Sep '17

The syntax for decorators in the grammar is quite specific: decorator: '@' dotted_name [ '(' [arglist] ')' ] NEWLINE Decorators can be either a dotted name, or a dotted name followed by arguments. This disallows: @mapping['async'] # looking something up in a mapping @func(1, 2, 3).async # getting the attribute of the /result/ of a function call Obviously these restrictions haven't been too burdensome, as I've labored under them for 13+ years and didn't even notice until just now. But it set me to wondering. If it were me, perpetually lazy sod that I am, I'd have written the grammar as decorator: '@' expr NEWLINE and been done with it. So why don't decorators allow arbitrary expressions? The PEP discusses the syntax for decorators, but that whole debate only concerned itself with where the decorator goes relative to "def", and what funny punctuation might it use. It never says "decorators shouldn't permit arbitrary expressions because--". Nor is there any info on wiki page with the extensive summary of alternative syntax proposals. Anybody remember? I'm not proposing that we allow arbitrary expressions as decorators... well, I'm not doing that /yet/ at least. But like I said, the syntax has been this way for 13 years and I don't recall anybody complaining. //arry /p.s. I experimentally tried modifying the grammar for descriptors to allow arbitrary expressions. The syntax was fine but it crashed in ast_for_decorator(). When I updated that to match, it worked fine! The diff is short and mainly consists of deleted code.

9 8

PEP 554 v2 (new "interpreters" module)
by Eric Snow 17 Sep '17

17 Sep '17

I've updated the PEP in response to some excellent feedback. Thanks to all who helped. Most notably, I've added a basic object passing mechanism. I've included the PEP below. Please let me know what you think. Thanks! -eric **************************************************** PEP: 554 Title: Multiple Interpreters in the Stdlib Author: Eric Snow <ericsnowcurrently(a)gmail.com> Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 2017-09-05 Python-Version: 3.7 Post-History: Abstract ======== This proposal introduces the stdlib ``interpreters`` module. It exposes the basic functionality of subinterpreters that already exists in the C-API. Each subinterpreter runs with its own state (see ``Interpreter Isolation`` below). The module will be "provisional", as described by PEP 411. Rationale ========= Running code in multiple interpreters provides a useful level of isolation within the same process. This can be leveraged in number of ways. Furthermore, subinterpreters provide a well-defined framework in which such isolation may extended. CPython has supported subinterpreters, with increasing levels of support, since version 1.5. While the feature has the potential to be a powerful tool, subinterpreters have suffered from neglect because they are not available directly from Python. Exposing the existing functionality in the stdlib will help reverse the situation. This proposal is focused on enabling the fundamental capability of multiple isolated interpreters in the same Python process. This is a new area for Python so there is relative uncertainly about the best tools to provide as companions to subinterpreters. Thus we minimize the functionality we add in the proposal as much as possible. Concerns -------- * "subinterpreters are not worth the trouble" Some have argued that subinterpreters do not add sufficient benefit to justify making them an official part of Python. Adding features to the language (or stdlib) has a cost in increasing the size of the language. So it must pay for itself. In this case, subinterpreters provide a novel concurrency model focused on isolated threads of execution. Furthermore, they present an opportunity for changes in CPython that will allow simulateous use of multiple CPU cores (currently prevented by the GIL). Alternatives to subinterpreters include threading, async, and multiprocessing. Threading is limited by the GIL and async isn't the right solution for every problem (nor for every person). Multiprocessing is likewise valuable in some but not all situations. Direct IPC (rather than via the multiprocessing module) provides similar benefits but with the same caveat. Notably, subinterpreters are not intended as a replacement for any of the above. Certainly they overlap in some areas, but the benefits of subinterpreters include isolation and (potentially) performance. In particular, subinterpreters provide a direct route to an alternate concurrency model (e.g. CSP) which has found success elsewhere and will appeal to some Python users. That is the core value that the ``interpreters`` module will provide. * "stdlib support for subinterpreters adds extra burden on C extension authors" In the ``Interpreter Isolation`` section below we identify ways in which isolation in CPython's subinterpreters is incomplete. Most notable is extension modules that use C globals to store internal state. PEP 3121 and PEP 489 provide a solution for most of the problem, but one still remains. [petr-c-ext]_ Until that is resolved, C extension authors will face extra difficulty to support subinterpreters. Consequently, projects that publish extension modules may face an increased maintenance burden as their users start using subinterpreters, where their modules may break. This situation is limited to modules that use C globals (or use libraries that use C globals) to store internal state. Ultimately this comes down to a question of how often it will be a problem in practice: how many projects would be affected, how often their users will be affected, what the additional maintenance burden will be for projects, and what the overall benefit of subinterpreters is to offset those costs. The position of this PEP is that the actual extra maintenance burden will be small and well below the threshold at which subinterpreters are worth it. Proposal ======== The ``interpreters`` module will be added to the stdlib. It will provide a high-level interface to subinterpreters and wrap the low-level ``_interpreters`` module. The proposed API is inspired by the ``threading`` module. The module provides the following functions: ``list()``:: Return a list of all existing interpreters. ``get_current()``:: Return the currently running interpreter. ``get_main()``:: Return the main interpreter. ``create()``:: Initialize a new Python interpreter and return it. The interpreter will be created in the current thread and will remain idle until something is run in it. The module also provides the following classes: ``Interpreter(id)``:: id: The interpreter's ID (read-only). is_running(): Return whether or not the interpreter is currently executing code. destroy(): Finalize and destroy the interpreter. If called on a running interpreter then raise RuntimeError in the interpreter that called ``destroy()``. run(code): Run the provided Python code in the interpreter, in the current OS thread. If the interpreter is already running then raise RuntimeError in the interpreter that called ``run()``. The current interpreter (which called ``run()``) will block until the subinterpreter finishes running the requested code. Any uncaught exception in that code will bubble up to the current interpreter. Supported code: source text. get_fifo(name): Return the FIFO object with the given name that is associated with this interpreter. If no such FIFO exists then raise KeyError. The FIFO will be either a "FIFOReader" or a "FIFOWriter", depending on which "add_*_fifo()" was called. list_fifos(): Return a list of all fifos associated with the interpreter. add_recv_fifo(name=None): Create a new FIFO, associate the two ends with the involved interpreters, and return the side associated with the interpreter in which "add_recv_fifo()" was called. A FIFOReader gets tied to this interpreter. A FIFOWriter gets tied to the interpreter that called "add_recv_fifo()". The FIFO's name is set to the provided value. If no name is provided then a dynamically generated one is used. If a FIFO with the given name is already associated with this interpreter (or with the one in which "add_recv_fifo()" was called) then raise KeyError. add_send_fifo(name=None): Create a new FIFO, associate the two ends with the involved interpreters, and return the side associated with the interpreter in which "add_recv_fifo()" was called. A FIFOWriter gets tied to this interpreter. A FIFOReader gets tied to the interpreter that called "add_recv_fifo()". The FIFO's name is set to the provided value. If no name is provided then a dynamically generated one is used. If a FIFO with the given name is already associated with this interpreter (or with the one in which "add_send_fifo()" was called) then raise KeyError. remove_fifo(name): Drop the association between the named FIFO and this interpreter. If the named FIFO is not found then raise KeyError. ``FIFOReader(name)``:: The receiving end of a FIFO. An interpreter may use this to receive objects from another interpreter. At first only bytes and None will be supported. name: The FIFO's name. __next__(): Return the next bytes object from the pipe. If none have been pushed on then block. pop(*, block=True): Return the next bytes object from the pipe. If none have been pushed on and "block" is True (the default) then block. Otherwise return None. ``FIFOWriter(name)``:: The sending end of a FIFO. An interpreter may use this to send objects to another interpreter. At first only bytes and None will be supported. name: The FIFO's name. push(object, *, block=True): Add the object to the FIFO. If "block" is true then block until the object is popped off. If the FIFO does not support the object's type then TypeError is raised. About FIFOs ----------- Subinterpreters are inherently isolated (with caveats explained below), in contrast to threads. This enables a different concurrency model than currently exists in Python. CSP (Communicating Sequential Processes), upon which Go's concurrency is based, is one example of this model. A key component of this approach to concurrency is message passing. So providing a message/object passing mechanism alongside ``Interpreter`` is a fundamental requirement. This proposal includes a basic mechanism upon which more complex machinery may be built. That basic mechanism draws inspiration from pipes, queues, and CSP's channels. The key challenge here is that sharing objects between interpreters faces complexity due in part to CPython's current memory model. Furthermore, in this class of concurrency, the ideal is that objects only exist in one interpreter at a time. However, this is not practical for Python so we initially constrain supported objects to ``bytes`` and ``None``. There are a number of strategies we may pursue in the future to expand supported objects and object sharing strategies. Note that the complexity of object sharing increases as subinterpreters become more isolated, e.g. after GIL removal. So the mechanism for message passing needs to be carefully considered. Keeping the API minimal and initially restricting the supported types helps us avoid further exposing any underlying complexity to Python users. Deferred Functionality ====================== In the interest of keeping this proposal minimal, the following functionality has been left out for future consideration. Note that this is not a judgement against any of said capability, but rather a deferment. That said, each is arguably valid. Interpreter.call() ------------------ It would be convenient to run existing functions in subinterpreters directly. ``Interpreter.run()`` could be adjusted to support this or a ``call()`` method could be added:: Interpreter.call(f, *args, **kwargs) This suffers from the same problem as sharing objects between interpreters via queues. The minimal solution (running a source string) is sufficient for us to get the feature out where it can be explored. timeout arg to pop() and push() ------------------------------- Typically functions that have a ``block`` argument also have a ``timeout`` argument. We can add it later if needed. Interpreter Isolation ===================== CPython's interpreters are intended to be strictly isolated from each other. Each interpreter has its own copy of all modules, classes, functions, and variables. The same applies to state in C, including in extension modules. The CPython C-API docs explain more. [c-api]_ However, there are ways in which interpreters share some state. First of all, some process-global state remains shared, like file descriptors. There are no plans to change this. Second, some isolation is faulty due to bugs or implementations that did not take subinterpreters into account. This includes things like at-exit handlers and extension modules that rely on C globals. In these cases bugs should be opened (some are already). Finally, some potential isolation is missing due to the current design of CPython. This includes the GIL and memory management. Improvements are currently going on to address gaps in this area. Provisional Status ================== The new ``interpreters`` module will be added with "provisional" status (see PEP 411). This allows Python users to experiment with the feature and provide feedback while still allowing us to adjust to that feedback. The module will be provisional in Python 3.7 and we will make a decision before the 3.8 release whether to keep it provisional, graduate it, or remove it. References ========== .. [c-api] https://docs.python.org/3/c-api/init.html#bugs-and-caveats .. [petr-c-ext] https://mail.python.org/pipermail/import-sig/2016-June/001062.html https://mail.python.org/pipermail/python-ideas/2016-April/039748.html Copyright ========= This document has been placed in the public domain.

9 21

[RELEASE] Python 2.7.14
by Benjamin Peterson 16 Sep '17

16 Sep '17

I'm happy to announce to the immediate availability of Python 2.7.14, yet another bug fix release in the Python 2.7 series. 2.7.14 includes 9 months of conservative bug fixes from the 3.x branch. Downloads of source code and binaries are at: https://www.python.org/downloads/release/python-2714/ Bugs may be reported at https://bugs.python.org/ Warmly, Benjamin 2.7 release manager (on behalf of all of 2.7's contributors)

1 0

Summary of Python tracker Issues
by Python tracker 15 Sep '17

15 Sep '17

ACTIVITY SUMMARY (2017-09-08 - 2017-09-15) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 6171 (+22) closed 37065 (+68) total 43236 (+90) Open issues with patches: 2349 Issues opened (59) ================== #28411: Eliminate PyInterpreterState.modules. https://bugs.python.org/issue28411 reopened by eric.snow #31370: Remove support for threads-less builds https://bugs.python.org/issue31370 reopened by Arfrever #31398: TypeError: gdbm key must be string, not unicode https://bugs.python.org/issue31398 opened by sam-s #31399: Let OpenSSL verify hostname and IP address https://bugs.python.org/issue31399 opened by christian.heimes #31404: undefined behavior and crashes in case of a bad sys.modules https://bugs.python.org/issue31404 opened by Oren Milman #31405: shutil.which doesn't find files without PATHEXT extension on W https://bugs.python.org/issue31405 opened by rmccampbell7 #31410: int.__repr__() is slower than repr() https://bugs.python.org/issue31410 opened by serhiy.storchaka #31412: wave.open does not accept PathLike objects https://bugs.python.org/issue31412 opened by mscuthbert #31414: IDLE: Entry tests should delete before insert. https://bugs.python.org/issue31414 opened by terry.reedy #31415: Add -X option to show import time https://bugs.python.org/issue31415 opened by inada.naoki #31419: Can not install python3.6.2 due to Error 0x80070643: Failed to https://bugs.python.org/issue31419 opened by fernado #31422: tkinter.messagebox and tkinter.filedialog don't show default b https://bugs.python.org/issue31422 opened by jcrmatos #31423: Error while building PDF documentation https://bugs.python.org/issue31423 opened by mdk #31424: test_socket hangs on x86 Gentoo Installed with X 3.x https://bugs.python.org/issue31424 opened by haypo #31425: Expose AF_QIPCRTR in socket module https://bugs.python.org/issue31425 opened by Bjorn Andersson #31426: [3.5] crash in gen_traverse(): gi_frame.ob_type=NULL, called b https://bugs.python.org/issue31426 opened by iwienand #31427: Proposed addition to Windows FAQ https://bugs.python.org/issue31427 opened by Stephan Houben #31429: TLS cipher suite compile time option for downstream https://bugs.python.org/issue31429 opened by christian.heimes #31430: [Windows][2.7] Python 2.7 compilation fails on mt.exe crashing https://bugs.python.org/issue31430 opened by haypo #31431: SSL: check_hostname should imply CERT_REQUIRED https://bugs.python.org/issue31431 opened by christian.heimes #31432: Documention for CERT_OPTIONAL is misleading https://bugs.python.org/issue31432 opened by christian.heimes #31436: test_socket.SendfileUsingSendfileTest.testWithTimeoutTriggered https://bugs.python.org/issue31436 opened by bmoyles #31440: wrong default module search path in help message https://bugs.python.org/issue31440 opened by xiang.zhang #31441: Descriptor example in documentation is confusing, possibly wro https://bugs.python.org/issue31441 opened by Benjamin Wohlwend #31442: assertion failures on Windows in Python/traceback.c in case of https://bugs.python.org/issue31442 opened by Oren Milman #31443: Possibly out of date C extension documentation https://bugs.python.org/issue31443 opened by Romuald #31445: Index out of range in get of message.EmailMessage.get() https://bugs.python.org/issue31445 opened by Michala #31446: _winapi.CreateProcess (used by subprocess) is not thread-safe https://bugs.python.org/issue31446 opened by evan_ #31447: proc communicate not exiting on python subprocess timeout usin https://bugs.python.org/issue31447 opened by Leonardo Francalanci #31449: Potential DoS Attack when Parsing Email with Huge Number of MI https://bugs.python.org/issue31449 opened by ckossmann #31450: Subprocess exceptions re-raised in parent process do not have https://bugs.python.org/issue31450 opened by msekletar #31451: PYTHONHOME is not absolutized https://bugs.python.org/issue31451 opened by xiang.zhang #31452: asyncio.gather does not cancel tasks if one fails https://bugs.python.org/issue31452 opened by Andrew Lytvyn #31453: Debian Sid/Buster: Cannot enable TLS 1.0/1.1 with PROTOCOL_TLS https://bugs.python.org/issue31453 opened by adrianv #31454: Include "import as" in tutorial https://bugs.python.org/issue31454 opened by svenyonson #31455: ElementTree.XMLParser() mishandles exceptions https://bugs.python.org/issue31455 opened by scoder #31456: SimpleCookie fails to parse any cookie if an entry has whitesp https://bugs.python.org/issue31456 opened by Adam Davis #31458: Broken link to Misc/NEWS in What's New page https://bugs.python.org/issue31458 opened by Mariatta #31459: IDLE: Remane Class Browser as Module Browser https://bugs.python.org/issue31459 opened by terry.reedy #31460: IDLE: Revise ModuleBrowser API https://bugs.python.org/issue31460 opened by terry.reedy #31461: IDLE: Enhance class browser https://bugs.python.org/issue31461 opened by terry.reedy #31463: test_multiprocessing_fork hangs test_subprocess https://bugs.python.org/issue31463 opened by benjamin.peterson #31465: Allow _PyType_Lookup() to raise exceptions https://bugs.python.org/issue31465 opened by scoder #31466: No easy way to change float formatting when subclassing encode https://bugs.python.org/issue31466 opened by qpeter #31468: os.path.samefile fails on windows network drive https://bugs.python.org/issue31468 opened by Daniel Sauer #31470: Py_Initialize documentation wrong https://bugs.python.org/issue31470 opened by Jim.Jewett #31472: "Emulating callable objects" documentation misleading https://bugs.python.org/issue31472 opened by nmarrow #31473: PyMem_Raw* API in debug mode are not thread safe https://bugs.python.org/issue31473 opened by xiang.zhang #31474: [2.7] Fix -Wnonnull and -Wint-in-bool-context warnings https://bugs.python.org/issue31474 opened by christian.heimes #31475: Bug in argparse - not supporting utf8 https://bugs.python.org/issue31475 opened by Ali Razmjoo #31476: "Open Module..." Not Working in IDLE for Standard Library https://bugs.python.org/issue31476 opened by Zero #31477: IDLE 'strip trailing whitespace' changes the value of multilin https://bugs.python.org/issue31477 opened by bup #31478: assertion failure in random.seed() in case the seed argument h https://bugs.python.org/issue31478 opened by Oren Milman #31479: Always reset the signal alarm in tests https://bugs.python.org/issue31479 opened by haypo #31481: telnetlib fails to read continous large output from Windows Te https://bugs.python.org/issue31481 opened by nisar009 #31482: random.seed() doesn't work with bytes and version=1 https://bugs.python.org/issue31482 opened by serhiy.storchaka #31483: ButtonPress event not firing until button release Python 3.6.1 https://bugs.python.org/issue31483 opened by HobbyScript #31484: Cache single-character strings outside of the Latin1 range https://bugs.python.org/issue31484 opened by serhiy.storchaka #31485: Tkinter widget.unbind(sequence, funcid) unbind all bindings https://bugs.python.org/issue31485 opened by j-4321-i Most recent 15 issues with no replies (15) ========================================== #31484: Cache single-character strings outside of the Latin1 range https://bugs.python.org/issue31484 #31482: random.seed() doesn't work with bytes and version=1 https://bugs.python.org/issue31482 #31481: telnetlib fails to read continous large output from Windows Te https://bugs.python.org/issue31481 #31477: IDLE 'strip trailing whitespace' changes the value of multilin https://bugs.python.org/issue31477 #31476: "Open Module..." Not Working in IDLE for Standard Library https://bugs.python.org/issue31476 #31474: [2.7] Fix -Wnonnull and -Wint-in-bool-context warnings https://bugs.python.org/issue31474 #31473: PyMem_Raw* API in debug mode are not thread safe https://bugs.python.org/issue31473 #31472: "Emulating callable objects" documentation misleading https://bugs.python.org/issue31472 #31470: Py_Initialize documentation wrong https://bugs.python.org/issue31470 #31468: os.path.samefile fails on windows network drive https://bugs.python.org/issue31468 #31466: No easy way to change float formatting when subclassing encode https://bugs.python.org/issue31466 #31463: test_multiprocessing_fork hangs test_subprocess https://bugs.python.org/issue31463 #31461: IDLE: Enhance class browser https://bugs.python.org/issue31461 #31460: IDLE: Revise ModuleBrowser API https://bugs.python.org/issue31460 #31459: IDLE: Remane Class Browser as Module Browser https://bugs.python.org/issue31459 Most recent 15 issues waiting for review (15) ============================================= #31484: Cache single-character strings outside of the Latin1 range https://bugs.python.org/issue31484 #31479: Always reset the signal alarm in tests https://bugs.python.org/issue31479 #31478: assertion failure in random.seed() in case the seed argument h https://bugs.python.org/issue31478 #31474: [2.7] Fix -Wnonnull and -Wint-in-bool-context warnings https://bugs.python.org/issue31474 #31466: No easy way to change float formatting when subclassing encode https://bugs.python.org/issue31466 #31458: Broken link to Misc/NEWS in What's New page https://bugs.python.org/issue31458 #31455: ElementTree.XMLParser() mishandles exceptions https://bugs.python.org/issue31455 #31452: asyncio.gather does not cancel tasks if one fails https://bugs.python.org/issue31452 #31432: Documention for CERT_OPTIONAL is misleading https://bugs.python.org/issue31432 #31431: SSL: check_hostname should imply CERT_REQUIRED https://bugs.python.org/issue31431 #31429: TLS cipher suite compile time option for downstream https://bugs.python.org/issue31429 #31415: Add -X option to show import time https://bugs.python.org/issue31415 #31414: IDLE: Entry tests should delete before insert. https://bugs.python.org/issue31414 #31412: wave.open does not accept PathLike objects https://bugs.python.org/issue31412 #31410: int.__repr__() is slower than repr() https://bugs.python.org/issue31410 Top 10 most discussed issues (10) ================================= #31234: Make support.threading_cleanup() stricter https://bugs.python.org/issue31234 31 msgs #31265: Remove doubly-linked list from C OrderedDict https://bugs.python.org/issue31265 13 msgs #31453: Debian Sid/Buster: Cannot enable TLS 1.0/1.1 with PROTOCOL_TLS https://bugs.python.org/issue31453 12 msgs #31336: Speed up _PyType_Lookup() for class creation https://bugs.python.org/issue31336 11 msgs #31447: proc communicate not exiting on python subprocess timeout usin https://bugs.python.org/issue31447 11 msgs #31370: Remove support for threads-less builds https://bugs.python.org/issue31370 8 msgs #29505: Submit the re, json, & csv modules to oss-fuzz testing https://bugs.python.org/issue29505 7 msgs #31454: Include "import as" in tutorial https://bugs.python.org/issue31454 7 msgs #31233: socketserver.ThreadingMixIn leaks running threads after server https://bugs.python.org/issue31233 6 msgs #31404: undefined behavior and crashes in case of a bad sys.modules https://bugs.python.org/issue31404 6 msgs Issues closed (65) ================== #15427: Describe use of args parameter of argparse.ArgumentParser.pars https://bugs.python.org/issue15427 closed by Mariatta #17085: test_socket crashes the whole test suite https://bugs.python.org/issue17085 closed by haypo #19985: Not so correct error message when initializing Struct with ill https://bugs.python.org/issue19985 closed by xiang.zhang #23508: Document & unittest the subprocess.getstatusoutput() status va https://bugs.python.org/issue23508 closed by gregory.p.smith #23669: test_socket.NonBlockingTCPTests failing due to race condition https://bugs.python.org/issue23669 closed by haypo #25684: ttk.OptionMenu radiobuttons aren't unique between two instance https://bugs.python.org/issue25684 closed by Mariatta #27099: IDLE: turn built-in extensions into regular modules https://bugs.python.org/issue27099 closed by terry.reedy #27354: SSLContext.load_verify_locations cannot handle paths on Window https://bugs.python.org/issue27354 closed by christian.heimes #28182: Expose OpenSSL verification results in SSLError https://bugs.python.org/issue28182 closed by christian.heimes #29631: Error “importlib.h, importlib_external.h updated. You will n https://bugs.python.org/issue29631 closed by zach.ware #29718: Fixed compile on cygwin. https://bugs.python.org/issue29718 closed by Decorater #29767: build python failed on test_socket due to unused_port is actua https://bugs.python.org/issue29767 closed by haypo #30246: fix several error messages in struct https://bugs.python.org/issue30246 closed by xiang.zhang #30313: Tests of Python 2.7 VS9.0 buildbots must be run with -uall -rw https://bugs.python.org/issue30313 closed by haypo #30389: distutils._msvccompiler cannot find VS 2017 https://bugs.python.org/issue30389 closed by steve.dower #30830: test_logging leaks dangling threads on FreeBSD https://bugs.python.org/issue30830 closed by haypo #30860: Consolidate stateful C globals under a single struct. https://bugs.python.org/issue30860 closed by eric.snow #30918: Unable to launch IDLE in windows 7 https://bugs.python.org/issue30918 closed by terry.reedy #31022: ERROR: testRegularFile (test.test_socket.SendfileUsingSendTest https://bugs.python.org/issue31022 closed by haypo #31128: Allow pydoc to run with an arbitrary hostname https://bugs.python.org/issue31128 closed by merwok #31164: test_functools: test_recursive_pickle() stack overflow on x86 https://bugs.python.org/issue31164 closed by haypo #31258: [2.7] Enhance support reap_children() and threading_cleanup() https://bugs.python.org/issue31258 closed by haypo #31259: [3.6] Enhance support reap_children() and threading_cleanup() https://bugs.python.org/issue31259 closed by haypo #31260: [2.7] Enhance PC/VS9.0/ project to produce python.bat, as PCbu https://bugs.python.org/issue31260 closed by zach.ware #31294: ZeroMQSocketListener and ZeroMQSocketHandler examples in the L https://bugs.python.org/issue31294 closed by christian.heimes #31320: test_ssl logs a traceback https://bugs.python.org/issue31320 closed by haypo #31323: test_ssl: reference cycle between ThreadedEchoServer and its C https://bugs.python.org/issue31323 closed by haypo #31338: Use abort() for code we never expect to hit https://bugs.python.org/issue31338 closed by barry #31345: Backport docstring improvements to the C version of OrderedDic https://bugs.python.org/issue31345 closed by Mariatta #31354: Fixing a bug related to LTO only build https://bugs.python.org/issue31354 closed by gregory.p.smith #31361: Update feedparser.py to prevent theano compiling fail in pytho https://bugs.python.org/issue31361 closed by serhiy.storchaka #31395: Docs Downloads are 404s https://bugs.python.org/issue31395 closed by ned.deily #31396: Configure and make will fail with enabling --with-pydebug https://bugs.python.org/issue31396 closed by christian.heimes #31397: does not work import in Python 3.6.2 https://bugs.python.org/issue31397 closed by r.david.murray #31400: SSL module returns incorrect error codes on Windows https://bugs.python.org/issue31400 closed by christian.heimes #31401: Dynamic compilation that uses function in comprehension fails https://bugs.python.org/issue31401 closed by r.david.murray #31402: Python won't load on Acer Aspire https://bugs.python.org/issue31402 closed by terry.reedy #31403: Remove WITHOUT_THREADS from _decimal https://bugs.python.org/issue31403 closed by skrah #31406: crashes when comparing between a Decimal object and a bad Rati https://bugs.python.org/issue31406 closed by skrah #31407: --without-pymalloc broken https://bugs.python.org/issue31407 closed by eric.snow #31408: Leak in typeobject.c https://bugs.python.org/issue31408 closed by skrah #31409: Implement PEP 559 - built-in noop() https://bugs.python.org/issue31409 closed by barry #31411: SystemError raised by warn_explicit() in case warnings.oncereg https://bugs.python.org/issue31411 closed by serhiy.storchaka #31413: Support importing anything in ._pth files. https://bugs.python.org/issue31413 closed by steve.dower #31416: assertion failures in warn_explicit() in case of a bad warning https://bugs.python.org/issue31416 closed by serhiy.storchaka #31417: Use the enumerate function where appropriate https://bugs.python.org/issue31417 closed by serhiy.storchaka #31418: assertion failure in PyErr_WriteUnraisable() in case of an exc https://bugs.python.org/issue31418 closed by serhiy.storchaka #31420: Reference leaks introduced by bpo-30860 https://bugs.python.org/issue31420 closed by eric.snow #31421: IDLE doc: add section on developing tkinter apps. https://bugs.python.org/issue31421 closed by terry.reedy #31428: ElementTree.Element.__deepcopy__() raises a SystemError in cas https://bugs.python.org/issue31428 closed by serhiy.storchaka #31433: Impossible download python 3.6.2 and 2.7 documentation (html) https://bugs.python.org/issue31433 closed by berker.peksag #31434: [3.6] Python/random.c:128:17: warning: implicit declaration of https://bugs.python.org/issue31434 closed by haypo #31435: Addition giving incorrect result in certain circumstances https://bugs.python.org/issue31435 closed by skrah #31437: test_socket.SendfileUsingSendfileTest.testWithTimeoutTriggered https://bugs.python.org/issue31437 closed by bmoyles #31438: IDLE 3 crashes and quits when caret character typed https://bugs.python.org/issue31438 closed by karakoyun #31439: WindowsError: [Error 2] The system cannot find the file specif https://bugs.python.org/issue31439 closed by zach.ware #31444: ResourceWarning in Python/traceback.c in case of a bad io.Text https://bugs.python.org/issue31444 closed by haypo #31448: test_poplib started to log a lot of ResourceWarning warnings o https://bugs.python.org/issue31448 closed by haypo #31457: LoggerAdapter objects cannot be nested https://bugs.python.org/issue31457 closed by lukasz.langa #31462: Remove trailing whitespaces https://bugs.python.org/issue31462 closed by serhiy.storchaka #31464: Remove trailing spaces from Python-ast.h https://bugs.python.org/issue31464 closed by serhiy.storchaka #31467: cElementTree behaves differently compared to ElementTree https://bugs.python.org/issue31467 closed by poojariravi #31469: Running inside docker container from non-root user https://bugs.python.org/issue31469 closed by r.david.murray #31471: assertion failure in subprocess.Popen() in case the env arg ha https://bugs.python.org/issue31471 closed by serhiy.storchaka #31480: IDLE: disable ZzDummy, revise tests to match https://bugs.python.org/issue31480 closed by terry.reedy

1 0

parallelizing
by Matthieu Bec 13 Sep '17

13 Sep '17

There are times when you deal with completely independent input/output 'pipes' - where parallelizing would really help speed things up. Can't there be a way to capture that idiom and multi thread it in the language itself? Example: loop: read an XML produce a JSON like Regards, MB

2 3

A reminder for PEP owners
by Guido van Rossum 13 Sep '17

13 Sep '17

I know there's a lot of excitement around lots of new ideas. And the 3.7 feature freeze is looming (January is in a few months). But someone has to review and accept all those PEPs, and I can't do it all by myself. If you want your proposal to be taken seriously, you need to include a summary of the discussion on the mailing list (including objections, even if you disagree!) in your PEP, e.g. as an extended design rationale or under the Rejected Ideas heading. If you don't do this you risk having to repeat yourself -- also you risk having your PEP rejected, because at this point there's no way I am going to read all the discussions. -- --Guido van Rossum (python.org/~guido <http://python.org/%7Eguido>)

2 1

Python-Dev September 2017