Python-Dev October 2019

python-dev@python.org

55 participants
47 discussions

Re: [RELEASE] Python 3.8.0 is now available

by Glenn Linderman

On 10/14/2019 9:26 PM, Glenn Linderman wrote: > On 10/14/2019 1:23 PM, Łukasz Langa wrote: >> On behalf of the Python development community and the Python 3.8 release team, I’m pleased to announce the availability of Python 3.8.0. > I look forward to using Python 3.8.0. > > However, having installed it, I then needed to install brotli, so I > ran pip install brotli, and that worked, but I was very surprised to > get told: > > You are using pip version 18.1, however version 19.3 is available. > You should consider upgrading via the 'python -m pip install --upgrade > pip' command. > > The upgrade worked, but why would the newest, just-released version of > Python not include the newest version of pip? > > Glenn Hmm. "worked" above only means "completed without reporting errors". Excuse the noise, I accidentally ran Python3.6\Scripts\pip.exe. But now running the one from Python3.8 the error message from pip references pip version 19.2.3 as the "old version", so it is still true that Python 3.8 doesn't seem to include the latest pip. But with the numbers being closer, I suppose that means that pip had a release after the Python 3.8 code freeze. And sadly, I'm too fast at trying to install brotli for 3.8: it apparently doesn't have a wheel yet, so tried to compile from source, and couldn't find a C compiler on my machine.

1 year, 6 months

[RELEASED] Python 3.5.8rc1 is released

by Larry Hastings

On behalf of the Python development community, I'm chuffed to announce the availability of Python 3.5.8rc1. Python 3.5 is in "security fixes only" mode. This new version only contains security fixes, not conventional bug fixes, and it is a source-only release. You can find Python 3.5.8rc1 here: https://www.python.org/downloads/release/python-358rc1/ I think Python 3.5 may just barely outlive 2.7, //arry/

1 year, 6 months

I'm working on the release of Python 3.8.0 right now

by Łukasz Langa

Please hold your breath. Unless you have some last minute blocker, then let me know immediately. - Ł

1 year, 6 months

Summary of Python tracker Issues

by Python tracker

ACTIVITY SUMMARY (2019-10-04 - 2019-10-11) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7068 ( +8) closed 43134 (+71) total 50202 (+79) Open issues with patches: 2807 Issues opened (48) ================== #38373: List overallocation strategy https://bugs.python.org/issue38373 opened by serhiy.storchaka #38374: Remove weakref.ReferenceError entry from documentation https://bugs.python.org/issue38374 opened by mjpieters #38377: test_asyncio.test_events.GetEventLoopTestsMixin.test_get_event https://bugs.python.org/issue38377 opened by mcepl #38378: os.sendfile() has improperly named parameter https://bugs.python.org/issue38378 opened by serhiy.storchaka #38379: finalizer resurrection in gc https://bugs.python.org/issue38379 opened by tim.peters #38380: Update SQLite to 3.30 in Windows and macOS installer builds https://bugs.python.org/issue38380 opened by Big Stone #38381: Possible wordcode optimization for STORE/LOAD pairs https://bugs.python.org/issue38381 opened by rhettinger #38382: statistics.harmonic_mean fails to raise error with negative in https://bugs.python.org/issue38382 opened by WarrenWeckesser #38384: An assertion failure in test_pickle https://bugs.python.org/issue38384 opened by ZackerySpytz #38385: statistics: incorrect documentation https://bugs.python.org/issue38385 opened by lebigot #38387: Document PyDoc_STRVAR https://bugs.python.org/issue38387 opened by bsolomon1124 #38388: Pickle protocol v 5 needs to be documented https://bugs.python.org/issue38388 opened by Dima.Tisnek #38393: building modules from 3.8.0rc1 fails in a venv when system 3.8 https://bugs.python.org/issue38393 opened by pmpp #38394: time.get_clock_info reports "adjustable=False" for implementat https://bugs.python.org/issue38394 opened by Florian Krause #38395: proxy_contains (weakref.proxy) can access an object with 0 ref https://bugs.python.org/issue38395 opened by colesbury #38397: __init_subclass__ causes TypeError when used with more standar https://bugs.python.org/issue38397 opened by retnikt #38401: Make dataclass attribute docstrings accessible https://bugs.python.org/issue38401 opened by John Parejko2 #38403: nuspec iconUrl field is deprecated https://bugs.python.org/issue38403 opened by steve.dower #38410: Possible fatal errors due to _PyEval_SetAsyncGen{Finalizer,Fir https://bugs.python.org/issue38410 opened by ZackerySpytz #38411: SQLITE_MISUSE race condition in sqlite3 is misleadingly raised https://bugs.python.org/issue38411 opened by Jack Robison #38413: Remove or change "Multithreading" section https://bugs.python.org/issue38413 opened by Vladimir Ryabtsev #38415: @asynccontextmanager decorated functions are not callable like https://bugs.python.org/issue38415 opened by fried #38417: Add support for settting umask in subprocess children https://bugs.python.org/issue38417 opened by gregory.p.smith #38418: Audit event for os.system is incorrect https://bugs.python.org/issue38418 opened by steve.dower #38419: The path of check-c-globals.py on README is wrong https://bugs.python.org/issue38419 opened by corona10 #38421: email.utils.parsetime_tz does not return "None" as the tz offs https://bugs.python.org/issue38421 opened by irishsmurf #38422: Clarify docstrings of pathlib suffix(es) https://bugs.python.org/issue38422 opened by cool-RR #38423: Event loop implementation docs advertise set_event_loop which https://bugs.python.org/issue38423 opened by hniksic #38424: typing.Generator shorthand https://bugs.python.org/issue38424 opened by Dima.Tisnek #38427: Issue URL on translated Python docs site is always pointed to https://bugs.python.org/issue38427 opened by zhsj #38428: Can't gracefully ctrl+C multiprocessing pool on Python3 & Wind https://bugs.python.org/issue38428 opened by rebeccafair #38430: Memory leak in ThreadPoolExecutor + run_in_executor https://bugs.python.org/issue38430 opened by Evgeny Nizhibitsky #38431: dataclasses.InitVar breaks with typing.Optional https://bugs.python.org/issue38431 opened by samuelcolvin #38433: 2.7.17rc1 tcl/tk version regression on Windows https://bugs.python.org/issue38433 opened by terry.reedy #38434: sys.addaudithook event is not documented https://bugs.python.org/issue38434 opened by steve.dower #38435: Start the deprecation cycle for subprocess preexec_fn https://bugs.python.org/issue38435 opened by gregory.p.smith #38436: Improved performance for list addition. https://bugs.python.org/issue38436 opened by brandtbucher #38438: argparse "usage" overly-complex with nargs="*" https://bugs.python.org/issue38438 opened by bobjalex #38439: Python needs higher resolution app/menu icons https://bugs.python.org/issue38439 opened by hroncok #38440: Possible new issues with IDLE https://bugs.python.org/issue38440 opened by rhettinger #38443: unavailable --with-universal-archs= macOS confgure options fai https://bugs.python.org/issue38443 opened by ned.deily #38445: os.path.exists() takes bool as argument and returns True https://bugs.python.org/issue38445 opened by Nika #38446: Ambiguous signature for builtins.__build_class__ https://bugs.python.org/issue38446 opened by bup #38447: test_multiprocessing_spawn: Dangling processes: {<SpawnProcess https://bugs.python.org/issue38447 opened by vstinner #38448: test_concurrent_futures: reap_children() reaped child process https://bugs.python.org/issue38448 opened by vstinner #38449: regression - mimetypes guess_type is confused by ; in the file https://bugs.python.org/issue38449 opened by Yaroslav.Halchenko #38450: 3.8 Release Notes: IDLE section dupe https://bugs.python.org/issue38450 opened by srittau #38451: Datetime definition does not work in function definition as li https://bugs.python.org/issue38451 opened by Pouria_ff Most recent 15 issues with no replies (15) ========================================== #38451: Datetime definition does not work in function definition as li https://bugs.python.org/issue38451 #38450: 3.8 Release Notes: IDLE section dupe https://bugs.python.org/issue38450 #38448: test_concurrent_futures: reap_children() reaped child process https://bugs.python.org/issue38448 #38447: test_multiprocessing_spawn: Dangling processes: {<SpawnProcess https://bugs.python.org/issue38447 #38446: Ambiguous signature for builtins.__build_class__ https://bugs.python.org/issue38446 #38434: sys.addaudithook event is not documented https://bugs.python.org/issue38434 #38433: 2.7.17rc1 tcl/tk version regression on Windows https://bugs.python.org/issue38433 #38422: Clarify docstrings of pathlib suffix(es) https://bugs.python.org/issue38422 #38418: Audit event for os.system is incorrect https://bugs.python.org/issue38418 #38415: @asynccontextmanager decorated functions are not callable like https://bugs.python.org/issue38415 #38411: SQLITE_MISUSE race condition in sqlite3 is misleadingly raised https://bugs.python.org/issue38411 #38403: nuspec iconUrl field is deprecated https://bugs.python.org/issue38403 #38388: Pickle protocol v 5 needs to be documented https://bugs.python.org/issue38388 #38387: Document PyDoc_STRVAR https://bugs.python.org/issue38387 #38377: test_asyncio.test_events.GetEventLoopTestsMixin.test_get_event https://bugs.python.org/issue38377 Most recent 15 issues waiting for review (15) ============================================= #38436: Improved performance for list addition. https://bugs.python.org/issue38436 #38431: dataclasses.InitVar breaks with typing.Optional https://bugs.python.org/issue38431 #38422: Clarify docstrings of pathlib suffix(es) https://bugs.python.org/issue38422 #38421: email.utils.parsetime_tz does not return "None" as the tz offs https://bugs.python.org/issue38421 #38419: The path of check-c-globals.py on README is wrong https://bugs.python.org/issue38419 #38418: Audit event for os.system is incorrect https://bugs.python.org/issue38418 #38415: @asynccontextmanager decorated functions are not callable like https://bugs.python.org/issue38415 #38413: Remove or change "Multithreading" section https://bugs.python.org/issue38413 #38410: Possible fatal errors due to _PyEval_SetAsyncGen{Finalizer,Fir https://bugs.python.org/issue38410 #38395: proxy_contains (weakref.proxy) can access an object with 0 ref https://bugs.python.org/issue38395 #38388: Pickle protocol v 5 needs to be documented https://bugs.python.org/issue38388 #38384: An assertion failure in test_pickle https://bugs.python.org/issue38384 #38382: statistics.harmonic_mean fails to raise error with negative in https://bugs.python.org/issue38382 #38380: Update SQLite to 3.30 in Windows and macOS installer builds https://bugs.python.org/issue38380 #38379: finalizer resurrection in gc https://bugs.python.org/issue38379 Top 10 most discussed issues (10) ================================= #38382: statistics.harmonic_mean fails to raise error with negative in https://bugs.python.org/issue38382 10 msgs #38417: Add support for settting umask in subprocess children https://bugs.python.org/issue38417 10 msgs #38430: Memory leak in ThreadPoolExecutor + run_in_executor https://bugs.python.org/issue38430 8 msgs #32561: Add API to io objects for cache-only reads/writes https://bugs.python.org/issue32561 7 msgs #38379: finalizer resurrection in gc https://bugs.python.org/issue38379 7 msgs #38438: argparse "usage" overly-complex with nargs="*" https://bugs.python.org/issue38438 7 msgs #38349: Email example using imaginary library installation error. https://bugs.python.org/issue38349 6 msgs #38380: Update SQLite to 3.30 in Windows and macOS installer builds https://bugs.python.org/issue38380 6 msgs #13322: The io module doesn't support non-blocking files https://bugs.python.org/issue13322 5 msgs #37951: Disallow fork in a subinterpreter broke subprocesses in mod_ws https://bugs.python.org/issue37951 5 msgs Issues closed (62) ================== #14307: Make subclassing SocketServer simpler for non-blocking framewo https://bugs.python.org/issue14307 closed by vstinner #17894: Edits to descriptor howto https://bugs.python.org/issue17894 closed by rhettinger #24560: codecs.StreamReader doesn't work with nonblocking streams: Typ https://bugs.python.org/issue24560 closed by vstinner #25988: collections.abc.Indexable https://bugs.python.org/issue25988 closed by serhiy.storchaka #26292: Raw I/O writelines() broken for non-blocking I/O https://bugs.python.org/issue26292 closed by vstinner #33714: module can set an exception in tp_clear https://bugs.python.org/issue33714 closed by petr.viktorin #34957: Segementation faults on ARM and ARM64 https://bugs.python.org/issue34957 closed by zach.ware #35005: argparse should accept json and yaml argument types https://bugs.python.org/issue35005 closed by rhettinger #35762: subprocess.Popen with universal_newlines and nonblocking strea https://bugs.python.org/issue35762 closed by vstinner #36075: python 2to3 conversion tool is generating file with extra line https://bugs.python.org/issue36075 closed by mark.dickinson #36161: Use thread-safe functions instead of unsafe ones (crypt, ttyna https://bugs.python.org/issue36161 closed by benjamin.peterson #36253: Use after free in ctypes test suite https://bugs.python.org/issue36253 closed by btharper #36698: Shell restart when error message contains non-BMP characters https://bugs.python.org/issue36698 closed by serhiy.storchaka #36953: Remove collections ABCs? https://bugs.python.org/issue36953 closed by serhiy.storchaka #37324: collections: remove deprecated aliases to ABC classes https://bugs.python.org/issue37324 closed by serhiy.storchaka #38014: ./configure on recent macOS versions can fail with multiple "p https://bugs.python.org/issue38014 closed by ned.deily #38109: Missing constants in Lib/stat.py https://bugs.python.org/issue38109 closed by vstinner #38167: O_DIRECT read fails with 4K mmap buffer https://bugs.python.org/issue38167 closed by josh.r #38210: Intersection of dict view with iterator returns empty set https://bugs.python.org/issue38210 closed by serhiy.storchaka #38215: Do not import modules in star-import when __all__ is not defin https://bugs.python.org/issue38215 closed by serhiy.storchaka #38216: Fix for issue30458 (HTTP Header Injection) prevents crafting i https://bugs.python.org/issue38216 closed by larry #38230: A Path Traversal vulnerability in test/ssl_servers.py https://bugs.python.org/issue38230 closed by vstinner #38294: Documentation on 3.6->3.7 re.escape no longer escaping "/" or https://bugs.python.org/issue38294 closed by serhiy.storchaka #38331: Exec not recognizing global variables inside function https://bugs.python.org/issue38331 closed by terry.reedy #38339: [3.5] The doc job of Travis CI fails on Python 3.5: needs at l https://bugs.python.org/issue38339 closed by vstinner #38345: Add end lines to pyclbr objects https://bugs.python.org/issue38345 closed by terry.reedy #38346: Wrong behavior when using `assert_called_with` with mutable ob https://bugs.python.org/issue38346 closed by mariocj89 #38347: pathfix.py does not find Python scripts that have '-' in its f https://bugs.python.org/issue38347 closed by vstinner #38367: test_regrtest hanged on AMD64 Windows10 3.x https://bugs.python.org/issue38367 closed by vstinner #38368: Crash when subclassing ctypes.Union https://bugs.python.org/issue38368 closed by vinay.sajip #38371: Tkinter: deprecate the split() method https://bugs.python.org/issue38371 closed by serhiy.storchaka #38375: Enum lookup fails for callable values https://bugs.python.org/issue38375 closed by ethan.furman #38376: ./configure --with-assertions generates a broken build https://bugs.python.org/issue38376 closed by vstinner #38383: undefined behavior in tailmatch() of bytes_methods.c https://bugs.python.org/issue38383 closed by serhiy.storchaka #38386: ModuleNotFoundError: No module named '_ctypes' https://bugs.python.org/issue38386 closed by ned.deily #38389: Bug on sorted with count key https://bugs.python.org/issue38389 closed by benjamin.peterson #38390: Got a compile warning in dictobject.c https://bugs.python.org/issue38390 closed by serhiy.storchaka #38391: Typo in tutorial code (does not compile) https://bugs.python.org/issue38391 closed by xiang.zhang #38392: Ensure that objects entering the GC are valid https://bugs.python.org/issue38392 closed by vstinner #38396: ast.literal_eval doesn't give information about node except th https://bugs.python.org/issue38396 closed by serhiy.storchaka #38398: PyUnicode functions are not exported by python 2 in Ubuntu https://bugs.python.org/issue38398 closed by vstinner #38399: Error message persists when reimporting library https://bugs.python.org/issue38399 closed by steven.daprano #38400: Python segfaults when configured with --with-pydebug --with-tr https://bugs.python.org/issue38400 closed by pablogsal #38402: crypt: check error from library call https://bugs.python.org/issue38402 closed by benjamin.peterson #38404: spam https://bugs.python.org/issue38404 closed by ned.deily #38405: Nested subclasses of typing.NamedTuple are not pickleable https://bugs.python.org/issue38405 closed by serhiy.storchaka #38406: Missed some public names in help(typing) https://bugs.python.org/issue38406 closed by serhiy.storchaka #38407: Add docstrings for typing.SupportsXXX classes https://bugs.python.org/issue38407 closed by serhiy.storchaka #38408: urlparse gives no method to build a url with a port https://bugs.python.org/issue38408 closed by eric.smith #38409: Typo in doc string for str.strip https://bugs.python.org/issue38409 closed by zach.ware #38412: csv.reader failed to split string with spaces and quoted delim https://bugs.python.org/issue38412 closed by belegnar #38414: Ordering a nested dictionary in python with json format https://bugs.python.org/issue38414 closed by serhiy.storchaka #38416: test_largefile.TestSocketSendfile.test_it() failed with 15 min https://bugs.python.org/issue38416 closed by vstinner #38420: defaultdict does not support parametric lambda https://bugs.python.org/issue38420 closed by steven.daprano #38425: Remove warning: ‘res’ may be used uninitialized in this fu https://bugs.python.org/issue38425 closed by corona10 #38426: declare visit_validate in Py_DEBUG macro https://bugs.python.org/issue38426 closed by vstinner #38429: Failed to compile with --enable-framework on macOS on master https://bugs.python.org/issue38429 closed by vstinner #38432: ZeroDivisionError when inf is expected https://bugs.python.org/issue38432 closed by vstinner #38437: Set GC_DEBUG for debug builds of the interpreter https://bugs.python.org/issue38437 closed by pablogsal #38441: failing to build the Documentation https://bugs.python.org/issue38441 closed by ned.deily #38442: Doc/whatsnew/3.8.rst has an execution bit https://bugs.python.org/issue38442 closed by serhiy.storchaka #38444: dataclass: always generate default __init__ on __default_init_ https://bugs.python.org/issue38444 closed by eric.smith

1 year, 6 months

non-standard dlerror declaration in _ctypes/darwin/dlfcn.h?

by Patrick Stinson

The extern declaration for dlerror() in _ctypes/darwin/dlfcn.h does not match the declaration in the macOS 10.4/10.5 SDK, causing a compile error for dlfcn_simple.c for statically linking the interpreter and modules (for example with pyqtdeploy). The line in question is in the following snippet. Changing "extern const char *dlerror" to "extern char *dlerror" fixes the problem. What is the rationale for the current "const char *" declaration when the macOS SDK and GNU spec uses "char *"? #if MAC_OS_X_VERSION_MIN_REQUIRED <= MAC_OS_X_VERSION_10_2 #warning CTYPES_DARWIN_DLFCN #define CTYPES_DARWIN_DLFCN extern void * (*ctypes_dlopen)(const char *path, int mode); extern void * (*ctypes_dlsym)(void * handle, const char *symbol); extern const char * (*ctypes_dlerror)(void); extern int (*ctypes_dlclose)(void * handle); extern int (*ctypes_dladdr)(const void *, Dl_info *); #else extern void * dlopen(const char *path, int mode); extern void * dlsym(void * handle, const char *symbol); extern const char * dlerror(void); extern int dlclose(void * handle); extern int dladdr(const void *, Dl_info *); #endif Cheers!

1 year, 6 months

non-standard dlerror declaration in _ctypes/darwin/dlfcn.h?

by patrickkidd＠gmail.com

1 year, 6 months

Migrate typing in builtin

by Philippe Prados

Hello, I try to implement a *proof of concept* of Pep-0604 <https://www.python.org/dev/peps/pep-0604/>. To do this, the _GenericAlias must be in builtin, because I would like to update issubclass() and isinstance() to accept Union. These methods are in builtin, and must be run without others modules. But, the class _GenericAlias is in typing module, with the Python implementation in Lib/typing.py, and the C implementation is in Modules/_ctypes. For you, what is the best approach to move the _GenericAlias and all dependencies in the builtin "module" ? Philippe

1 year, 6 months

[RELEASE] Python 2.7.17 release candidate 1

by Benjamin Peterson

The first release candidate of Python 2.7.17 is now available for download and testing. Python 2.7.17 includes 80 fixes over Python 2.7.16. Downloads may be found on python.org: https://www.python.org/downloads/release/python-2717rc1/ Read the full changelog at: https://raw.githubusercontent.com/python/cpython/1c7b14197b10924e2efc1e6c99… As always with prereleases, please test your applications and libraries and report bugs to: https://bugs.python.org/ A final release is scheduled to follow in 12 days. PEP 373, the Python 2.7 release schedule, calls for 2.7.17 to be the penultimate bug fix release of the Python 2.7 series. Time for Python 2 is running low! Regards, Benjamin 2.7 release manager

1 year, 6 months

Python Profilers documentation - typo?

by Rob Cliffe

The documentation at https://docs.python.org/3.2/library/profile.html contains the sentence For example, if your_integer_time_func() returns times measured in thousands of seconds, you would construct the Profile instance as follows: "thousands of seconds" should ISTM be "thousandths of a second". There is essentially the same thing in the Python 2 docs at https://docs.python.org/2/library/profile.html viz. For example, if the timer returns times measured in _thousands_ of seconds, the time unit would be |.001|. Just trying for perfection! Best wishes Rob Cliffe

1 year, 6 months

PEP 587 (Python Initialization Configuration) updated to be future proof again

by Victor Stinner

Hi, I dislike having to do that, but I had to make a last minute change in my PEP 587 "Python Initialization Configuration" to allow to modify the structure in the future without breaking the backward compatibility. I added a "struct_size" field to PyPreConfig and PyConfig: * https://bugs.python.org/issue38304 * https://github.com/python/peps/commit/afa38c0bef7738b8fcc3173daee8488e04208… The example: PyConfig config; PyStatus status = PyConfig_InitPythonConfig(&config); ... must now be written: PyConfig config; config.struct_size = sizeof(PyConfig); PyStatus status = PyConfig_InitPythonConfig(&config); ... At the beginning, I used a private "_config_version" field which was initialized statically by a macro. But it was decided to replace macros with functions. I only noticed today that the conversion to function broke the API/ABI future compatibility. PyConfig_InitPythonConfig() got uninitialized memory and didn't know the size of the config variable. With my change, the function now requires the "struct_size" field to be set, and so it can support internally different versions of the PyConfig structure. Storing the structure size directly in the structure is a common practice in the Windows API which is a good example of long term ABI compatibility. -- By the way, last week, Pablo Galindo Salgado reported to me a regression in PyInstaller caused by the implementation of my PEP. I fixed different issues related to the "Path Configuration" (sys.path in short), but I also added a lot of tests for this code. Previously, there was simply no test on the path configuration! I added a lot of comments to the C code, and I completed the public documentation: https://docs.python.org/dev/c-api/init_config.html#path-configuration Please test the incoming Python 3.8.0rc1 release with your project if you embed Python into your application. Please test also projects like PyInstaller, PyOxidizer, etc. Note: PyInstaller requires my fix for 3.8 (not merged yet): https://github.com/pyinstaller/pyinstaller/pull/4440 Victor -- Night gathers, and now my watch begins. It shall not end until my death.

1 year, 6 months

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

Python-Dev October 2019