Python-Dev November 2019

python-dev@python.org

57 participants
38 discussions

by Benjamin Peterson

Hi all, It's finally time to schedule the last releases in Python 2's life. There will be two more releases of Python 2.7: Python 2.7.17 and Python 2.7.18. Python 2.7.17 release candidate 1 will happen on October 5th followed by the final release on October 19th. I'm going to time Python 2.7.18 to coincide with PyCon 2020 in April, so attendees can enjoy some collective catharsis. We'll still say January 1st is the official EOL date. Thanks to Sumana Harihareswara, there's now a FAQ about the Python 2 sunset on the website: https://www.python.org/doc/sunset-python-2/ Regards, Benjamin

3 months, 3 weeks

Last call for comments on PEP 573 (Module State Access from C Extension Methods)

by Stefan Behnel

Hi all, I think that PEP 573 is ready to be accepted, to greatly improve the state of extension modules in CPython 3.9. https://www.python.org/dev/peps/pep-0573/ It has come a long way since the original proposal and went through several iterations and discussions by various interested people, effectively reducing its scope quite a bit. So this is the last call for comments on the latest version of the PEP, before I will pronounce on it. Please keep the discussion in this thread. Stefan

5 months

Stalemate on bringing back PEP 523 support into Python 3.8

by Brett Cannon

An unfortunate side-effect of making PyInterpreterState in Python 3.8 opaque is it removed [PEP 523](https://www.python.org/dev/peps/pep-0523/) support. https://www.python.org/dev/peps/pep-0523/ was opened to try and fix this, but there seems to be a stalemate in the issue. A key question is at what API level should setting the frame evaluation function live at? No one is suggesting the stable ABI, but there isn't agreement between CPython or the internal API (there's also seems to be a suggestion to potentially remove PEP 523 support entirely). And regardless of either, there also seems to be a disagreement about providing getters and setters to continue to try and hide PyInterpreterState regardless of which API level support is provided at (if any). If you have an opinion please weight in on the issue.

5 months

About "python-porting" mail list

by Facundo Batista

Hello! This list (which I co-admin, with Georg) is getting less and less traffic as months pass by. See: https://mail.python.org/pipermail/python-porting/ The interwebs has been collecting ton of resources about porting py2 to 3 during these years. Any not-yet-answered question surely can be done in a list with more participants. Can we kill this list? Thanks! Regards, -- . Facundo Blog: http://www.taniquetil.com.ar/plog/ PyAr: http://www.python.org.ar/ Twitter: @facundobatista

6 months, 3 weeks

Requesting PR review on locale module

by Cédric Krier

Hi, Few months ago, I submitted a PR [1] for the bpo [2] about locale.format casting Decimal into float. Has someone some times to finish the review? This change is blocking a bugfix on Tryton [3]. [1] https://github.com/python/cpython/pull/15275 [2] https://bugs.python.org/issue34311 [3] https://bugs.tryton.org/issue8574 Thanks, -- Cédric Krier - B2CK SPRL Email/Jabber: cedric.krier(a)b2ck.com Tel: +32 472 54 46 59 Website: http://www.b2ck.com/

7 months

Travis CI for backports not working.

by Terry Reedy

Travis passed https://github.com/python/cpython/pull/17366 but a half hour later twice failed https://github.com/python/cpython/pull/17370 https://github.com/python/cpython/pull/17371 saying pyenv: python3.8: command not found pyenv: version `3.7.1' not installed -- Terry Jan Reedy

7 months, 3 weeks

Adding a toml module to the standard lib?

by Bastian Venthur

Hi, I'd like to discuss the idea to add a module to parse TOML [toml-lang] to Python's standard library. PEP-0518 -- Specifying Minimum Build System Requirements for Python Projects [pep] suggests to store build system dependencies in `pyproject.toml`, yet Python itself does not support this format. Various packaging related projects like pip and pipenv already support PEP-0518 and vendored one of the existing TOML libraries in order to read `pyproject.toml` files. Besides that, TOML seems a better alternative to .cfg/.ini, .json -- both of which are already supported by Python's standard lib and parsing/dumping TOML properly is tricky enough to solve it properly [requirements]. There are a couple of TOML implementations out there [toml, pytoml, tomlkit] and one would have to find out which one to prefer and migrate into the stdlib. If the result of this discussion is leaning towards adding TOML, I'd volunteer to do it. This includes: coordinating with the maintainer of the chosen library, writing the PEP (hopefully with some help) and maintain the module for at least two years. Cheers, Bastian [toml-lang]: https://github.com/toml-lang/toml [pep]: https://www.python.org/dev/peps/pep-0518 [pip]: https://github.com/pypa/pip [pipenv]: https://github.com/pypa/pipenv [toml]: https://github.com/uiri/toml [pytoml]: https://github.com/avakar/pytoml [tomlkit]: https://github.com/sdispater/tomlkit [requirements]: https://devguide.python.org/stdlibchanges/#requirements -- Dr. Bastian Venthur http://venthur.de Debian Developer venthur at debian org

7 months, 3 weeks

Should we require all deprecations to have a removal version that we follow through on?

by Brett Cannon

What do people think of the idea of requiring all deprecations specifying a version that the feature will be removed in (which under our annual release cadence would be at least the third release from the start of the deprecation, hence the deprecation being public for 2 years)? And that we also follow through with that removal? Now I'm not suggesting it **must** be in three feature releases. A deprecation could be set to Python 4 if people truly feel keeping the code is as easy it gets in terms of maintenance and there's enough usage to warrant such a potential indefinite deprecation/maintenance while keeping the code and docs alive (basically "there are better ways to do this, but this works fine, too, if you were already using it"). But what I am trying to avoid is the semi-regular discussion we seem to have of what is or is not reasonable to deprecate and leave versus deprecate and eventually remove because we didn't specify what the eventual plan was for a deprecation. Also feel like it would help users to know specifically what the plan is with a deprecation rather than wondering if something will get removed in the next feature release or not because we left off a specific removal version. If people are amenable to this idea I will update PEP 387 (which I plan to start a discussion about post-SC election) and I would also plan to add a warnings._deprecate() which I roughly outlined once at https://discuss.python.org/t/pendingdeprecationwarning-is-really-useful/103….

8 months

Fun with Python 3.8 and Qt

by Kacvinsky, Tom

Today I discovered the this struct typedef struct{ const char* name; int basicsize; int itemsize; unsigned int flags; PyType_Slot *slots; /* terminated by slot==0. */ } PyType_Spec; with "PyTypeSlot *slots" being on line 190 of object.h causes a problem when compiled with code that brings in Qt. Qt has macro definitions of slots. With a cursory preprocessing of the file I was working with, using the handy gcc options -dM -E, I found that slots was defined to nothing #define slots and hence caused problems when object.h was brought into the mix. I will try to make a simple reproducer tomorrow. I know this probably could be solved by header file inclusion re-ordering, or in some cases #undef'ing slots before including Python.h, but I also thought the Python dev team would like to know about this issue. Tom

8 months

Summary of Python tracker Issues

by Python tracker

ACTIVITY SUMMARY (2019-11-22 - 2019-11-29) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7170 ( -1) closed 43522 (+47) total 50692 (+46) Open issues with patches: 2823 Issues opened (23) ================== #38270: Tests: Avoid MD5 or check for MD5 availablity https://bugs.python.org/issue38270 reopened by petr.viktorin #38901: Add a CLI flag to venv to use the pwd basename as the prompt https://bugs.python.org/issue38901 opened by brett.cannon #38902: image/webp support in mimetypes https://bugs.python.org/issue38902 opened by leecatball #38903: #if 0 block on parsetok.c https://bugs.python.org/issue38903 opened by eamanu #38904: "signal only works in main thread" in main thread https://bugs.python.org/issue38904 opened by Richard Warfield #38905: venv python reports wrong sys.executable in a subprocess on Wi https://bugs.python.org/issue38905 opened by uranusjr #38906: copy2 doesn't copy metadata on Windows and MacOS https://bugs.python.org/issue38906 opened by greggman #38907: Add IPv6 Dual-Stack control for http.server https://bugs.python.org/issue38907 opened by zkonge #38908: Troubles with @runtime_checkable protocols https://bugs.python.org/issue38908 opened by levkivskyi #38912: test_asyncio altered the execution environment https://bugs.python.org/issue38912 opened by pablogsal #38913: Py_BuildValue("(s#O)", ...) segfaults if entered with exceptio https://bugs.python.org/issue38913 opened by danielen #38914: Clarify wording for warning message when checking a package https://bugs.python.org/issue38914 opened by jugmac00 #38916: Remove array.fromstring https://bugs.python.org/issue38916 opened by corona10 #38918: Add __module__ entry for function type in inspect docs table. https://bugs.python.org/issue38918 opened by eric.snow #38920: Audit events for unhandled exceptions https://bugs.python.org/issue38920 opened by steve.dower #38921: Max Recursion Depth Reached in Logging Library https://bugs.python.org/issue38921 opened by joy #38924: pathlib paths .normalize() https://bugs.python.org/issue38924 opened by iciocirlan #38926: MacOS: 'Install certificates.command' has no effect https://bugs.python.org/issue38926 opened by Jeff Berkowitz #38932: unittest.mock.Mock.reset_mocks does not pass all arguments to https://bugs.python.org/issue38932 opened by vegarsti #38936: fatal error during installation 0x80070643 during python insta https://bugs.python.org/issue38936 opened by kiranmai velishala #38937: NameError in list comprehension within .pth file https://bugs.python.org/issue38937 opened by Chris Billington #38938: Iterable merge performance and inclusion in itertools https://bugs.python.org/issue38938 opened by Dennis Sweeney #38941: xml.etree.ElementTree.Element inconsistent warning for bool https://bugs.python.org/issue38941 opened by philiprowlands Most recent 15 issues with no replies (15) ========================================== #38926: MacOS: 'Install certificates.command' has no effect https://bugs.python.org/issue38926 #38918: Add __module__ entry for function type in inspect docs table. https://bugs.python.org/issue38918 #38912: test_asyncio altered the execution environment https://bugs.python.org/issue38912 #38903: #if 0 block on parsetok.c https://bugs.python.org/issue38903 #38902: image/webp support in mimetypes https://bugs.python.org/issue38902 #38887: test_asyncio: test_pipe_handle() failed on AMD64 Windows7 SP1 https://bugs.python.org/issue38887 #38886: permissions too restrictive in zipfile.writestr https://bugs.python.org/issue38886 #38883: Path.home() should ignore HOME env var like os.path.expanduser https://bugs.python.org/issue38883 #38880: Subinterpreters: List interpreters associated with a channel e https://bugs.python.org/issue38880 #38879: Reordered error checking in PyArena_New(). https://bugs.python.org/issue38879 #38872: Document exec symbol for codeop.compile_command https://bugs.python.org/issue38872 #38867: Enable Tkinter on Windows ARM https://bugs.python.org/issue38867 #38860: GenericPyCData_new does not invoke new or init https://bugs.python.org/issue38860 #38856: wait_closed() can raise ConnectionResetError https://bugs.python.org/issue38856 #38851: UDPLITE tests fail on android https://bugs.python.org/issue38851 Most recent 15 issues waiting for review (15) ============================================= #38937: NameError in list comprehension within .pth file https://bugs.python.org/issue38937 #38932: unittest.mock.Mock.reset_mocks does not pass all arguments to https://bugs.python.org/issue38932 #38920: Audit events for unhandled exceptions https://bugs.python.org/issue38920 #38918: Add __module__ entry for function type in inspect docs table. https://bugs.python.org/issue38918 #38914: Clarify wording for warning message when checking a package https://bugs.python.org/issue38914 #38907: Add IPv6 Dual-Stack control for http.server https://bugs.python.org/issue38907 #38903: #if 0 block on parsetok.c https://bugs.python.org/issue38903 #38886: permissions too restrictive in zipfile.writestr https://bugs.python.org/issue38886 #38880: Subinterpreters: List interpreters associated with a channel e https://bugs.python.org/issue38880 #38878: os.PathLike subclasshook causes subclass checks true on abstra https://bugs.python.org/issue38878 #38870: Expose ast.unparse in the ast module https://bugs.python.org/issue38870 #38858: new_interpreter() should reuse more Py_InitializeFromConfig() https://bugs.python.org/issue38858 #38854: Decorator breaks inspect.getsource https://bugs.python.org/issue38854 #38852: test_recursion_limit in test_threading crashes with SIGSEGV on https://bugs.python.org/issue38852 #38848: compileall fails when the platform lacks a functional sem_ope https://bugs.python.org/issue38848 Top 10 most discussed issues (10) ================================= #38905: venv python reports wrong sys.executable in a subprocess on Wi https://bugs.python.org/issue38905 17 msgs #38916: Remove array.fromstring https://bugs.python.org/issue38916 8 msgs #37224: test__xxsubinterpreters fails randomly https://bugs.python.org/issue37224 7 msgs #35003: Provide an option to venv to put files in a bin/ directory on https://bugs.python.org/issue35003 6 msgs #38021: Modify AIX platform_tag so it provides PEP425 needs https://bugs.python.org/issue38021 6 msgs #38547: test_pty fails when using setsid() https://bugs.python.org/issue38547 6 msgs #38895: performance degradation creating a mock object (by factor 7-8) https://bugs.python.org/issue38895 6 msgs #38861: zipfile: Corrupts filenames containing non-UTF8 characters https://bugs.python.org/issue38861 5 msgs #38878: os.PathLike subclasshook causes subclass checks true on abstra https://bugs.python.org/issue38878 5 msgs #38924: pathlib paths .normalize() https://bugs.python.org/issue38924 5 msgs Issues closed (48) ================== #7980: time.strptime not thread safe https://bugs.python.org/issue7980 closed by brett.cannon #20928: xml.etree.ElementInclude does not include nested xincludes https://bugs.python.org/issue20928 closed by scoder #21063: Touch up one-line descriptions of modules for module index https://bugs.python.org/issue21063 closed by brett.cannon #26730: SpooledTemporaryFile rollover corrupts data silently when Unic https://bugs.python.org/issue26730 closed by inada.naoki #27145: long_add and long_sub might return a new int where &small_ints https://bugs.python.org/issue27145 closed by inada.naoki #37073: clarify functions docs in IO modules and Bytes Objects https://bugs.python.org/issue37073 closed by inada.naoki #38328: Speed up the creation time of constant list and set literals. https://bugs.python.org/issue38328 closed by inada.naoki #38446: Ambiguous signature for builtins.__build_class__ https://bugs.python.org/issue38446 closed by pablogsal #38483: [venv] Add ~/.venvrc to change module defaults https://bugs.python.org/issue38483 closed by cooperlees #38524: functools.cached_property is not supported for setattr https://bugs.python.org/issue38524 closed by taleinat #38686: WWW-Authenticate qop="auth,auth-int" rejected by urllib https://bugs.python.org/issue38686 closed by orsenthil #38688: Python 3.8 regression: endless loop in shutil.copytree https://bugs.python.org/issue38688 closed by giampaolo.rodola #38803: test_wait3 and test_wait4 leaked references on x86 Gentoo Refl https://bugs.python.org/issue38803 closed by benjamin.peterson #38810: SSL connect() raises SSLError "[SSL] EC lib (_ssl.c:728)" https://bugs.python.org/issue38810 closed by benjamin.peterson #38817: Immutable types inplace operations work incorrect in async https://bugs.python.org/issue38817 closed by asvetlov #38834: TypedDict: no way to tell which (if any) keys are optional at https://bugs.python.org/issue38834 closed by levkivskyi #38855: test_unpack.py does not catch the unpacking of a set https://bugs.python.org/issue38855 closed by zach.ware #38862: IDLE: Include end newlines in whitespace fix. https://bugs.python.org/issue38862 closed by terry.reedy #38864: dbm: Can't open database with bytes-encoded filename https://bugs.python.org/issue38864 closed by serhiy.storchaka #38866: test_pyclbr replace asyncore https://bugs.python.org/issue38866 closed by inada.naoki #38876: pickle is raising KeyError insteat of pickle.UnpicklingError u https://bugs.python.org/issue38876 closed by alexandre.vassalotti #38877: Python 3.9 build fails under Debian 9.11 https://bugs.python.org/issue38877 closed by ned.deily #38881: unexpected behaviour of random.choices with zero weights https://bugs.python.org/issue38881 closed by rhettinger #38892: Audit Hook doc typos and confusion https://bugs.python.org/issue38892 closed by steve.dower #38896: Remove PyUnicode_ClearFreeList() function https://bugs.python.org/issue38896 closed by vstinner #38897: Example in socket documentation uses deprecated array.fromstri https://bugs.python.org/issue38897 closed by xtreak #38898: Tkinter checkbutton switch on and off together https://bugs.python.org/issue38898 closed by serhiy.storchaka #38899: Document that virtual environment activation for fish should u https://bugs.python.org/issue38899 closed by brett.cannon #38900: Add a glossary entry for "callable" objects https://bugs.python.org/issue38900 closed by rhettinger #38909: module name 'stat.py' https://bugs.python.org/issue38909 closed by zach.ware #38910: AssertionError: ElementTree not initialized, missing root https://bugs.python.org/issue38910 closed by scoder #38911: include __del__ in Generator ABC https://bugs.python.org/issue38911 closed by gvanrossum #38915: 'r[/]*', str, re.MULTILINE | re.DOTALL Won't match // in a str https://bugs.python.org/issue38915 closed by yanioaioan #38917: Color setting doesn't work in tkinter https://bugs.python.org/issue38917 closed by ned.deily #38919: support Assignment Operators https://bugs.python.org/issue38919 closed by zach.ware #38922: code.replace() does not raise audit event https://bugs.python.org/issue38922 closed by steve.dower #38923: Spurious OSError "Not enough memory resources" when allocating https://bugs.python.org/issue38923 closed by bkardon #38925: Decoding unicode not supported after upd to 2.7.17 [possible p https://bugs.python.org/issue38925 closed by steven.daprano #38927: venv --upgrade_deps fails on Windows https://bugs.python.org/issue38927 closed by vinay.sajip #38928: EnvBuilder.upgrade_dependencies() does not exist on 3.8 https://bugs.python.org/issue38928 closed by vinay.sajip #38929: Float // Integer doesn't give best result. https://bugs.python.org/issue38929 closed by steven.daprano #38930: Subprocess failed to kill child process after timeout when usi https://bugs.python.org/issue38930 closed by Xuan Hu #38931: pathlib.Path on Windows - parser issue https://bugs.python.org/issue38931 closed by zach.ware #38933: unusual behaviour on list of dependable lambdas https://bugs.python.org/issue38933 closed by tim.peters #38934: Dictionaries of dictionaries behave incorrectly when created f https://bugs.python.org/issue38934 closed by josh.r #38935: File modes with '+' character does not give expected output https://bugs.python.org/issue38935 closed by steven.daprano #38939: Using Python as a Calculator https://bugs.python.org/issue38939 closed by brett.cannon #38940: Add a new functools.cast() function https://bugs.python.org/issue38940 closed by brett.cannon

8 months, 1 week

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

Python-Dev November 2019