Mailman 3 January 2021 - Python-Dev

Does the C-API include C structs not explicitly documented?
by Mark Shannon 27 Jan '21

27 Jan '21

Hi everyone, Are C structs part of the C-API if the struct is only included in a header, but not documented? I have always assumed not, but it isn't clear. This question arose in https://github.com/python/cpython/pull/24298 Obviously, any structs listed in https://docs.python.org/3/c-api/structures.html are part of the API Thoughts? Cheers, Mark.

2 1

Resurrecting PEP 558 (defined semantics for locals())
by Mark Shannon 27 Jan '21

27 Jan '21

Hi, PEP 558 seems to be dormant, if not abandoned. There are at least two open issues for bugs resulting from the currently weird and inefficient behavior of `f_locals` and `locals()`. See https://bugs.python.org/issue30744 for an example of undesirable behaviour. PEP 588, or something like it, would fix those. I'd be happy to take over the PEP, or write a new one. I like PEP 588, although I would propose a simplification. The PEP mentions "tracing mode" and changes behavior according to whether a program is in "tracing mode" or not. I'd like to remove this distinction. Cheers, Mark.

3 5

Re: Speeding up CPython
by Bruno Cabral 25 Jan '21

25 Jan '21

Hello Everyone, I´m very curious about this proposal, but unfortunately it has been a while since I heard any news about this project. Does anyone know what happened? Best Regards, Bruno

3 2

Tff rvt
by Swati Singh 23 Jan '21

23 Jan '21

-- *Life is short .... Live it to it's full potential :) -Swati *

1 0

Please explain how to migrate when a function is removed, thanks ;-)
by Victor Stinner 22 Jan '21

22 Jan '21

Hi, We are working on upgrading Python from 3.9 to 3.10 in Fedora and we are facing many Python 3.10 incompatible changes. Most changes were planned with a deprecation period, but, as usual, projects are not tested with DeprecationWarning treated as errors, and so tons of packages now fail to build. I'm not here to talk about DeprecationWarning, but how we communicate on incompatible changes made on purpose. For example, What's New in Python 3.8 announces: "In asyncio, the explicit passing of a loop argument has been deprecated and will be removed in version 3.10". As expected, the parameter was removed in Python 3.10 (bpo-42392), but I cannot see anything in What's New in Python 3.10. The problem is that I don't know how to fix projects broken by this change. I'm not complaining about this specific change, but more generally. I strongly suggest to well document incompatible changes. The bare minimum is to mention them in "Porting to Python 3.10" section: https://docs.python.org/dev/whatsnew/3.10.html#porting-to-python-3-10 A link to the bpo sometimes helps to understand how to port code. But I would really appreciate if authors of incompatible changes would explain how to add Python 3.10 support to existing projects, without losing support for older Python versions. Not just "this function is now removed, good luck!" :-) I didn't touch asyncio for at least 1 year, so I don't know what happens if I remove a loop argument. Does an application remain compatible with Python 3.6 without passing loop? I know that I made multiple incompatible changes myself and I'm sure that the documentation should probably be enhanced, but I also expect others to help on that! ;-) Please think about people who have to port 4000 Python projects to Python 3.10! --- The best would be to ship a tool which adds Python 3.10 support to existing projects without losing support with Python 3.6. Maybe something like https://github.com/asottile/pyupgrade could be used for that? pyupgrade looks more specific to the Python syntax, than the usage of the stdlib. I wrote such tool to add Python 3.10 support to C extensions without losing support with Python 2.7. It relies on a header file (pythoncapi_compat.h) which provides new C API functions on old Python versions. https://github.com/pythoncapi/pythoncapi_compat For example, it replaces "obj->ob_refcnt = refcnt;" with "Py_SET_REFCNT(obj, refcnt);" and provides Py_SET_REFCNT() to Python 3.8 and older (function added to Python 3.9) Victor -- Night gathers, and now my watch begins. It shall not end until my death.

4 7

The SC is accepting PEP 632: deprecating distutils
by Brett Cannon 22 Jan '21

22 Jan '21

On behalf of the SC, I'm happy to announce that we have chosen to accept PEP 632. Congrats, Steve, and thanks for the work on the PEP! I'll let Steve outline what the next steps are for implementing the PEP.

2 1

Summary of Python tracker Issues
by Python tracker 22 Jan '21

22 Jan '21

ACTIVITY SUMMARY (2021-01-15 - 2021-01-22) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7578 (+32) closed 47161 (+35) total 54739 (+67) Open issues with patches: 3037 Issues opened (52) ================== #42604: EXT_SUFFIX too short on FreeBSD and AIX https://bugs.python.org/issue42604 reopened by vstinner #42937: 192.0.0.8 (IPv4 dummy address) considered globally reachable https://bugs.python.org/issue42937 opened by cdirkx #42939: Linux's chattr i.e. ioctl(FS_IOC_SETFLAGS) is not supported in https://bugs.python.org/issue42939 opened by socketpair #42940: Incorrect behavior of inspect.signature(f).bind https://bugs.python.org/issue42940 opened by slavkostrov #42941: Infinite loop in asyncio sslproto https://bugs.python.org/issue42941 opened by linxy95 #42943: singledispatchmethod should expose registry of all known overl https://bugs.python.org/issue42943 opened by Ilya.Kulakov #42946: email: ValueError in get_section when parsing header with non- https://bugs.python.org/issue42946 opened by The Compiler #42947: email: Handling when both extended/ascii parameter (filename*/ https://bugs.python.org/issue42947 opened by The Compiler #42948: bytearray.copy is undocumented https://bugs.python.org/issue42948 opened by wim.glenn #42949: pdb & multiprocessing.Pool: AttributeError: module '__main__' https://bugs.python.org/issue42949 opened by macfreek #42950: Incorrect exception behavior in handling recursive call. https://bugs.python.org/issue42950 opened by xxm #42952: Incorrect handling of EC_KEY_new_by_curve_name() in the _ssl m https://bugs.python.org/issue42952 opened by ZackerySpytz #42955: Add sys.module_names: list of stdlib module names (Python and https://bugs.python.org/issue42955 opened by vstinner #42956: Easy conversion between range and slice https://bugs.python.org/issue42956 opened by nemeskeyd #42957: os.readlink produces wrong result on windows https://bugs.python.org/issue42957 opened by simon mackenzie #42958: filecmp.cmp(shallow=True) isn't actually shallow when only mti https://bugs.python.org/issue42958 opened by AlexVndnblcke #42960: resources module, FreeBSD update adding RLIMIT_KQUEUES constan https://bugs.python.org/issue42960 opened by devnexen #42961: Use-after-free (of a heap type) during finalization https://bugs.python.org/issue42961 opened by bstaletic #42962: Windows: SystemError during os.kill(..., signal.CTRL_C_EVENT) https://bugs.python.org/issue42962 opened by William.Schwartz #42963: [multiprocessing] Calling pool.terminate() from an error_callb https://bugs.python.org/issue42963 opened by sjelin #42964: Draft PEP blob etc https://bugs.python.org/issue42964 opened by larry #42966: argparse: customizable help formatter https://bugs.python.org/issue42966 opened by monkeyman79 #42967: [security] urllib.parse.parse_qsl(): Web cache poisoning - `; https://bugs.python.org/issue42967 opened by AdamGold #42968: multiprocessing handle leak on Windows when child process is k https://bugs.python.org/issue42968 opened by dgrunwald #42969: pthread_exit & PyThread_exit_thread from PyEval_RestoreThread https://bugs.python.org/issue42969 opened by gregory.p.smith #42970: File path with blank causes open error in 3.8, not in 3.7 https://bugs.python.org/issue42970 opened by dday52 #42971: Some errnos for BSD/OSX are missing from errno module https://bugs.python.org/issue42971 opened by ngie #42972: [C API] Heap types (PyType_FromSpec) must fully implement the https://bugs.python.org/issue42972 opened by vstinner #42973: argparse: mixing optional and positional arguments... not agai https://bugs.python.org/issue42973 opened by monkeyman79 #42974: tokenize reports incorrect end col offset and line string when https://bugs.python.org/issue42974 opened by romanows #42976: __text_signature__ parser silently drops arguments with certai https://bugs.python.org/issue42976 opened by Antony.Lee #42977: Tkinter Optionmenu Too Narrow on Mac https://bugs.python.org/issue42977 opened by zjdavid #42979: _zoneinfo: zoneinfomodule_exec() doesn't check for PyDateTime_ https://bugs.python.org/issue42979 opened by vstinner #42980: argparse: GNU-style help formatter https://bugs.python.org/issue42980 opened by will #42981: Error messages raised by _hashlib_scrypt_impl() are slightly m https://bugs.python.org/issue42981 opened by illia-v #42982: Update suggested number of iterations for pbkdf2_hmac() https://bugs.python.org/issue42982 opened by illia-v #42985: AMD64 Arch Linux Asan 3.x fails: command timed out: 1200 secon https://bugs.python.org/issue42985 opened by vstinner #42986: pegen parser: Crash on SyntaxError with f-string on Windows https://bugs.python.org/issue42986 opened by neonene #42988: Information disclosure via pydoc -p: /getfile?key=path allows https://bugs.python.org/issue42988 opened by hroncok #42990: Improve the C code for calling Python code: _PyEval_EvalCode() https://bugs.python.org/issue42990 opened by Mark.Shannon #42991: support for splitting multichannel audio fragments in audioop https://bugs.python.org/issue42991 opened by Th4R4 #42992: Tkinter bbox coordinates incorrectly drawn https://bugs.python.org/issue42992 opened by rhoffmann #42993: doc xml.etree.ElementTree.ElementTree.write does not mention a https://bugs.python.org/issue42993 opened by buhtz #42994: Missing MIME types for opus, AAC, 3gpp and 3gpp2 https://bugs.python.org/issue42994 opened by nbeals #42995: Add PurePath.with_suffix_appended() https://bugs.python.org/issue42995 opened by bgerrity #42997: Improve error message for missing : before suites https://bugs.python.org/issue42997 opened by pablogsal #42998: pathlib.Path: add `username` argument to `home()` https://bugs.python.org/issue42998 opened by barneygale #42999: `pathlib.Path.link_to()` documentation is misleading https://bugs.python.org/issue42999 opened by barneygale #43000: All SSL requests fail with WRONG_VERSION_NUMBER when a packet https://bugs.python.org/issue43000 opened by darrenrs #43001: python3.9.1 test_embed test_tabnanny failed https://bugs.python.org/issue43001 opened by asholomitskiy84 #43002: Exception chaining accepts exception classes https://bugs.python.org/issue43002 opened by cool-RR #43003: Parts of the API will be removed in Python 4.0 ? https://bugs.python.org/issue43003 opened by MichaelClerx Most recent 15 issues with no replies (15) ========================================== #43003: Parts of the API will be removed in Python 4.0 ? https://bugs.python.org/issue43003 #43002: Exception chaining accepts exception classes https://bugs.python.org/issue43002 #43001: python3.9.1 test_embed test_tabnanny failed https://bugs.python.org/issue43001 #42999: `pathlib.Path.link_to()` documentation is misleading https://bugs.python.org/issue42999 #42994: Missing MIME types for opus, AAC, 3gpp and 3gpp2 https://bugs.python.org/issue42994 #42993: doc xml.etree.ElementTree.ElementTree.write does not mention a https://bugs.python.org/issue42993 #42991: support for splitting multichannel audio fragments in audioop https://bugs.python.org/issue42991 #42981: Error messages raised by _hashlib_scrypt_impl() are slightly m https://bugs.python.org/issue42981 #42979: _zoneinfo: zoneinfomodule_exec() doesn't check for PyDateTime_ https://bugs.python.org/issue42979 #42976: __text_signature__ parser silently drops arguments with certai https://bugs.python.org/issue42976 #42966: argparse: customizable help formatter https://bugs.python.org/issue42966 #42963: [multiprocessing] Calling pool.terminate() from an error_callb https://bugs.python.org/issue42963 #42960: resources module, FreeBSD update adding RLIMIT_KQUEUES constan https://bugs.python.org/issue42960 #42949: pdb & multiprocessing.Pool: AttributeError: module '__main__' https://bugs.python.org/issue42949 #42947: email: Handling when both extended/ascii parameter (filename*/ https://bugs.python.org/issue42947 Most recent 15 issues waiting for review (15) ============================================= #42999: `pathlib.Path.link_to()` documentation is misleading https://bugs.python.org/issue42999 #42997: Improve error message for missing : before suites https://bugs.python.org/issue42997 #42995: Add PurePath.with_suffix_appended() https://bugs.python.org/issue42995 #42994: Missing MIME types for opus, AAC, 3gpp and 3gpp2 https://bugs.python.org/issue42994 #42991: support for splitting multichannel audio fragments in audioop https://bugs.python.org/issue42991 #42990: Improve the C code for calling Python code: _PyEval_EvalCode() https://bugs.python.org/issue42990 #42988: Information disclosure via pydoc -p: /getfile?key=path allows https://bugs.python.org/issue42988 #42986: pegen parser: Crash on SyntaxError with f-string on Windows https://bugs.python.org/issue42986 #42982: Update suggested number of iterations for pbkdf2_hmac() https://bugs.python.org/issue42982 #42981: Error messages raised by _hashlib_scrypt_impl() are slightly m https://bugs.python.org/issue42981 #42980: argparse: GNU-style help formatter https://bugs.python.org/issue42980 #42974: tokenize reports incorrect end col offset and line string when https://bugs.python.org/issue42974 #42973: argparse: mixing optional and positional arguments... not agai https://bugs.python.org/issue42973 #42967: [security] urllib.parse.parse_qsl(): Web cache poisoning - `; https://bugs.python.org/issue42967 #42958: filecmp.cmp(shallow=True) isn't actually shallow when only mti https://bugs.python.org/issue42958 Top 10 most discussed issues (10) ================================= #42955: Add sys.module_names: list of stdlib module names (Python and https://bugs.python.org/issue42955 24 msgs #42988: Information disclosure via pydoc -p: /getfile?key=path allows https://bugs.python.org/issue42988 13 msgs #42967: [security] urllib.parse.parse_qsl(): Web cache poisoning - `; https://bugs.python.org/issue42967 10 msgs #42887: 100000 assignments of .__sizeof__ cause a segfault on del https://bugs.python.org/issue42887 7 msgs #42962: Windows: SystemError during os.kill(..., signal.CTRL_C_EVENT) https://bugs.python.org/issue42962 7 msgs #42985: AMD64 Arch Linux Asan 3.x fails: command timed out: 1200 secon https://bugs.python.org/issue42985 7 msgs #41701: Buildbot web page: connection lost after 1 minute, then displa https://bugs.python.org/issue41701 6 msgs #42606: Support POSIX atomicity guarantee of O_APPEND on Windows https://bugs.python.org/issue42606 6 msgs #42800: Traceback objects allow accessing frame objects without trigge https://bugs.python.org/issue42800 6 msgs #33289: tkinter askcolor returning floats for r, g, b values instead o https://bugs.python.org/issue33289 5 msgs Issues closed (35) ================== #36769: doc Document that fnmatch.filter supports any kind of iterable https://bugs.python.org/issue36769 closed by iritkatriel #40176: unterminated string literal tokenization error messages could https://bugs.python.org/issue40176 closed by BTaskaya #40304: Classes created using type() don't need to explicitly inherit https://bugs.python.org/issue40304 closed by terry.reedy #41036: Visit the type of instance of heap types if tp_traverse is not https://bugs.python.org/issue41036 closed by vstinner #41545: gc API requiring matching number of gc.disable - gc.enable cal https://bugs.python.org/issue41545 closed by Yonatan Goldschmidt #41995: five possible Null Pointer Dereference bugs. https://bugs.python.org/issue41995 closed by vstinner #42005: profile/cProfile CLI should catch BrokenPipeError https://bugs.python.org/issue42005 closed by vstinner #42048: Document Argument Clinic's defining_class converter https://bugs.python.org/issue42048 closed by erlendaasland #42163: _replace() no longer works on platform.uname_result objects https://bugs.python.org/issue42163 closed by jaraco #42189: copy.deepcopy() no longer works on platform.uname_result objec https://bugs.python.org/issue42189 closed by jaraco #42447: robotsparser deny all with some rules https://bugs.python.org/issue42447 closed by terry.reedy #42531: importlib.resources.path() raises TypeError for packages witho https://bugs.python.org/issue42531 closed by jaraco #42659: Objects of uname_result Class Cannot be Successfully Pickled https://bugs.python.org/issue42659 closed by jaraco #42780: os.set_inheritable() fails for O_PATH file descriptors on Linu https://bugs.python.org/issue42780 closed by vstinner #42856: ensurepip: add configure --with-wheel-pkg-dir=PATH to get whee https://bugs.python.org/issue42856 closed by vstinner #42864: Improve error messages regarding unclosed parentheses https://bugs.python.org/issue42864 closed by pablogsal #42923: Py_FatalError(): dump the list of extension modules https://bugs.python.org/issue42923 closed by vstinner #42925: Error trace of else inside class https://bugs.python.org/issue42925 closed by Mark.Shannon #42931: Include randbytes in random.__all__ https://bugs.python.org/issue42931 closed by rhettinger #42938: [security] ctypes double representation BoF https://bugs.python.org/issue42938 closed by benjamin.peterson #42942: Feature request: Add decdigest() to hashlib https://bugs.python.org/issue42942 closed by 2d4d #42944: random.Random.sample bug when counts is not None https://bugs.python.org/issue42944 closed by rhettinger #42945: weakref.finalize documentation contradicts itself RE: finalize https://bugs.python.org/issue42945 closed by ryan.a.heisler #42951: Random and infinite loop in dealing with recursion error for " https://bugs.python.org/issue42951 closed by Mark.Shannon #42953: After the subclass of enum.Enum is imported in some diffenent https://bugs.python.org/issue42953 closed by ethan.furman #42954: new "if-as" syntax https://bugs.python.org/issue42954 closed by steven.daprano #42959: AttributeError: module 'signal' has no attribute 'SIGHUP' https://bugs.python.org/issue42959 closed by gvanrossum #42965: Optional callable raises TypeError https://bugs.python.org/issue42965 closed by Ofekmeister #42975: urllib.parse.parse_qsl(): add an option to not consider semico https://bugs.python.org/issue42975 closed by vstinner #42978: Improve error message when "self" is missing from the method d https://bugs.python.org/issue42978 closed by pablogsal #42983: sys.argv incorrectly parses command lines with args in environ https://bugs.python.org/issue42983 closed by gvanrossum #42984: Python 3.7 and qt Libraries https://bugs.python.org/issue42984 closed by gvanrossum #42987: HTTP header injection in urllib on windows https://bugs.python.org/issue42987 closed by vstinner #42989: Bug https://bugs.python.org/issue42989 closed by zach.ware #42996: hashlib documentation references an obsolete RFC 2898 https://bugs.python.org/issue42996 closed by illia-v

1 0

pathlib.Path: inconsistent symlink_to() and link_to()
by Barney Gale 22 Jan '21

22 Jan '21

Hi, Pathlib's symlink_to() and link_to() methods have different argument orders, so: a.symlink_to(b) # Creates a symlink from A to B a.link_to(b) # Creates a hard link from B to A I don't think link_to() was intended to be implemented this way, as the docs say "Create a hard link pointing to a path named target.". It's also inconsistent with everything else in pathlib, most obviously symlink_to(). Bug report here: https://bugs.python.org/issue39291 This /really/ irks me. Apparently it's too late to fix link_to(), so I'd like to suggest we add a new hardlink_to() method that matches the symlink_to() argument order. link_to() then becomes deprecated/undocumented. Any thoughts? Barney

4 5

PEP 651: Robust Overflow Handling, version 2
by Mark Shannon 22 Jan '21

22 Jan '21

Hi, I've updated the PEP in light of my experiments and feedback. The new API is simpler and a bit more backwards compatible. https://www.python.org/dev/peps/pep-0651/ Cheers, Mark.

2 2

Doctest does not work with mock.call PR #22981
by Alfred Perlstein 21 Jan '21

21 Jan '21

Hello, There's been a bug open where doctest can break if there are proxy objects that fail to unwrap (https://bugs.python.org/issue35753) since python 3.7, this includes when importing 'call' from the 'mock' module. Does someone have time to review PR 22981 (https://github.com/python/cpython/pull/22981). Last feedback from folks with merge capabilities seems to be from November 8th. I've replied a few times in December on the PR but there is no response. -Alfred

1 0