Mailman 3 May 2022 - Python-Dev

python3.110b1 fails during post compile setup on OpenBSD 7.1
by Sandeep Gupta May 23, 2022

May 23, 2022

I tried to install python3.110b1 on OpenBSD7.1/Rpi4. The compilation goes fine but post compilation setup fails. It is not able to fine module `_sysconfigdata__openbsd7_aarch64-unknown-openbsd7`. The full error: gmake[3]: Entering directory '/home/shared/downloads/Python-3.11.0b1' LD_LIBRARY_PATH=/home/shared/downloads/Python-3.11.0b1 CC='/usr/bin/cc -pthread' LDSHARED='/usr/bin/cc -pthread -shared -fPIC -g ' OPT='-DNDEBUG -g -fwrapv -O3 -Wall' ./python -E ./setup.py build Traceback … [View More](most recent call last): File "/home/shared/downloads/Python-3.11.0b1/./setup.py", line 49, in <module> from distutils.command.build_ext import build_ext ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/shared/downloads/Python-3.11.0b1/Lib/distutils/command/build_ext.py", line 13, in <module> from distutils.sysconfig import customize_compiler, get_python_version ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/shared/downloads/Python-3.11.0b1/Lib/distutils/sysconfig.py", line 53, in <module> _config_vars = get_config_vars() ^^^^^^^^^^^^^^^^^ File "/home/shared/downloads/Python-3.11.0b1/Lib/sysconfig.py", line 669, in get_config_vars _init_posix(_CONFIG_VARS) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/shared/downloads/Python-3.11.0b1/Lib/sysconfig.py", line 530, in _init_posix _temp = __import__(name, globals(), locals(), ['build_time_vars'], 0) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ModuleNotFoundError: No module named '_sysconfigdata__openbsd7_aarch64-unknown-openbsd7' gmake[3]: *** [Makefile:858: sharedmods] Error 1 gmake[3]: Leaving directory '/home/shared/downloads/Python-3.11.0b1' gmake[2]: *** [Makefile:757: build_all_generate_profile] Error 2 gmake[2]: Leaving directory '/home/shared/downloads/Python-3.11.0b1' gmake[1]: *** [Makefile:733: profile-gen-stamp] Error 2 gmake[1]: Leaving directory '/home/shared/downloads/Python-3.11.0b1' gmake: *** [Makefile:745: profile-run-stamp] Error 2 This module is present in ./build/lib.openbsd-7.1-arm64-3.11/ as _ sysconfigdata__openbsd7_aarch64-unknown-openbsd7.1.py. So I made renamed the file dropping the .1 from suffix. Then I get a different error: ModuleNotFoundError: No module named '_sysconfigdata__openbsd7_aarch64-unknown-openbsd7.1'; '_sysconfigdata__openbsd7_aarch64-unknown-openbsd7' is not a package I guess we need some fix in the script itself. Thanks Sandeep [View Less]

2 1

Summary of Python tracker Issues
by Python tracker May 20, 2022

May 20, 2022

ACTIVITY SUMMARY (2022-05-13 - 2022-05-20) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7146 ( +0) closed 51841 ( +0) total 58987 ( +0) Open issues with patches: 2890 Most recent 15 issues with no replies (15) ========================================== #47258: Python 3.10 hang at exit in drop_gil() (due to resource warnin https://bugs.python.org/… [View More]

1 0

[RELEASE] Python 3.9.13 is now available
by Łukasz Langa May 17, 2022

May 17, 2022

This is the thirteenth maintenance release of Python 3.9. Get it here: Python 3.9.13 <https://www.python.org/downloads/release/python-3913/> According to the release calendar specified in PEP 596 <https://www.python.org/dev/peps/pep-0596/>, Python 3.9.13 is the final regular maintenance release. Starting now, the 3.9 branch will only accept security fixes and releases of those will be made in source-only form until October 2025. This is a milestone moment for me as it means that … [View More]

1 0

New public PyUnicodeBuilder C API
by Victor Stinner May 17, 2022

May 17, 2022

Hi, I propose adding a new C API to "build an Unicode string". What do you think? Would it be efficient with any possible Unicode string storage and any Python implementation? PyPy has an UnicodeBuilder type in Python, but here I only propose C API. Later, if needed, it would be easy to add a Python API for it. PyPy has UnicodeBuilder to replace "str += str" pattern which is inefficient in PyPy: CPython has a micro-optimization (in ceval.c) to keep this pattern performance interesting. Adding … [View More]a Python API was discussed in 2020, see the LWN article: https://lwn.net/Articles/816415/ Example without error handling, naive implementation which doesn't use known length of key and value strings (calling Preallocate may be more efficient): --------------------------- // Format "key=value" PyObject *format_with_builder(PyObject *key, PyObject *value) { assert(PyUnicode_Check(key)); assert(PyUnicode_Check(value)); // Allocated on the stack PyUnicodeBuilder builder; PyUnicodeBuilder_Init(&builder); // Overallocation is more efficient if the final length is unknown PyUnicodeBuilder_EnableOverallocation(&builder); PyUnicodeBuilder_WriteStr(&builder, key); PyUnicodeBuilder_WriteChar(&builder, '='); // Disable overallocation before the last write PyUnicodeBuilder_DisableOverallocation(&builder); PyUnicodeBuilder_WriteStr(&builder, value); PyUnicode *str = PyUnicodeBuilder_Finish(&builder); // ... use str ... return error: PyUnicodeBuilder_Clear(&builder); ... } --------------------------- Proposed API (11 functions, 1 type): --------------------------- typedef struct { ... } PyUnicodeBuilder; void PyUnicodeBuilder_Init(PyUnicodeBuilder *builder); int PyUnicodeBuilder_Preallocate(PyUnicodeBuilder *builder, Py_ssize_t length, uint32_t maxchar); void PyUnicodeBuilder_EnableOverallocation(PyUnicodeBuilder *builder); void PyUnicodeBuilder_DisableOverallocation(PyUnicodeBuilder *builder); int PyUnicodeBuilder_WriteChar(PyUnicodeBuilder *builder, uint32_t ch); int PyUnicodeBuilder_WriteStr(PyUnicodeBuilder *builder, PyObject *str); int PyUnicodeBuilder_WriteSubstr(PyUnicodeBuilder *builder, PyObject *str, Py_ssize_t start, Py_ssize_t end); int PyUnicodeBuilder_WriteASCIIStr(PyUnicodeBuilder *builder, const char *str, Py_ssize_t len); int PyUnicodeBuilder_WriteLatin1Str(PyUnicodeBuilder *builder, const char *str, Py_ssize_t len); PyObject* PyUnicodeBuilder_Finish(PyUnicodeBuilder *builder); void PyUnicodeBuilder_Clear(PyUnicodeBuilder *builder); --------------------------- The proposed API is based on the private _PyUnicodeWriter C API that I added in Python 3.3 to optimize PEP 393 implementation. PyUnicodeBuilder_WriteASCIIStr() is an optimization: in release mode, the function doesn't have to check if the string contains non-ASCII characters. In debug mode, it must fail. If you consider that this API is too likely to introduce bugs in release mode, it can be removed. PyUnicodeBuilder_Preallocate() maxchar can be zero, but for the current Python implementation (PEP 393 compact string), it's more efficient if maxchar matchs the expected Unicode storage: 127 for ASCII, 255 for Latin1, 0xffff for UCS2, or 0x10ffff for UCS4. The value doesn't have to the exact, for example, it can be any valiue in [128; 255] for Latin1. The problem is that computing maxchar (need to read characters, decode a byte strings from a codec, etc.) can be expensive and an PyUnicodeBuilder_Preallocate() implementation can ignore maxchar depending on the chosen Unicode string storage. PyUnicode_MAX_CHAR_VALUE(str) can be used to create maxchar, but this function is specific to the current CPython implementation. Maybe a second "preallocate" function without maxchar should be added (more convenient, but less efficient). I don't know. Rationale for adding a new public C API. Currently, the Python C API is designed to allocate an Unicode string on the heap memory with uninitialized characters, and then basically gives a direct access to these characters. Since Python 3.3, creating an Unicode string in a C extension became more complicated: the caller must know in advance what will be the optimal storage for characters: ASCII, Latin1 UCS1 [U+0000; U+00FF], BMP UCS-2 [U+0000; U+FFFF],or full Unicode character set UCS4 [U+0000; U+10FFFF]. When writing a codec decoder (like decoding UTF-8), the maximum code point is not known in advance and so the decoder may need to change the buffer format while decoding (start with UCS1, switch to UCS2, maybe switch a second time to UCS4). The current C API has multiple drawbacks: * It is designed to target the exact format "PEP 393 compact strings" ("kind + data"). * It is inefficient for PyPy which uses UTF-8 internally. So it would also be inefficient if Python is modified to also use UTF-8 internally. * It leaks too many implementation details. * It creates an uninitialized string which might be exposed by mistake to Python and so can lead to bugs or even crashes I propose adding a new API to "build a string" which would be efficient on CPython and PyPy. Later, it should help Python experimenting a different storage for Unicode strings (with different trade-offs, like UTF-8). Discussion about changing maybe the Unicode storage in Python tomorrow, especially issues caused by the C API which prevent that: * https://discuss.python.org/t/un-deprecate-pyunicode-ready-for-future-unicod… * https://github.com/python/cpython/pull/92705#issuecomment-1125869198 In 2016, I wrote an article about private _PyUnicodeWriter and _PyBytesWriter C API that I added to optimize Python: https://vstinner.github.io/pybyteswriter.html Victor -- Night gathers, and now my watch begins. It shall not end until my death. [View Less]

3 8

Issue: 92359 - Python 3.10 IDLE 64-bit doesn't open any files names code (code.py, code.pyw) - found a partial fix but looking for input
by ward.davidj＠gmail.com May 16, 2022

May 16, 2022

Hello, Link to the github issue page is here https://github.com/python/cpython/issues/92359 This bug has been lurking in waiting for roughly 7 years or possibly longer. The root issue is that the "Edit with IDLE" context menu executes idle with `python.exe -m idlelib` which puts the current working directory in sys.path but inside idlelib it has a `from code import ...` statement. A kind of ugly hack is sitting in my fork of cpython here https://github.com/devdave/cpython/blob/… [View More]

4 4

Problems building 3.7.13 on Windows
by Joseph L. Casale May 16, 2022

May 16, 2022

I am trying to build a full release of 3.7.13 with the Wix bundle on Windows. I have installed Visual Studio 2015 and included its bundled Windows 10 SDK. The SdkBinPath property in .\PCbuild\pyproject.props on line 182 seems to incorrectly set the path to: C:\Program Files (x86)\Windows Kits\10\bin\10.0.14393.0\x86 This does not include any of the tools referenced later such as Makecat.exe. The right path would be set further down to (but is skipped): C:\Program Files (x86)\… [View More]

1 1

Summary of Python tracker Issues
by Python tracker May 15, 2022

May 15, 2022

ACTIVITY SUMMARY (2022-05-06 - 2022-05-13) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7146 ( +0) closed 51841 ( +0) total 58987 ( +0) Open issues with patches: 2890 Most recent 15 issues with no replies (15) ========================================== #47258: Python 3.10 hang at exit in drop_gil() (due to resource warnin https://bugs.python.org/… [View More]

7 6

Re: Summary of Python tracker Issues
by Harry Lees May 15, 2022

May 15, 2022

> > My understanding was that it would be updated to get its information > from Github once the transition was complete. Is that not going to > happen now? > There is an open PR to fix the roundup summary script at: https://github.com/python/cpython/pull/91738 It will move the roundup-summary script into the Python repo and have it run as a Github action instead of a cron job. Harry

1 0

Starting a new thread
by Barney Stratford May 13, 2022

May 13, 2022

Hello all. It occurs to me that creating threads in Python is more awkward than it needs to be. Every time I want to start a new thread, I end up writing the same thing over and over again: def target(*args, **kwds): ... t = threading.Thread(target = target, args = <something>, kwargs= <something>) t.start() This becomes especially repetitive when calling a target function that only makes sense when run in a new thread, such as a timer. In my own code, I’ve taken to … [View More]

8 10

Announcing the Python Language Summit 2022 blog posts
by Mariatta May 11, 2022

May 11, 2022

The blog posts about presentations and discussions from Python Language Summit 2022 are now up for your enjoyment. Main article: https://pyfound.blogspot.com/2022/05/the-2022-python-language-summit_016788… - Python without the GIL <https://pyfound.blogspot.com/2022/05/the-2022-python-language-summit-python…> , Sam Gross - Reaching a per-interpreter GIL <https://pyfound.blogspot.com/2022/05/the-2022-python-language-summit-per.ht…> , Eric Snow - The “Faster CPython” project: 3.12 … [View More]

2 1