Mailman 3 March 2020 - Python-Dev

REMINDER: report conduct issues to the Conduct WG
by Brett Cannon 30 Mar '20

30 Mar '20

The steering council wants to remind folks that if you have witnessed or experienced any conduct that you think may go against the PSF Code of Conduct to please report those incidents to conduct(a)python.org. This includes reporting micro-aggressions like feeling dismissed so that any pattern of such behaviour can be detected and handled as a larger issue. If you are on the fence of reporting something we encourage you to report the incident and let the Conduct WG make the decision as to how to handle the report. https://www.python.org/psf/conduct/ https://www.python.org/psf/conduct/reporting/

1 0

PEP 615: Support for IANA Time Zones in the Standard Library
by Paul Ganssle 29 Mar '20

29 Mar '20

Greetings! Last year at the Language Summit, I proposed to add additional concrete time zones to the standard library <https://pyfound.blogspot.com/2019/05/paul-ganssle-time-zones-in-standard.ht…> . After much work and much more procrastination, I now have now put together my first proposal: support for the IANA time zone database <https://www.iana.org/time-zones> (also called tz, zoneinfo or the Olson database; Wikipedia <https://en.wikipedia.org/wiki/Tz_database> ). Last week, I submitted it for consideration as PEP 615 <https://www.python.org/dev/peps/pep-0615/>. I originally posted it on the discourse last week, and advertised the discussion on some interest-group-specific fora (tz mailing list, datetime-SIG mailing list), but I think it is ready to be advertised to a wider forum, so I am posting it here for your consideration. Please direct comments to the discourse thread, so that the discussion can be as centralized as possible: https://discuss.python.org/t/3468 <https://discuss.python.org/t/pep-615-support-for-the-iana-time-zone-databas…>. Links for easy access: PEP 615: https://www.python.org/dev/peps/pep-0615/ Reference implementation: https://github.com/pganssle/zoneinfo tzdata repo: https://github.com/pganssle/tzdata Thanks! Paul

1 1

Enum._convert should change __repr__ and/or __str__ to use module name instead of class name
by Ethan Furman 28 Mar '20

28 Mar '20

Serhiy had the idea of having Enum._convert also modify the __str__ and __repr__ of newly created enumerations to display the module name instead of the enumeration name (https://bugs.python.org/msg325007): --> socket.AF_UNIX <AddressFamily.AF_UNIX: 1> ==> <socket.AF_UNIX: 1> --> print(socket.AF_UNIX) AddressFamily.AF_UNIX ==> socket.AF_UNIX Thoughts? -- ~Ethan~

9 22

Summary of Python tracker Issues
by Python tracker 27 Mar '20

27 Mar '20

ACTIVITY SUMMARY (2020-03-20 - 2020-03-27) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7357 ( -1) closed 44486 (+66) total 51843 (+65) Open issues with patches: 2882 Issues opened (43) ================== #20526: python: Modules/gcmodule.c:379: visit_decref: Assertion `((gc) https://bugs.python.org/issue20526 reopened by vstinner #36759: astimezone() fails on Windows for pre-epoch times https://bugs.python.org/issue36759 reopened by SilentGhost #40028: Math module method to find prime factors for non-negative int https://bugs.python.org/issue40028 opened by trrhodes #40031: Python Configure IDLE 'Ok' and 'Apply' buttons do not seem to https://bugs.python.org/issue40031 opened by Vader27 #40034: cgi.parse() does not work with multipart POST requests. https://bugs.python.org/issue40034 opened by sangh #40038: pathlib: remove partial support for preserving accessor when m https://bugs.python.org/issue40038 opened by barneygale #40042: Enum Flag: psuedo-members have None for name attribute https://bugs.python.org/issue40042 opened by ethan.furman #40045: Make "dunder" method documentation easier to locate https://bugs.python.org/issue40045 opened by aeros #40048: _PyEval_EvalFrameDefault() doesn't reset tstate->frame if _PyC https://bugs.python.org/issue40048 opened by vstinner #40049: tarfile cannot extract from stdin https://bugs.python.org/issue40049 opened by dtamuc #40051: Dead link in help(lib2to3) https://bugs.python.org/issue40051 opened by wyz23x2 #40052: Incorrect pointer alignment in _PyVectorcall_Function() of cpy https://bugs.python.org/issue40052 opened by asn #40055: test___all__ and test_distutils alters the enviroinment: pkg_r https://bugs.python.org/issue40055 opened by vstinner #40056: more user-friendly turtledemo https://bugs.python.org/issue40056 opened by Evin Liang #40057: Missing mention of some class attributes in socketserver docum https://bugs.python.org/issue40057 opened by overmighty #40058: Running test_datetime twice fails with: module 'datetime' has https://bugs.python.org/issue40058 opened by vstinner #40059: Provide a toml module in the standard library https://bugs.python.org/issue40059 opened by mgorny #40060: socket.TCP_NOTSENT_LOWAT is missing in official macOS builds https://bugs.python.org/issue40060 opened by Dima.Tisnek #40061: Possible refleak in _asynciomodule.c future_add_done_callback( https://bugs.python.org/issue40061 opened by aeros #40064: py38: document xml.etree.cElementTree will be removed in 3.9 https://bugs.python.org/issue40064 opened by fdrake #40065: py39: remove deprecation note for xml.etree.cElementTree https://bugs.python.org/issue40065 opened by fdrake #40066: Enum._convert should change __repr__ and/or __str__ to use mod https://bugs.python.org/issue40066 opened by ethan.furman #40068: test_threading: ThreadJoinOnShutdown.test_reinit_tls_after_for https://bugs.python.org/issue40068 opened by vstinner #40070: GCC crashed on AMD64 RHEL7 LTO + PGO 3.7 (compiler bug) https://bugs.python.org/issue40070 opened by vstinner #40071: test__xxsubinterpreters leaked [1, 1, 1] references: test_ids https://bugs.python.org/issue40071 opened by vstinner #40072: Win7/Python3.8/asyncio IPv6 UDP Server raise OSError when recv https://bugs.python.org/issue40072 opened by honglei.jiang #40073: AIX: python3 points to "air" https://bugs.python.org/issue40073 opened by Michael.Felt #40074: pickle module dump and load: add support for string file names https://bugs.python.org/issue40074 opened by Diego Palacios #40075: _tkinter PythonCmd fails to acquire GIL https://bugs.python.org/issue40075 opened by speleo3 #40077: Convert static types to PyType_FromSpec() https://bugs.python.org/issue40077 opened by corona10 #40078: asyncio subprocesses allow pids to be reaped, different behavi https://bugs.python.org/issue40078 opened by Justin.Lebar #40079: NULL pointer deref on error path in _ssl debughelpers.c https://bugs.python.org/issue40079 opened by Alexander Riccio #40082: Assertion failure in trip_signal https://bugs.python.org/issue40082 opened by Alexander Riccio #40083: No run option available in python idle in version 3.8.2 https://bugs.python.org/issue40083 opened by Raj_110 #40084: HTTPStatus has incomplete dir() listing https://bugs.python.org/issue40084 opened by rhettinger #40085: Argument parsing option c should accept int between -128 to 25 https://bugs.python.org/issue40085 opened by tzickel #40086: test_etree is skipped in test_typing due to cElementTree remov https://bugs.python.org/issue40086 opened by xtreak #40087: How to Uninstall Python3.7.3 using cmd? https://bugs.python.org/issue40087 opened by deepaleedotkhare(a)gmail.com #40088: list.reverse(): slow sublist reverse https://bugs.python.org/issue40088 opened by Yury #40089: Add _at_fork_reinit() method to locks https://bugs.python.org/issue40089 opened by vstinner #40090: The referenced RFC for the json module should be corrected to https://bugs.python.org/issue40090 opened by amaajemyfren #40091: Crash in logging._after_at_fork_child_reinit_locks() https://bugs.python.org/issue40091 opened by vstinner #40092: Crash in _PyThreadState_DeleteExcept() at fork in the process https://bugs.python.org/issue40092 opened by vstinner Most recent 15 issues with no replies (15) ========================================== #40090: The referenced RFC for the json module should be corrected to https://bugs.python.org/issue40090 #40087: How to Uninstall Python3.7.3 using cmd? https://bugs.python.org/issue40087 #40086: test_etree is skipped in test_typing due to cElementTree remov https://bugs.python.org/issue40086 #40085: Argument parsing option c should accept int between -128 to 25 https://bugs.python.org/issue40085 #40084: HTTPStatus has incomplete dir() listing https://bugs.python.org/issue40084 #40079: NULL pointer deref on error path in _ssl debughelpers.c https://bugs.python.org/issue40079 #40078: asyncio subprocesses allow pids to be reaped, different behavi https://bugs.python.org/issue40078 #40075: _tkinter PythonCmd fails to acquire GIL https://bugs.python.org/issue40075 #40070: GCC crashed on AMD64 RHEL7 LTO + PGO 3.7 (compiler bug) https://bugs.python.org/issue40070 #40066: Enum._convert should change __repr__ and/or __str__ to use mod https://bugs.python.org/issue40066 #40064: py38: document xml.etree.cElementTree will be removed in 3.9 https://bugs.python.org/issue40064 #40060: socket.TCP_NOTSENT_LOWAT is missing in official macOS builds https://bugs.python.org/issue40060 #40057: Missing mention of some class attributes in socketserver docum https://bugs.python.org/issue40057 #40056: more user-friendly turtledemo https://bugs.python.org/issue40056 #40051: Dead link in help(lib2to3) https://bugs.python.org/issue40051 Most recent 15 issues waiting for review (15) ============================================= #40091: Crash in logging._after_at_fork_child_reinit_locks() https://bugs.python.org/issue40091 #40090: The referenced RFC for the json module should be corrected to https://bugs.python.org/issue40090 #40089: Add _at_fork_reinit() method to locks https://bugs.python.org/issue40089 #40086: test_etree is skipped in test_typing due to cElementTree remov https://bugs.python.org/issue40086 #40077: Convert static types to PyType_FromSpec() https://bugs.python.org/issue40077 #40075: _tkinter PythonCmd fails to acquire GIL https://bugs.python.org/issue40075 #40071: test__xxsubinterpreters leaked [1, 1, 1] references: test_ids https://bugs.python.org/issue40071 #40057: Missing mention of some class attributes in socketserver docum https://bugs.python.org/issue40057 #40055: test___all__ and test_distutils alters the enviroinment: pkg_r https://bugs.python.org/issue40055 #40052: Incorrect pointer alignment in _PyVectorcall_Function() of cpy https://bugs.python.org/issue40052 #40049: tarfile cannot extract from stdin https://bugs.python.org/issue40049 #40045: Make "dunder" method documentation easier to locate https://bugs.python.org/issue40045 #40034: cgi.parse() does not work with multipart POST requests. https://bugs.python.org/issue40034 #40025: enum: _generate_next_value_ is not called if its definition oc https://bugs.python.org/issue40025 #40024: Add _PyModule_AddType private helper function https://bugs.python.org/issue40024 Top 10 most discussed issues (10) ================================= #1635741: Py_Finalize() doesn't clear all Python objects at exit https://bugs.python.org/issue1635741 18 msgs #40028: Math module method to find prime factors for non-negative int https://bugs.python.org/issue40028 12 msgs #40018: test_ssl fails with OpenSSL 1.1.1e https://bugs.python.org/issue40018 8 msgs #36054: On Linux, os.count() should read cgroup cpu.shares and cpu.cfs https://bugs.python.org/issue36054 7 msgs #40077: Convert static types to PyType_FromSpec() https://bugs.python.org/issue40077 7 msgs #39148: DatagramProtocol + IPv6 does not work with ProactorEventLoop https://bugs.python.org/issue39148 6 msgs #40031: Python Configure IDLE 'Ok' and 'Apply' buttons do not seem to https://bugs.python.org/issue40031 6 msgs #36759: astimezone() fails on Windows for pre-epoch times https://bugs.python.org/issue36759 5 msgs #39943: Meta: Clean up various issues in C internals https://bugs.python.org/issue39943 5 msgs #40012: Avoid Python 2 documentation to appear in Web search results https://bugs.python.org/issue40012 5 msgs Issues closed (64) ================== #1812: doctest _load_testfile function -- newline handling seems inco https://bugs.python.org/issue1812 closed by zach.ware #15436: __sizeof__ is not documented https://bugs.python.org/issue15436 closed by rhettinger #19462: Add remove_argument() method to argparse.ArgumentParser https://bugs.python.org/issue19462 closed by rhettinger #19698: Implement _imp.exec_builtin and exec_dynamic https://bugs.python.org/issue19698 closed by brett.cannon #21983: segfault in ctypes.cast https://bugs.python.org/issue21983 closed by vstinner #22490: Using realpath for __PYVENV_LAUNCHER__ makes Homebrew installs https://bugs.python.org/issue22490 closed by jaraco #24916: In sysconfig, don't rely on sys.version format https://bugs.python.org/issue24916 closed by serhiy.storchaka #25024: Allow passing "delete=False" to TemporaryDirectory https://bugs.python.org/issue25024 closed by serhiy.storchaka #31521: segfault in PyBytes_AsString https://bugs.python.org/issue31521 closed by vstinner #32173: linecache.py add lazycache to __all__ and use dict.clear to cl https://bugs.python.org/issue32173 closed by akuchling #36144: Dictionary union. (PEP 584) https://bugs.python.org/issue36144 closed by brandtbucher #36989: test_thread fails because symbol is (no longer) exported https://bugs.python.org/issue36989 closed by vstinner #37319: Deprecate using random.randrange() with non-integers https://bugs.python.org/issue37319 closed by rhettinger #38044: unittest causing segfaults with string malloc in c++ module https://bugs.python.org/issue38044 closed by vstinner #38353: Cleanup the path configuration implementation code (getpath.c) https://bugs.python.org/issue38353 closed by vstinner #38410: Possible fatal errors due to _PyEval_SetAsyncGen{Finalizer,Fir https://bugs.python.org/issue38410 closed by steve.dower #38826: Regular Expression Denial of Service in urllib.request.Abstrac https://bugs.python.org/issue38826 closed by vstinner #38945: Remove newline characters from uu encoding methods https://bugs.python.org/issue38945 closed by larry #39352: Remove the formatter module, deprecated since Python 3.4 https://bugs.python.org/issue39352 closed by vstinner #39538: SystemError when set Element.attrib to non-dict https://bugs.python.org/issue39538 closed by serhiy.storchaka #39541: distutils: Remove bdist_wininst (Windows .exe installers) in f https://bugs.python.org/issue39541 closed by vstinner #39652: sqlite3 bug handling column names that contain square braces https://bugs.python.org/issue39652 closed by serhiy.storchaka #39787: test_ssl and test_urllib2_localnet failing with new OpenSSL https://bugs.python.org/issue39787 closed by vstinner #39853: Segmentation fault with urllib.request.urlopen and threads https://bugs.python.org/issue39853 closed by vstinner #39873: Debug mode: check if objects are valid https://bugs.python.org/issue39873 closed by vstinner #39879: Update language reference to specify that dict is insertion-or https://bugs.python.org/issue39879 closed by zach.ware #39882: Py_FatalError(): log automatically the function name https://bugs.python.org/issue39882 closed by vstinner #39908: Remove unused args from init_set_builtins_open and _Py_FatalEr https://bugs.python.org/issue39908 closed by petdance #39949: truncating match in regular expression match objects repr https://bugs.python.org/issue39949 closed by Seth.Troisi #39975: Commands running in 3.7.6 Shell, but failing as script https://bugs.python.org/issue39975 closed by terry.reedy #39984: Move pending calls from _PyRuntime to PyInterpreterState https://bugs.python.org/issue39984 closed by vstinner #39999: Fix some issues with AST node classes https://bugs.python.org/issue39999 closed by serhiy.storchaka #40005: Getting different result in python 2.7 and 3.7. https://bugs.python.org/issue40005 closed by tim.peters #40010: Inefficient signal handling in multithreaded applications https://bugs.python.org/issue40010 closed by vstinner #40011: Tkinter widget events become tuples https://bugs.python.org/issue40011 closed by terry.reedy #40013: CSV DictReader restval parameter documentation https://bugs.python.org/issue40013 closed by xtreak #40014: os.getgrouplist() can fail on macOS if the user has more than https://bugs.python.org/issue40014 closed by vstinner #40016: Clarify flag case in `re` module docstring https://bugs.python.org/issue40016 closed by terry.reedy #40017: Please support CLOCK_TAI in the time module. https://bugs.python.org/issue40017 closed by benjamin.peterson #40022: 关于列表的基础算法问题 https://bugs.python.org/issue40022 closed by terry.reedy #40029: test_importlib.test_zip requires zlib but not marked https://bugs.python.org/issue40029 closed by jaraco #40030: Error with math.fsum() regarding float-point error https://bugs.python.org/issue40030 closed by serhiy.storchaka #40032: Remove explicit inheriting of object in class definitions https://bugs.python.org/issue40032 closed by serhiy.storchaka #40033: Just defined class missing from scope https://bugs.python.org/issue40033 closed by rhettinger #40035: Filtration of the .txt file https://bugs.python.org/issue40035 closed by eric.smith #40036: Deleting duplicates in itertoolsmodule.c https://bugs.python.org/issue40036 closed by rhettinger #40037: py_compile.py quiet undefined in main function https://bugs.python.org/issue40037 closed by xtreak #40039: [CVE-2020-10796] Python multiprocessing Remote Code Execution https://bugs.python.org/issue40039 closed by steve.dower #40040: ProactorEventLoop fails on recvfrom with IPv6 sockets https://bugs.python.org/issue40040 closed by kbr #40041: Typo in argparse ja-document wrong:'append', correct:'extend' https://bugs.python.org/issue40041 closed by Yasunobu Imamura #40043: RegExp Conditional Construct (?(id/name)yes-pattern|no-pattern https://bugs.python.org/issue40043 closed by SilentGhost #40044: Tests failing with the latest update of openssl to version 1.1 https://bugs.python.org/issue40044 closed by cstratak #40046: Increase test coverage of the random module https://bugs.python.org/issue40046 closed by rhettinger #40047: itertools.tee does not release resources during iteration? https://bugs.python.org/issue40047 closed by rhettinger #40050: importlib: module.__spec__ leaks importlib namespaces (test_i https://bugs.python.org/issue40050 closed by vstinner #40053: Document the behavior that no interplotation is applied when n https://bugs.python.org/issue40053 closed by nhua #40054: Allow formatted strings as docstrings https://bugs.python.org/issue40054 closed by serhiy.storchaka #40062: islapha method returns True when the word is japanese https://bugs.python.org/issue40062 closed by eric.smith #40063: Bug in 3rd party sybase database connector (Fatal python error https://bugs.python.org/issue40063 closed by vstinner #40067: Improve error messages for multiple star expressions in assign https://bugs.python.org/issue40067 closed by pablogsal #40069: Clear .lst files for AIX https://bugs.python.org/issue40069 closed by vstinner #40076: isoformat function drops microseconds part if its value is 000 https://bugs.python.org/issue40076 closed by Alexander Bolshakov #40080: Stripping annotations out as a new optimization mode https://bugs.python.org/issue40080 closed by rhettinger #40081: List sorting https://bugs.python.org/issue40081 closed by eric.smith

1 0

Clean memory on C trace
by Leandro Müller 27 Mar '20

27 Mar '20

Hi. I need to clean memory on function on PyEval_SetTrace. When the python code run a while test, the memory consumption goes up a lot (99% of the system). exemple: while 1 == 1: pass My trace function is simple. static map<char *, int, cmp_str> session_debug_user; char *user_console; int trace_trampoline( PyObject *obj, PyFrameObject *frame, int event, PyObject *arg) { try { //check if user has debug session if (session_debug_user.count(user_console) == 0) { return 0; } return 0; } PyObject *sys_settrace(PyObject *mod, PyObject *obj) { user_console = get_variable_char(obj, 0); PyEval_SetTrace(trace_trampoline, obj); return Py_None; } [cid:607bbc5e-5dd8-4a8b-ad96-dc31dce274a9] Att. Leandro Müller

1 0

C trace after start runtime
by Leandro Müller 27 Mar '20

27 Mar '20

Hello. I need to start C trace the thread after to start, its to reduce of the time of the process. I had a lot performance changes sys.trace to C trace, but I need to reduce more time. Are there any soluction to set trace during thead runtime? Att. Leandro Müller

1 0

Accepting PEP 573 (Module State Access from C Extension Methods)
by Stefan Behnel 25 Mar '20

25 Mar '20

As (first-time) BDFL delegate, I accept PEP 573 for Python 3.9, "Module State Access from C Extension Methods" https://www.python.org/dev/peps/pep-0573/ Petr, Nick, Eric and Marcel, thank you for your work and intensive discussions on this PEP, and also to everyone else who got involved on mailing lists, sprints and conferences. It was a long process with several iterations, much thinking, rethinking and cutting down along the way, Python 3.7 *and* 3.8 being missed, but 3.9 now finally being hit. Together with several other improvements to the C-API in the upcoming release, this will help making extension modules less "different" and easier to adapt for subinterpreters. Best, Stefan

4 4

Jump on C by PyEval_SetTrace Python 3.7.7
by Leandro Müller 24 Mar '20

24 Mar '20

Hi everyone. I'm trying to make a simple jump on C funcion trace by frame->f_lineno. Example is simple, but not working. if (frame->f_lineno == 12){ frame->f_lineno = 8; } attached files C and python to run test. the line 12 I need to jump to line 8. Att. Leandro Müller

3 4

MacOS pkg bundles openssl, but doesn't include a cert bundle?
by Matt Billenstein 23 Mar '20

23 Mar '20

Hi, installing the latest 2.7.16 MacOS installer, functions in urllib will attempt to load trusted certs from: /Library/Frameworks/Python.framework/Versions/2.7/etc/openssl/cert.pem But this file is not shipped with the installer package - this makes urlretrieve and friends fail on https hosts - perhaps the installer should ship a bundle or enable using something like certifi if it's installed? AFAIK Apple has deprecated openssl libs as shipped with the OS a long time ago and only support their proprietary framework crypto apis and on MacOS Catalina and newer. thx m -- Matt Billenstein matt(a)vazor.com http://www.vazor.com/

2 2

[RELEASE] Python 3.9.0a5 is now available for testing
by Łukasz Langa 23 Mar '20

23 Mar '20

On behalf of the entire Python development community, and the currently serving Python release team in particular, I’m pleased to announce the release of Python 3.9.0a5. Get it here: https://www.python.org/downloads/release/python-390a5/ <https://www.python.org/downloads/release/python-390a5/> This is an early developer preview of Python 3.9 Python 3.9 is still in development. This releasee, 3.9.0a5 is the fifth of six planned alpha releases. Alpha releases are intended to make it easier to test the current state of new features and bug fixes and to test the release process. During the alpha phase, features may be added up until the start of the beta phase (2020-05-18) and, if necessary, may be modified or deleted up until the release candidate phase (2020-08-10). Please keep in mind that this is a preview release and its use is not recommended for production environments. Major new features of the 3.9 series, compared to 3.8 Many new features for Python 3.9 are still being planned and written. Among the new major new features and changes so far: PEP 584 <https://www.python.org/dev/peps/pep-0584/>, Union Operators in dict PEP 593 <https://www.python.org/dev/peps/pep-0593/>, Flexible function and variable annotations PEP 602 <https://www.python.org/dev/peps/pep-0602/>, Python adopts a stable annual release cadence BPO 38379 <https://bugs.python.org/issue38379>, garbage collection does not block on resurrected objects; BPO 38692 <https://bugs.python.org/issue38692>, os.pidfd_open added that allows process management without races and signals; BPO 39926 <https://bugs.python.org/issue39926>, Unicode support updated to version 13.0.0 BPO 1635741 <https://bugs.python.org/issue1635741>, when Python is initialized multiple times in the same process, it does not leak memory anymore A number of Python builtins (range, tuple, set, frozenset, list) are now sped up using PEP 570 <https://www.python.org/dev/peps/pep-0570> vectorcall A number of standard library modules (audioop, ast, grp, _hashlib, pwd, _posixsubprocess, random, select, struct, termios, zlib) are now using the stable ABI defined by PEP 384 <https://www.python.org/dev/peps/pep-0384/>. (Hey, fellow core developer, if a feature you find important is missing from this list, let Łukasz know <mailto:lukasz@python.org>.) The next pre-release, the last alpha release of Python 3.9, will be 3.9.0a6. It is currently scheduled for 2020-04-22. Until then, stay safe! Your friendly release team, Ned Deily @nad <https://discuss.python.org/u/nad> Steve Dower @steve.dower <https://discuss.python.org/u/steve.dower> Łukasz Langa @ambv <https://discuss.python.org/u/ambv>

1 0