Python-Dev March 2020

python-dev@python.org

65 participants
40 discussions

by Benjamin Peterson

Hi all, It's finally time to schedule the last releases in Python 2's life. There will be two more releases of Python 2.7: Python 2.7.17 and Python 2.7.18. Python 2.7.17 release candidate 1 will happen on October 5th followed by the final release on October 19th. I'm going to time Python 2.7.18 to coincide with PyCon 2020 in April, so attendees can enjoy some collective catharsis. We'll still say January 1st is the official EOL date. Thanks to Sumana Harihareswara, there's now a FAQ about the Python 2 sunset on the website: https://www.python.org/doc/sunset-python-2/ Regards, Benjamin

5 months, 1 week

PEP 616 -- String methods to remove prefixes and suffixes

by Dennis Sweeney

Browser Link: https://www.python.org/dev/peps/pep-0616/ PEP: 616 Title: String methods to remove prefixes and suffixes Author: Dennis Sweeney <sweeney.dennis650(a)gmail.com> Sponsor: Eric V. Smith <eric(a)trueblade.com> Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 19-Mar-2020 Python-Version: 3.9 Post-History: 30-Aug-2002 Abstract ======== This is a proposal to add two new methods, ``cutprefix`` and ``cutsuffix``, to the APIs of Python's various string objects. In particular, the methods would be added to Unicode ``str`` objects, binary ``bytes`` and ``bytearray`` objects, and ``collections.UserString``. If ``s`` is one these objects, and ``s`` has ``pre`` as a prefix, then ``s.cutprefix(pre)`` returns a copy of ``s`` in which that prefix has been removed. If ``s`` does not have ``pre`` as a prefix, an unchanged copy of ``s`` is returned. In summary, ``s.cutprefix(pre)`` is roughly equivalent to ``s[len(pre):] if s.startswith(pre) else s``. The behavior of ``cutsuffix`` is analogous: ``s.cutsuffix(suf)`` is roughly equivalent to ``s[:-len(suf)] if suf and s.endswith(suf) else s``. Rationale ========= There have been repeated issues [#confusion]_ on the Bug Tracker and StackOverflow related to user confusion about the existing ``str.lstrip`` and ``str.rstrip`` methods. These users are typically expecting the behavior of ``cutprefix`` and ``cutsuffix``, but they are surprised that the parameter for ``lstrip`` is interpreted as a set of characters, not a substring. This repeated issue is evidence that these methods are useful, and the new methods allow a cleaner redirection of users to the desired behavior. As another testimonial for the usefulness of these methods, several users on Python-Ideas [#pyid]_ reported frequently including similar functions in their own code for productivity. The implementation often contained subtle mistakes regarding the handling of the empty string (see `Specification`_). Specification ============= The builtin ``str`` class will gain two new methods with roughly the following behavior:: def cutprefix(self: str, pre: str, /) -> str: if self.startswith(pre): return self[len(pre):] return self[:] def cutsuffix(self: str, suf: str, /) -> str: if suf and self.endswith(suf): return self[:-len(suf)] return self[:] The only difference between the real implementation and the above is that, as with other string methods like ``replace``, the methods will raise a ``TypeError`` if any of ``self``, ``pre`` or ``suf`` is not an instace of ``str``, and will cast subclasses of ``str`` to builtin ``str`` objects. Note that without the check for the truthyness of ``suf``, ``s.cutsuffix('')`` would be mishandled and always return the empty string due to the unintended evaluation of ``self[:-0]``. Methods with the corresponding semantics will be added to the builtin ``bytes`` and ``bytearray`` objects. If ``b`` is either a ``bytes`` or ``bytearray`` object, then ``b.cutsuffix()`` and ``b.cutprefix()`` will accept any bytes-like object as an argument. Note that the ``bytearray`` methods return a copy of ``self``; they do not operate in place. The following behavior is considered a CPython implementation detail, but is not guaranteed by this specification:: >>> x = 'foobar' * 10**6 >>> x.cutprefix('baz') is x is x.cutsuffix('baz') True >>> x.cutprefix('') is x is x.cutsuffix('') True That is, for CPython's immutable ``str`` and ``bytes`` objects, the methods return the original object when the affix is not found or if the affix is empty. Because these types test for equality using shortcuts for identity and length, the following equivalent expressions are evaluated at approximately the same speed, for any ``str`` objects (or ``bytes`` objects) ``x`` and ``y``:: >>> (True, x[len(y):]) if x.startswith(y) else (False, x) >>> (True, z) if x != (z := x.cutprefix(y)) else (False, x) The two methods will also be added to ``collections.UserString``, where they rely on the implementation of the new ``str`` methods. Motivating examples from the Python standard library ==================================================== The examples below demonstrate how the proposed methods can make code one or more of the following: Less fragile: The code will not depend on the user to count the length of a literal. More performant: The code does not require a call to the Python built-in ``len`` function. More descriptive: The methods give a higher-level API for code readability, as opposed to the traditional method of string slicing. refactor.py ----------- - Current:: if fix_name.startswith(self.FILE_PREFIX): fix_name = fix_name[len(self.FILE_PREFIX):] - Improved:: fix_name = fix_name.cutprefix(self.FILE_PREFIX) c_annotations.py: ----------------- - Current:: if name.startswith("c."): name = name[2:] - Improved:: name = name.cutprefix("c.") find_recursionlimit.py ---------------------- - Current:: if test_func_name.startswith("test_"): print(test_func_name[5:]) else: print(test_func_name) - Improved:: print(test_finc_name.cutprefix("test_")) deccheck.py ----------- This is an interesting case because the author chose to use the ``str.replace`` method in a situation where only a prefix was intended to be removed. - Current:: if funcname.startswith("context."): self.funcname = funcname.replace("context.", "") self.contextfunc = True else: self.funcname = funcname self.contextfunc = False - Improved:: if funcname.startswith("context."): self.funcname = funcname.cutprefix("context.") self.contextfunc = True else: self.funcname = funcname self.contextfunc = False - Arguably further improved:: self.contextfunc = funcname.startswith("context.") self.funcname = funcname.cutprefix("context.") test_i18n.py ------------ - Current:: if test_func_name.startswith("test_"): print(test_func_name[5:]) else: print(test_func_name) - Improved:: print(test_finc_name.cutprefix("test_")) - Current:: if creationDate.endswith('\\n'): creationDate = creationDate[:-len('\\n')] - Improved:: creationDate = creationDate.cutsuffix('\\n') shared_memory.py ---------------- - Current:: reported_name = self._name if _USE_POSIX and self._prepend_leading_slash: if self._name.startswith("/"): reported_name = self._name[1:] return reported_name - Improved:: if _USE_POSIX and self._prepend_leading_slash: return self._name.cutprefix("/") return self._name build-installer.py ------------------ - Current:: if archiveName.endswith('.tar.gz'): retval = os.path.basename(archiveName[:-7]) if ((retval.startswith('tcl') or retval.startswith('tk')) and retval.endswith('-src')): retval = retval[:-4] - Improved:: if archiveName.endswith('.tar.gz'): retval = os.path.basename(archiveName[:-7]) if retval.startswith(('tcl', 'tk')): retval = retval.cutsuffix('-src') Depending on personal style, ``archiveName[:-7]`` could also be changed to ``archiveName.cutsuffix('.tar.gz')``. test_core.py ------------ - Current:: if output.endswith("\n"): output = output[:-1] - Improved:: output = output.cutsuffix("\n") cookiejar.py ------------ - Current:: def strip_quotes(text): if text.startswith('"'): text = text[1:] if text.endswith('"'): text = text[:-1] return text - Improved:: def strip_quotes(text): return text.cutprefix('"').cutsuffix('"') - Current:: if line.endswith("\n"): line = line[:-1] - Improved:: line = line.cutsuffix("\n") fixdiv.py --------- - Current:: def chop(line): if line.endswith("\n"): return line[:-1] else: return line - Improved:: def chop(line): return line.cutsuffix("\n") test_concurrent_futures.py -------------------------- In the following example, the meaning of the code changes slightly, but in context, it behaves the same. - Current:: if name.endswith(('Mixin', 'Tests')): return name[:-5] elif name.endswith('Test'): return name[:-4] else: return name - Improved:: return name.cutsuffix('Mixin').cutsuffix('Tests').cutsuffix('Test') msvc9compiler.py ---------------- - Current:: if value.endswith(os.pathsep): value = value[:-1] - Improved:: value = value.cutsuffix(os.pathsep) test_pathlib.py --------------- - Current:: self.assertTrue(r.startswith(clsname + '('), r) self.assertTrue(r.endswith(')'), r) inner = r[len(clsname) + 1 : -1] - Improved:: self.assertTrue(r.startswith(clsname + '('), r) self.assertTrue(r.endswith(')'), r) inner = r.cutprefix(clsname + '(').cutsuffix(')') Rejected Ideas ============== Expand the lstrip and rstrip APIs --------------------------------- Because ``lstrip`` takes a string as its argument, it could be viewed as taking an iterable of length-1 strings. The API could therefore be generalized to accept any iterable of strings, which would be successively removed as prefixes. While this behavior would be consistent, it would not be obvious for users to have to call ``'foobar'.cutprefix(('foo,))`` for the common use case of a single prefix. Allow multiple prefixes ----------------------- Some users discussed the desire to be able to remove multiple prefixes, calling, for example, ``s.cutprefix('From: ', 'CC: ')``. However, this adds ambiguity about the order in which the prefixes are removed, especially in cases like ``s.cutprefix('Foo', 'FooBar')``. After this proposal, this can be spelled explicitly as ``s.cutprefix('Foo').cutprefix('FooBar')``. Remove multiple copies of a prefix ---------------------------------- This is the behavior that would be consistent with the aforementioned expansion of the ``lstrip/rstrip`` API -- repeatedly applying the function until the argument is unchanged. This behavior is attainable from the proposed behavior via the following:: >>> s = 'foo' * 100 + 'bar' >>> while s != (s := s.cutprefix("foo")): pass >>> s 'bar' The above can be modififed by chaining multiple ``cutprefix`` calls together to achieve the full behavior of the ``lstrip``/``rstrip`` generalization, while being explicit in the order of removal. While the proposed API could later be extended to include some of these use cases, to do so before any observation of how these methods are used in practice would be premature and may lead to choosing the wrong behavior. Raising an exception when not found ----------------------------------- There was a suggestion that ``s.cutprefix(pre)`` should raise an exception if ``not s.startswith(pre)``. However, this does not match with the behavior and feel of other string methods. There could be ``required=False`` keyword added, but this violates the KISS principle. Alternative Method Names ------------------------ Several alternatives method names have been proposed. Some are listed below, along with commentary for why they should be rejected in favor of ``cutprefix`` (the same arguments hold for ``cutsuffix``) ``ltrim`` "Trim" does in other languages (e.g. JavaScript, Java, Go, PHP) what ``strip`` methods do in Python. ``lstrip(string=...)`` This would avoid adding a new method, but for different behavior, it's better to have two different methods than one method with a keyword argument that select the behavior. ``cut_prefix`` All of the other methods of the string API, e.g. ``str.startswith()``, use ``lowercase`` rather than ``lower_case_with_underscores``. ``cutleft``, ``leftcut``, or ``lcut`` The explicitness of "prefix" is preferred. ``removeprefix``, ``deleteprefix``, ``withoutprefix``, etc. All of these might have been acceptable, but they have more characters than ``cut``. Some suggested that the verb "cut" implies mutability, but the string API already contains verbs like "replace", "strip", "split", and "swapcase". ``stripprefix`` Users may benefit from the mnemonic that "strip" means working with sets of characters, while other methods work with substrings, so re-using "strip" here should be avoided. Reference Implementation ======================== See the pull request on GitHub [#pr]_. References ========== .. [#pr] GitHub pull request with implementation (https://github.com/python/cpython/pull/18939) .. [#pyid] Discussion on Python-Ideas (https://mail.python.org/archives/list/python-ideas@python.org/thread/RJARZS…) .. [#confusion] Comment listing Bug Tracker and StackOverflow issues (https://mail.python.org/archives/list/python-ideas@python.org/message/GRGAF…) Copyright ========= This document is placed in the public domain or under the CC0-1.0-Universal license, whichever is more permissive. .. Local Variables: mode: indented-text indent-tabs-mode: nil sentence-end-double-space: t fill-column: 70 coding: utf-8 End:

5 months, 3 weeks

Debug C++

by Leandro Müller

Hi Are there any away to debug C module during python debug? Att. Leandro Müller

5 months, 3 weeks

Moving threadstate to thread-local storage.

by Mark Shannon

Hi, As an experiment, I thought I would try moving the thread state (what you get from _PyThreadState_GET() ) to TLS. https://github.com/python/cpython/compare/master...markshannon:threadstate_… It works, passing all the tests, and seems sound. It is a small patch (< 50 lines) and doesn't increase the overall code size. My branch is GCC/Clang only, so will need a bit of extra code for Windows. It should only need a few more lines; I haven't done it as I don't have a Windows machine to test it on. This is a *much* cleaner approach to removing the global variable than adding lots of extra parameters all over the place. Cheers, Mark.

5 months, 3 weeks

PEP 585 "Type Hinting Generics In Standard Collections" accepted

by Victor Stinner

Hi, The Python Steering Council accepts PEP 585 "Type Hinting Generics In Standard Collections": https://www.python.org/dev/peps/pep-0585/ Congrats Łukasz Langa for your tenacity! (PEP written one year ago.) Thanks also to everyone who was involved in the discussion to help to get a better PEP ;-) It seems Guido van Rossum is already working on implementing the PEP: * https://github.com/python/cpython/pull/18239 * https://bugs.python.org/issue39481 Victor -- Night gathers, and now my watch begins. It shall not end until my death.

5 months, 3 weeks

REMINDER: report conduct issues to the Conduct WG

by Brett Cannon

The steering council wants to remind folks that if you have witnessed or experienced any conduct that you think may go against the PSF Code of Conduct to please report those incidents to conduct(a)python.org. This includes reporting micro-aggressions like feeling dismissed so that any pattern of such behaviour can be detected and handled as a larger issue. If you are on the fence of reporting something we encourage you to report the incident and let the Conduct WG make the decision as to how to handle the report. https://www.python.org/psf/conduct/ https://www.python.org/psf/conduct/reporting/

5 months, 3 weeks

PEP 615: Support for IANA Time Zones in the Standard Library

by Paul Ganssle

Greetings! Last year at the Language Summit, I proposed to add additional concrete time zones to the standard library <https://pyfound.blogspot.com/2019/05/paul-ganssle-time-zones-in-standard.ht…> . After much work and much more procrastination, I now have now put together my first proposal: support for the IANA time zone database <https://www.iana.org/time-zones> (also called tz, zoneinfo or the Olson database; Wikipedia <https://en.wikipedia.org/wiki/Tz_database> ). Last week, I submitted it for consideration as PEP 615 <https://www.python.org/dev/peps/pep-0615/>. I originally posted it on the discourse last week, and advertised the discussion on some interest-group-specific fora (tz mailing list, datetime-SIG mailing list), but I think it is ready to be advertised to a wider forum, so I am posting it here for your consideration. Please direct comments to the discourse thread, so that the discussion can be as centralized as possible: https://discuss.python.org/t/3468 <https://discuss.python.org/t/pep-615-support-for-the-iana-time-zone-databas…>. Links for easy access: PEP 615: https://www.python.org/dev/peps/pep-0615/ Reference implementation: https://github.com/pganssle/zoneinfo tzdata repo: https://github.com/pganssle/tzdata Thanks! Paul

5 months, 4 weeks

Enum._convert should change __repr__ and/or __str__ to use module name instead of class name

by Ethan Furman

Serhiy had the idea of having Enum._convert also modify the __str__ and __repr__ of newly created enumerations to display the module name instead of the enumeration name (https://bugs.python.org/msg325007): --> socket.AF_UNIX <AddressFamily.AF_UNIX: 1> ==> <socket.AF_UNIX: 1> --> print(socket.AF_UNIX) AddressFamily.AF_UNIX ==> socket.AF_UNIX Thoughts? -- ~Ethan~

5 months, 4 weeks

Summary of Python tracker Issues

by Python tracker

ACTIVITY SUMMARY (2020-03-20 - 2020-03-27) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7357 ( -1) closed 44486 (+66) total 51843 (+65) Open issues with patches: 2882 Issues opened (43) ================== #20526: python: Modules/gcmodule.c:379: visit_decref: Assertion `((gc) https://bugs.python.org/issue20526 reopened by vstinner #36759: astimezone() fails on Windows for pre-epoch times https://bugs.python.org/issue36759 reopened by SilentGhost #40028: Math module method to find prime factors for non-negative int https://bugs.python.org/issue40028 opened by trrhodes #40031: Python Configure IDLE 'Ok' and 'Apply' buttons do not seem to https://bugs.python.org/issue40031 opened by Vader27 #40034: cgi.parse() does not work with multipart POST requests. https://bugs.python.org/issue40034 opened by sangh #40038: pathlib: remove partial support for preserving accessor when m https://bugs.python.org/issue40038 opened by barneygale #40042: Enum Flag: psuedo-members have None for name attribute https://bugs.python.org/issue40042 opened by ethan.furman #40045: Make "dunder" method documentation easier to locate https://bugs.python.org/issue40045 opened by aeros #40048: _PyEval_EvalFrameDefault() doesn't reset tstate->frame if _PyC https://bugs.python.org/issue40048 opened by vstinner #40049: tarfile cannot extract from stdin https://bugs.python.org/issue40049 opened by dtamuc #40051: Dead link in help(lib2to3) https://bugs.python.org/issue40051 opened by wyz23x2 #40052: Incorrect pointer alignment in _PyVectorcall_Function() of cpy https://bugs.python.org/issue40052 opened by asn #40055: test___all__ and test_distutils alters the enviroinment: pkg_r https://bugs.python.org/issue40055 opened by vstinner #40056: more user-friendly turtledemo https://bugs.python.org/issue40056 opened by Evin Liang #40057: Missing mention of some class attributes in socketserver docum https://bugs.python.org/issue40057 opened by overmighty #40058: Running test_datetime twice fails with: module 'datetime' has https://bugs.python.org/issue40058 opened by vstinner #40059: Provide a toml module in the standard library https://bugs.python.org/issue40059 opened by mgorny #40060: socket.TCP_NOTSENT_LOWAT is missing in official macOS builds https://bugs.python.org/issue40060 opened by Dima.Tisnek #40061: Possible refleak in _asynciomodule.c future_add_done_callback( https://bugs.python.org/issue40061 opened by aeros #40064: py38: document xml.etree.cElementTree will be removed in 3.9 https://bugs.python.org/issue40064 opened by fdrake #40065: py39: remove deprecation note for xml.etree.cElementTree https://bugs.python.org/issue40065 opened by fdrake #40066: Enum._convert should change __repr__ and/or __str__ to use mod https://bugs.python.org/issue40066 opened by ethan.furman #40068: test_threading: ThreadJoinOnShutdown.test_reinit_tls_after_for https://bugs.python.org/issue40068 opened by vstinner #40070: GCC crashed on AMD64 RHEL7 LTO + PGO 3.7 (compiler bug) https://bugs.python.org/issue40070 opened by vstinner #40071: test__xxsubinterpreters leaked [1, 1, 1] references: test_ids https://bugs.python.org/issue40071 opened by vstinner #40072: Win7/Python3.8/asyncio IPv6 UDP Server raise OSError when recv https://bugs.python.org/issue40072 opened by honglei.jiang #40073: AIX: python3 points to "air" https://bugs.python.org/issue40073 opened by Michael.Felt #40074: pickle module dump and load: add support for string file names https://bugs.python.org/issue40074 opened by Diego Palacios #40075: _tkinter PythonCmd fails to acquire GIL https://bugs.python.org/issue40075 opened by speleo3 #40077: Convert static types to PyType_FromSpec() https://bugs.python.org/issue40077 opened by corona10 #40078: asyncio subprocesses allow pids to be reaped, different behavi https://bugs.python.org/issue40078 opened by Justin.Lebar #40079: NULL pointer deref on error path in _ssl debughelpers.c https://bugs.python.org/issue40079 opened by Alexander Riccio #40082: Assertion failure in trip_signal https://bugs.python.org/issue40082 opened by Alexander Riccio #40083: No run option available in python idle in version 3.8.2 https://bugs.python.org/issue40083 opened by Raj_110 #40084: HTTPStatus has incomplete dir() listing https://bugs.python.org/issue40084 opened by rhettinger #40085: Argument parsing option c should accept int between -128 to 25 https://bugs.python.org/issue40085 opened by tzickel #40086: test_etree is skipped in test_typing due to cElementTree remov https://bugs.python.org/issue40086 opened by xtreak #40087: How to Uninstall Python3.7.3 using cmd? https://bugs.python.org/issue40087 opened by deepaleedotkhare(a)gmail.com #40088: list.reverse(): slow sublist reverse https://bugs.python.org/issue40088 opened by Yury #40089: Add _at_fork_reinit() method to locks https://bugs.python.org/issue40089 opened by vstinner #40090: The referenced RFC for the json module should be corrected to https://bugs.python.org/issue40090 opened by amaajemyfren #40091: Crash in logging._after_at_fork_child_reinit_locks() https://bugs.python.org/issue40091 opened by vstinner #40092: Crash in _PyThreadState_DeleteExcept() at fork in the process https://bugs.python.org/issue40092 opened by vstinner Most recent 15 issues with no replies (15) ========================================== #40090: The referenced RFC for the json module should be corrected to https://bugs.python.org/issue40090 #40087: How to Uninstall Python3.7.3 using cmd? https://bugs.python.org/issue40087 #40086: test_etree is skipped in test_typing due to cElementTree remov https://bugs.python.org/issue40086 #40085: Argument parsing option c should accept int between -128 to 25 https://bugs.python.org/issue40085 #40084: HTTPStatus has incomplete dir() listing https://bugs.python.org/issue40084 #40079: NULL pointer deref on error path in _ssl debughelpers.c https://bugs.python.org/issue40079 #40078: asyncio subprocesses allow pids to be reaped, different behavi https://bugs.python.org/issue40078 #40075: _tkinter PythonCmd fails to acquire GIL https://bugs.python.org/issue40075 #40070: GCC crashed on AMD64 RHEL7 LTO + PGO 3.7 (compiler bug) https://bugs.python.org/issue40070 #40066: Enum._convert should change __repr__ and/or __str__ to use mod https://bugs.python.org/issue40066 #40064: py38: document xml.etree.cElementTree will be removed in 3.9 https://bugs.python.org/issue40064 #40060: socket.TCP_NOTSENT_LOWAT is missing in official macOS builds https://bugs.python.org/issue40060 #40057: Missing mention of some class attributes in socketserver docum https://bugs.python.org/issue40057 #40056: more user-friendly turtledemo https://bugs.python.org/issue40056 #40051: Dead link in help(lib2to3) https://bugs.python.org/issue40051 Most recent 15 issues waiting for review (15) ============================================= #40091: Crash in logging._after_at_fork_child_reinit_locks() https://bugs.python.org/issue40091 #40090: The referenced RFC for the json module should be corrected to https://bugs.python.org/issue40090 #40089: Add _at_fork_reinit() method to locks https://bugs.python.org/issue40089 #40086: test_etree is skipped in test_typing due to cElementTree remov https://bugs.python.org/issue40086 #40077: Convert static types to PyType_FromSpec() https://bugs.python.org/issue40077 #40075: _tkinter PythonCmd fails to acquire GIL https://bugs.python.org/issue40075 #40071: test__xxsubinterpreters leaked [1, 1, 1] references: test_ids https://bugs.python.org/issue40071 #40057: Missing mention of some class attributes in socketserver docum https://bugs.python.org/issue40057 #40055: test___all__ and test_distutils alters the enviroinment: pkg_r https://bugs.python.org/issue40055 #40052: Incorrect pointer alignment in _PyVectorcall_Function() of cpy https://bugs.python.org/issue40052 #40049: tarfile cannot extract from stdin https://bugs.python.org/issue40049 #40045: Make "dunder" method documentation easier to locate https://bugs.python.org/issue40045 #40034: cgi.parse() does not work with multipart POST requests. https://bugs.python.org/issue40034 #40025: enum: _generate_next_value_ is not called if its definition oc https://bugs.python.org/issue40025 #40024: Add _PyModule_AddType private helper function https://bugs.python.org/issue40024 Top 10 most discussed issues (10) ================================= #1635741: Py_Finalize() doesn't clear all Python objects at exit https://bugs.python.org/issue1635741 18 msgs #40028: Math module method to find prime factors for non-negative int https://bugs.python.org/issue40028 12 msgs #40018: test_ssl fails with OpenSSL 1.1.1e https://bugs.python.org/issue40018 8 msgs #36054: On Linux, os.count() should read cgroup cpu.shares and cpu.cfs https://bugs.python.org/issue36054 7 msgs #40077: Convert static types to PyType_FromSpec() https://bugs.python.org/issue40077 7 msgs #39148: DatagramProtocol + IPv6 does not work with ProactorEventLoop https://bugs.python.org/issue39148 6 msgs #40031: Python Configure IDLE 'Ok' and 'Apply' buttons do not seem to https://bugs.python.org/issue40031 6 msgs #36759: astimezone() fails on Windows for pre-epoch times https://bugs.python.org/issue36759 5 msgs #39943: Meta: Clean up various issues in C internals https://bugs.python.org/issue39943 5 msgs #40012: Avoid Python 2 documentation to appear in Web search results https://bugs.python.org/issue40012 5 msgs Issues closed (64) ================== #1812: doctest _load_testfile function -- newline handling seems inco https://bugs.python.org/issue1812 closed by zach.ware #15436: __sizeof__ is not documented https://bugs.python.org/issue15436 closed by rhettinger #19462: Add remove_argument() method to argparse.ArgumentParser https://bugs.python.org/issue19462 closed by rhettinger #19698: Implement _imp.exec_builtin and exec_dynamic https://bugs.python.org/issue19698 closed by brett.cannon #21983: segfault in ctypes.cast https://bugs.python.org/issue21983 closed by vstinner #22490: Using realpath for __PYVENV_LAUNCHER__ makes Homebrew installs https://bugs.python.org/issue22490 closed by jaraco #24916: In sysconfig, don't rely on sys.version format https://bugs.python.org/issue24916 closed by serhiy.storchaka #25024: Allow passing "delete=False" to TemporaryDirectory https://bugs.python.org/issue25024 closed by serhiy.storchaka #31521: segfault in PyBytes_AsString https://bugs.python.org/issue31521 closed by vstinner #32173: linecache.py add lazycache to __all__ and use dict.clear to cl https://bugs.python.org/issue32173 closed by akuchling #36144: Dictionary union. (PEP 584) https://bugs.python.org/issue36144 closed by brandtbucher #36989: test_thread fails because symbol is (no longer) exported https://bugs.python.org/issue36989 closed by vstinner #37319: Deprecate using random.randrange() with non-integers https://bugs.python.org/issue37319 closed by rhettinger #38044: unittest causing segfaults with string malloc in c++ module https://bugs.python.org/issue38044 closed by vstinner #38353: Cleanup the path configuration implementation code (getpath.c) https://bugs.python.org/issue38353 closed by vstinner #38410: Possible fatal errors due to _PyEval_SetAsyncGen{Finalizer,Fir https://bugs.python.org/issue38410 closed by steve.dower #38826: Regular Expression Denial of Service in urllib.request.Abstrac https://bugs.python.org/issue38826 closed by vstinner #38945: Remove newline characters from uu encoding methods https://bugs.python.org/issue38945 closed by larry #39352: Remove the formatter module, deprecated since Python 3.4 https://bugs.python.org/issue39352 closed by vstinner #39538: SystemError when set Element.attrib to non-dict https://bugs.python.org/issue39538 closed by serhiy.storchaka #39541: distutils: Remove bdist_wininst (Windows .exe installers) in f https://bugs.python.org/issue39541 closed by vstinner #39652: sqlite3 bug handling column names that contain square braces https://bugs.python.org/issue39652 closed by serhiy.storchaka #39787: test_ssl and test_urllib2_localnet failing with new OpenSSL https://bugs.python.org/issue39787 closed by vstinner #39853: Segmentation fault with urllib.request.urlopen and threads https://bugs.python.org/issue39853 closed by vstinner #39873: Debug mode: check if objects are valid https://bugs.python.org/issue39873 closed by vstinner #39879: Update language reference to specify that dict is insertion-or https://bugs.python.org/issue39879 closed by zach.ware #39882: Py_FatalError(): log automatically the function name https://bugs.python.org/issue39882 closed by vstinner #39908: Remove unused args from init_set_builtins_open and _Py_FatalEr https://bugs.python.org/issue39908 closed by petdance #39949: truncating match in regular expression match objects repr https://bugs.python.org/issue39949 closed by Seth.Troisi #39975: Commands running in 3.7.6 Shell, but failing as script https://bugs.python.org/issue39975 closed by terry.reedy #39984: Move pending calls from _PyRuntime to PyInterpreterState https://bugs.python.org/issue39984 closed by vstinner #39999: Fix some issues with AST node classes https://bugs.python.org/issue39999 closed by serhiy.storchaka #40005: Getting different result in python 2.7 and 3.7. https://bugs.python.org/issue40005 closed by tim.peters #40010: Inefficient signal handling in multithreaded applications https://bugs.python.org/issue40010 closed by vstinner #40011: Tkinter widget events become tuples https://bugs.python.org/issue40011 closed by terry.reedy #40013: CSV DictReader restval parameter documentation https://bugs.python.org/issue40013 closed by xtreak #40014: os.getgrouplist() can fail on macOS if the user has more than https://bugs.python.org/issue40014 closed by vstinner #40016: Clarify flag case in `re` module docstring https://bugs.python.org/issue40016 closed by terry.reedy #40017: Please support CLOCK_TAI in the time module. https://bugs.python.org/issue40017 closed by benjamin.peterson #40022: 关于列表的基础算法问题 https://bugs.python.org/issue40022 closed by terry.reedy #40029: test_importlib.test_zip requires zlib but not marked https://bugs.python.org/issue40029 closed by jaraco #40030: Error with math.fsum() regarding float-point error https://bugs.python.org/issue40030 closed by serhiy.storchaka #40032: Remove explicit inheriting of object in class definitions https://bugs.python.org/issue40032 closed by serhiy.storchaka #40033: Just defined class missing from scope https://bugs.python.org/issue40033 closed by rhettinger #40035: Filtration of the .txt file https://bugs.python.org/issue40035 closed by eric.smith #40036: Deleting duplicates in itertoolsmodule.c https://bugs.python.org/issue40036 closed by rhettinger #40037: py_compile.py quiet undefined in main function https://bugs.python.org/issue40037 closed by xtreak #40039: [CVE-2020-10796] Python multiprocessing Remote Code Execution https://bugs.python.org/issue40039 closed by steve.dower #40040: ProactorEventLoop fails on recvfrom with IPv6 sockets https://bugs.python.org/issue40040 closed by kbr #40041: Typo in argparse ja-document wrong:'append', correct:'extend' https://bugs.python.org/issue40041 closed by Yasunobu Imamura #40043: RegExp Conditional Construct (?(id/name)yes-pattern|no-pattern https://bugs.python.org/issue40043 closed by SilentGhost #40044: Tests failing with the latest update of openssl to version 1.1 https://bugs.python.org/issue40044 closed by cstratak #40046: Increase test coverage of the random module https://bugs.python.org/issue40046 closed by rhettinger #40047: itertools.tee does not release resources during iteration? https://bugs.python.org/issue40047 closed by rhettinger #40050: importlib: module.__spec__ leaks importlib namespaces (test_i https://bugs.python.org/issue40050 closed by vstinner #40053: Document the behavior that no interplotation is applied when n https://bugs.python.org/issue40053 closed by nhua #40054: Allow formatted strings as docstrings https://bugs.python.org/issue40054 closed by serhiy.storchaka #40062: islapha method returns True when the word is japanese https://bugs.python.org/issue40062 closed by eric.smith #40063: Bug in 3rd party sybase database connector (Fatal python error https://bugs.python.org/issue40063 closed by vstinner #40067: Improve error messages for multiple star expressions in assign https://bugs.python.org/issue40067 closed by pablogsal #40069: Clear .lst files for AIX https://bugs.python.org/issue40069 closed by vstinner #40076: isoformat function drops microseconds part if its value is 000 https://bugs.python.org/issue40076 closed by Alexander Bolshakov #40080: Stripping annotations out as a new optimization mode https://bugs.python.org/issue40080 closed by rhettinger #40081: List sorting https://bugs.python.org/issue40081 closed by eric.smith

6 months

Clean memory on C trace

by Leandro Müller

Hi. I need to clean memory on function on PyEval_SetTrace. When the python code run a while test, the memory consumption goes up a lot (99% of the system). exemple: while 1 == 1: pass My trace function is simple. static map<char *, int, cmp_str> session_debug_user; char *user_console; int trace_trampoline( PyObject *obj, PyFrameObject *frame, int event, PyObject *arg) { try { //check if user has debug session if (session_debug_user.count(user_console) == 0) { return 0; } return 0; } PyObject *sys_settrace(PyObject *mod, PyObject *obj) { user_console = get_variable_char(obj, 0); PyEval_SetTrace(trace_trampoline, obj); return Py_None; } [cid:607bbc5e-5dd8-4a8b-ad96-dc31dce274a9] Att. Leandro Müller

6 months

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

Python-Dev March 2020