Mailman 3 November 2019 - Python-Dev

Should we require all deprecations to have a removal version that we follow through on?
by Brett Cannon 07 Dec '19

07 Dec '19

What do people think of the idea of requiring all deprecations specifying a version that the feature will be removed in (which under our annual release cadence would be at least the third release from the start of the deprecation, hence the deprecation being public for 2 years)? And that we also follow through with that removal? Now I'm not suggesting it **must** be in three feature releases. A deprecation could be set to Python 4 if people truly feel keeping the code is as easy it gets in terms of maintenance and there's enough usage to warrant such a potential indefinite deprecation/maintenance while keeping the code and docs alive (basically "there are better ways to do this, but this works fine, too, if you were already using it"). But what I am trying to avoid is the semi-regular discussion we seem to have of what is or is not reasonable to deprecate and leave versus deprecate and eventually remove because we didn't specify what the eventual plan was for a deprecation. Also feel like it would help users to know specifically what the plan is with a deprecation rather than wondering if something will get removed in the next feature release or not because we left off a specific removal version. If people are amenable to this idea I will update PEP 387 (which I plan to start a discussion about post-SC election) and I would also plan to add a warnings._deprecate() which I roughly outlined once at https://discuss.python.org/t/pendingdeprecationwarning-is-really-useful/103….

8 10

Fun with Python 3.8 and Qt
by Kacvinsky, Tom 07 Dec '19

07 Dec '19

Today I discovered the this struct typedef struct{ const char* name; int basicsize; int itemsize; unsigned int flags; PyType_Slot *slots; /* terminated by slot==0. */ } PyType_Spec; with "PyTypeSlot *slots" being on line 190 of object.h causes a problem when compiled with code that brings in Qt. Qt has macro definitions of slots. With a cursory preprocessing of the file I was working with, using the handy gcc options -dM -E, I found that slots was defined to nothing #define slots and hence caused problems when object.h was brought into the mix. I will try to make a simple reproducer tomorrow. I know this probably could be solved by header file inclusion re-ordering, or in some cases #undef'ing slots before including Python.h, but I also thought the Python dev team would like to know about this issue. Tom

3 2

Summary of Python tracker Issues
by Python tracker 30 Nov '19

30 Nov '19

ACTIVITY SUMMARY (2019-11-22 - 2019-11-29) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7170 ( -1) closed 43522 (+47) total 50692 (+46) Open issues with patches: 2823 Issues opened (23) ================== #38270: Tests: Avoid MD5 or check for MD5 availablity https://bugs.python.org/issue38270 reopened by petr.viktorin #38901: Add a CLI flag to venv to use the pwd basename as the prompt https://bugs.python.org/issue38901 opened by brett.cannon #38902: image/webp support in mimetypes https://bugs.python.org/issue38902 opened by leecatball #38903: #if 0 block on parsetok.c https://bugs.python.org/issue38903 opened by eamanu #38904: "signal only works in main thread" in main thread https://bugs.python.org/issue38904 opened by Richard Warfield #38905: venv python reports wrong sys.executable in a subprocess on Wi https://bugs.python.org/issue38905 opened by uranusjr #38906: copy2 doesn't copy metadata on Windows and MacOS https://bugs.python.org/issue38906 opened by greggman #38907: Add IPv6 Dual-Stack control for http.server https://bugs.python.org/issue38907 opened by zkonge #38908: Troubles with @runtime_checkable protocols https://bugs.python.org/issue38908 opened by levkivskyi #38912: test_asyncio altered the execution environment https://bugs.python.org/issue38912 opened by pablogsal #38913: Py_BuildValue("(s#O)", ...) segfaults if entered with exceptio https://bugs.python.org/issue38913 opened by danielen #38914: Clarify wording for warning message when checking a package https://bugs.python.org/issue38914 opened by jugmac00 #38916: Remove array.fromstring https://bugs.python.org/issue38916 opened by corona10 #38918: Add __module__ entry for function type in inspect docs table. https://bugs.python.org/issue38918 opened by eric.snow #38920: Audit events for unhandled exceptions https://bugs.python.org/issue38920 opened by steve.dower #38921: Max Recursion Depth Reached in Logging Library https://bugs.python.org/issue38921 opened by joy #38924: pathlib paths .normalize() https://bugs.python.org/issue38924 opened by iciocirlan #38926: MacOS: 'Install certificates.command' has no effect https://bugs.python.org/issue38926 opened by Jeff Berkowitz #38932: unittest.mock.Mock.reset_mocks does not pass all arguments to https://bugs.python.org/issue38932 opened by vegarsti #38936: fatal error during installation 0x80070643 during python insta https://bugs.python.org/issue38936 opened by kiranmai velishala #38937: NameError in list comprehension within .pth file https://bugs.python.org/issue38937 opened by Chris Billington #38938: Iterable merge performance and inclusion in itertools https://bugs.python.org/issue38938 opened by Dennis Sweeney #38941: xml.etree.ElementTree.Element inconsistent warning for bool https://bugs.python.org/issue38941 opened by philiprowlands Most recent 15 issues with no replies (15) ========================================== #38926: MacOS: 'Install certificates.command' has no effect https://bugs.python.org/issue38926 #38918: Add __module__ entry for function type in inspect docs table. https://bugs.python.org/issue38918 #38912: test_asyncio altered the execution environment https://bugs.python.org/issue38912 #38903: #if 0 block on parsetok.c https://bugs.python.org/issue38903 #38902: image/webp support in mimetypes https://bugs.python.org/issue38902 #38887: test_asyncio: test_pipe_handle() failed on AMD64 Windows7 SP1 https://bugs.python.org/issue38887 #38886: permissions too restrictive in zipfile.writestr https://bugs.python.org/issue38886 #38883: Path.home() should ignore HOME env var like os.path.expanduser https://bugs.python.org/issue38883 #38880: Subinterpreters: List interpreters associated with a channel e https://bugs.python.org/issue38880 #38879: Reordered error checking in PyArena_New(). https://bugs.python.org/issue38879 #38872: Document exec symbol for codeop.compile_command https://bugs.python.org/issue38872 #38867: Enable Tkinter on Windows ARM https://bugs.python.org/issue38867 #38860: GenericPyCData_new does not invoke new or init https://bugs.python.org/issue38860 #38856: wait_closed() can raise ConnectionResetError https://bugs.python.org/issue38856 #38851: UDPLITE tests fail on android https://bugs.python.org/issue38851 Most recent 15 issues waiting for review (15) ============================================= #38937: NameError in list comprehension within .pth file https://bugs.python.org/issue38937 #38932: unittest.mock.Mock.reset_mocks does not pass all arguments to https://bugs.python.org/issue38932 #38920: Audit events for unhandled exceptions https://bugs.python.org/issue38920 #38918: Add __module__ entry for function type in inspect docs table. https://bugs.python.org/issue38918 #38914: Clarify wording for warning message when checking a package https://bugs.python.org/issue38914 #38907: Add IPv6 Dual-Stack control for http.server https://bugs.python.org/issue38907 #38903: #if 0 block on parsetok.c https://bugs.python.org/issue38903 #38886: permissions too restrictive in zipfile.writestr https://bugs.python.org/issue38886 #38880: Subinterpreters: List interpreters associated with a channel e https://bugs.python.org/issue38880 #38878: os.PathLike subclasshook causes subclass checks true on abstra https://bugs.python.org/issue38878 #38870: Expose ast.unparse in the ast module https://bugs.python.org/issue38870 #38858: new_interpreter() should reuse more Py_InitializeFromConfig() https://bugs.python.org/issue38858 #38854: Decorator breaks inspect.getsource https://bugs.python.org/issue38854 #38852: test_recursion_limit in test_threading crashes with SIGSEGV on https://bugs.python.org/issue38852 #38848: compileall fails when the platform lacks a functional sem_ope https://bugs.python.org/issue38848 Top 10 most discussed issues (10) ================================= #38905: venv python reports wrong sys.executable in a subprocess on Wi https://bugs.python.org/issue38905 17 msgs #38916: Remove array.fromstring https://bugs.python.org/issue38916 8 msgs #37224: test__xxsubinterpreters fails randomly https://bugs.python.org/issue37224 7 msgs #35003: Provide an option to venv to put files in a bin/ directory on https://bugs.python.org/issue35003 6 msgs #38021: Modify AIX platform_tag so it provides PEP425 needs https://bugs.python.org/issue38021 6 msgs #38547: test_pty fails when using setsid() https://bugs.python.org/issue38547 6 msgs #38895: performance degradation creating a mock object (by factor 7-8) https://bugs.python.org/issue38895 6 msgs #38861: zipfile: Corrupts filenames containing non-UTF8 characters https://bugs.python.org/issue38861 5 msgs #38878: os.PathLike subclasshook causes subclass checks true on abstra https://bugs.python.org/issue38878 5 msgs #38924: pathlib paths .normalize() https://bugs.python.org/issue38924 5 msgs Issues closed (48) ================== #7980: time.strptime not thread safe https://bugs.python.org/issue7980 closed by brett.cannon #20928: xml.etree.ElementInclude does not include nested xincludes https://bugs.python.org/issue20928 closed by scoder #21063: Touch up one-line descriptions of modules for module index https://bugs.python.org/issue21063 closed by brett.cannon #26730: SpooledTemporaryFile rollover corrupts data silently when Unic https://bugs.python.org/issue26730 closed by inada.naoki #27145: long_add and long_sub might return a new int where &small_ints https://bugs.python.org/issue27145 closed by inada.naoki #37073: clarify functions docs in IO modules and Bytes Objects https://bugs.python.org/issue37073 closed by inada.naoki #38328: Speed up the creation time of constant list and set literals. https://bugs.python.org/issue38328 closed by inada.naoki #38446: Ambiguous signature for builtins.__build_class__ https://bugs.python.org/issue38446 closed by pablogsal #38483: [venv] Add ~/.venvrc to change module defaults https://bugs.python.org/issue38483 closed by cooperlees #38524: functools.cached_property is not supported for setattr https://bugs.python.org/issue38524 closed by taleinat #38686: WWW-Authenticate qop="auth,auth-int" rejected by urllib https://bugs.python.org/issue38686 closed by orsenthil #38688: Python 3.8 regression: endless loop in shutil.copytree https://bugs.python.org/issue38688 closed by giampaolo.rodola #38803: test_wait3 and test_wait4 leaked references on x86 Gentoo Refl https://bugs.python.org/issue38803 closed by benjamin.peterson #38810: SSL connect() raises SSLError "[SSL] EC lib (_ssl.c:728)" https://bugs.python.org/issue38810 closed by benjamin.peterson #38817: Immutable types inplace operations work incorrect in async https://bugs.python.org/issue38817 closed by asvetlov #38834: TypedDict: no way to tell which (if any) keys are optional at https://bugs.python.org/issue38834 closed by levkivskyi #38855: test_unpack.py does not catch the unpacking of a set https://bugs.python.org/issue38855 closed by zach.ware #38862: IDLE: Include end newlines in whitespace fix. https://bugs.python.org/issue38862 closed by terry.reedy #38864: dbm: Can't open database with bytes-encoded filename https://bugs.python.org/issue38864 closed by serhiy.storchaka #38866: test_pyclbr replace asyncore https://bugs.python.org/issue38866 closed by inada.naoki #38876: pickle is raising KeyError insteat of pickle.UnpicklingError u https://bugs.python.org/issue38876 closed by alexandre.vassalotti #38877: Python 3.9 build fails under Debian 9.11 https://bugs.python.org/issue38877 closed by ned.deily #38881: unexpected behaviour of random.choices with zero weights https://bugs.python.org/issue38881 closed by rhettinger #38892: Audit Hook doc typos and confusion https://bugs.python.org/issue38892 closed by steve.dower #38896: Remove PyUnicode_ClearFreeList() function https://bugs.python.org/issue38896 closed by vstinner #38897: Example in socket documentation uses deprecated array.fromstri https://bugs.python.org/issue38897 closed by xtreak #38898: Tkinter checkbutton switch on and off together https://bugs.python.org/issue38898 closed by serhiy.storchaka #38899: Document that virtual environment activation for fish should u https://bugs.python.org/issue38899 closed by brett.cannon #38900: Add a glossary entry for "callable" objects https://bugs.python.org/issue38900 closed by rhettinger #38909: module name 'stat.py' https://bugs.python.org/issue38909 closed by zach.ware #38910: AssertionError: ElementTree not initialized, missing root https://bugs.python.org/issue38910 closed by scoder #38911: include __del__ in Generator ABC https://bugs.python.org/issue38911 closed by gvanrossum #38915: 'r[/]*', str, re.MULTILINE | re.DOTALL Won't match // in a str https://bugs.python.org/issue38915 closed by yanioaioan #38917: Color setting doesn't work in tkinter https://bugs.python.org/issue38917 closed by ned.deily #38919: support Assignment Operators https://bugs.python.org/issue38919 closed by zach.ware #38922: code.replace() does not raise audit event https://bugs.python.org/issue38922 closed by steve.dower #38923: Spurious OSError "Not enough memory resources" when allocating https://bugs.python.org/issue38923 closed by bkardon #38925: Decoding unicode not supported after upd to 2.7.17 [possible p https://bugs.python.org/issue38925 closed by steven.daprano #38927: venv --upgrade_deps fails on Windows https://bugs.python.org/issue38927 closed by vinay.sajip #38928: EnvBuilder.upgrade_dependencies() does not exist on 3.8 https://bugs.python.org/issue38928 closed by vinay.sajip #38929: Float // Integer doesn't give best result. https://bugs.python.org/issue38929 closed by steven.daprano #38930: Subprocess failed to kill child process after timeout when usi https://bugs.python.org/issue38930 closed by Xuan Hu #38931: pathlib.Path on Windows - parser issue https://bugs.python.org/issue38931 closed by zach.ware #38933: unusual behaviour on list of dependable lambdas https://bugs.python.org/issue38933 closed by tim.peters #38934: Dictionaries of dictionaries behave incorrectly when created f https://bugs.python.org/issue38934 closed by josh.r #38935: File modes with '+' character does not give expected output https://bugs.python.org/issue38935 closed by steven.daprano #38939: Using Python as a Calculator https://bugs.python.org/issue38939 closed by brett.cannon #38940: Add a new functools.cast() function https://bugs.python.org/issue38940 closed by brett.cannon

1 0

3.10 or 4.0?
by Facundo Batista 29 Nov '19

29 Nov '19

Hello! Did we take a decision of what comes after 3.9? Do we have a PEP for that decision? (couldn't find it) (not arguing in favor of one or another, just want to know the rationale behind it) Thanks! -- . Facundo Blog: http://www.taniquetil.com.ar/plog/ PyAr: http://www.python.org.ar/ Twitter: @facundobatista

8 12

buildbot.python.org database reset
by Zachary Ware 29 Nov '19

29 Nov '19

Hi all, The database backing buildbot.python.org has been reset in order to clean out old workers and builders, and to allow some relationships to be created properly to allow future cleanups without resetting everything. This does unfortunately mean that old links are going to be broken, including those to particular workers or builders since they have all been renumbered. Apologies for the inconvenience, Zach

1 0

arm64 python 3.5.6 test case failure - ctypes/test/test_structures.py (test_pass_by_value)
by Peter Morrow 29 Nov '19

29 Nov '19

Hi Folks, Python-dev seemed to be the most appropriate email alias for this, though please do point me somewhere else if this is not appropriate. We are using a custom arm64 based distro built using yocto and as such we are currently using python 3.5.6. We are hitting a failure in a python3 test case qemu running under QEMU that we would like to try to resolve if possible: root@10:/usr/lib/python3.5# python3 --version Python 3.5.6 root@10:/usr/lib/python3.5# python3 ctypes/test/test_structures.py .................F....s..... ====================================================================== FAIL: test_pass_by_value (__main__.StructureTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "ctypes/test/test_structures.py", line 419, in test_pass_by_value self.assertEqual(s.first, 0xdeadbeef) AssertionError: 195948557 != 3735928559 ---------------------------------------------------------------------- Ran 28 tests in 0.457s FAILED (failures=1, skipped=1) root@10:/usr/lib/python3.5# From searching the web I came across this bug which appears to match what we are seeing: https://bugs.python.org/issue29804 ("test_ctypes test_pass_by_value fails on arm64 (aarch64) architecture"). However it looks like this fix is already in 3.5.6 so this isn't it. Next set of searching led me here: https://bugs.python.org/issue30353 and thus this patch: https://github.com/python/cpython/commit/9ba3aa4d02a110d1a1ea464a8aff3be7dd… So I applied this patch but we end up with this now: root@10:~# cd /usr/lib/python3.5/ root@10:/usr/lib/python3.5# python3 ctypes/test/test_structures.py Traceback (most recent call last): File "ctypes/test/test_structures.py", line 2, in <module> from ctypes import * File "/usr/lib/python3.5/ctypes/__init__.py", line 7, in <module> from _ctypes import Union, Structure, Array ImportError: No module named '_ctypes' root@10:/usr/lib/python3.5# Can anyone help point me in the right direction with this failure we are seeing? We are stuck with python 3.5.6 for now due to the version of yocto we are using, though I'm concerned since this seems to be a fairly fundamental issue which is being exposed by this testcase. Do let me know if you require any more information from me. Many Thanks, Peter.

2 2

Are we ready to start cleaning up deprecated stuff?
by Brett Cannon 28 Nov '19

28 Nov '19

Python 3.9 is going to be the first release which will exist without any Python 2.7 overlap. Does this mean we are ready to start removing things that have been deprecated since at least Python 3.7? PEP 4 says [we are in the clear for modules](https://www.python.org/dev/peps/pep-0004/#for-modules-existing-in-…, but I figured I would double-check as questions of cleaning up individual functions that have been deprecated for a very long time are now starting to come up (e.g. https://bugs.python.org/issue38916).

2 4

Restricted Entry Point from PEP-551/578
by Jason Killen 23 Nov '19

23 Nov '19

I sent in a couple of PRs, accepted and merged (Thanks!), lately that switch to using io.open_code when appropriate. In the process of making those PRs I spent a bit of time reading the two related PEPs. In PEP-551 there's a suggestion that people use a restricted entry point in production environments. I googled around a bit and couldn't find any evidence that there was an existing implementation, at least not made public, that people were using in a general sense. So I created a branch from my fork and over the last few days have implemented part of what's suggested in PEP-551. Specifically my changes remove most of the command line options, ignore envvars (except for a possible logging filename for the audit hooks), and registers an audit hook that logs everything to the defined envvar when provided or stderr if not. Now the questions: 1) Does anybody care? Is anyone currently doing this or planning on doing this? 2) Do we want to provide an "official" version of a restricted entry point that could be used as-is or easily modified per specific needs? Seems kinda silly to make everyone roll their own version but I'm happy to yield to the will of the people. 3) What's the chance we wanna merge something like this into the official master branch? I accomplished what I wanted to do using a few #ifdef's and some funky makefile magic. I think it would merge easily. Maintaining a fork sounds like a lot of work to me. And here's the code: I'm very open to suggestions. I basically have no idea what I'm doing. I haven't touched C in about 7 years so don't expect the Mona Lisa. https://github.com/python/cpython/compare/master...jsnklln:PEP551_restricte… -- Jason Killen jsnklln(a)gmail.com Pain is inevitable, misery is optional.

4 9

Summary of Python tracker Issues
by Python tracker 23 Nov '19

23 Nov '19

ACTIVITY SUMMARY (2019-11-15 - 2019-11-22) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7171 (+23) closed 43475 (+57) total 50646 (+80) Open issues with patches: 2826 Issues opened (61) ================== #25172: Unix-only crypt should not be present on Windows. https://bugs.python.org/issue25172 reopened by xdegaye #32371: Delay-loading of python dll is impossible when using some C ma https://bugs.python.org/issue32371 reopened by Pierre Chatelier #37957: Allow regrtest to receive a file with test (and subtests) to i https://bugs.python.org/issue37957 reopened by pablogsal #38817: Immutable types inplace operations work incorrect in async https://bugs.python.org/issue38817 opened by bryzgaloff #38818: Modify PyInterpreterState.eval_frame to pass tstate (PyThreadS https://bugs.python.org/issue38818 opened by vstinner #38820: Make Python compatible with OpenSSL 3.0.0 https://bugs.python.org/issue38820 opened by christian.heimes #38822: Inconsistent os.stat behavior for directory with Access Denied https://bugs.python.org/issue38822 opened by CrouZ #38823: Improve stdlib module initialization error handling. https://bugs.python.org/issue38823 opened by brandtbucher #38825: shutil.disk_usage - Lacking documentation https://bugs.python.org/issue38825 opened by Lord Anton Hvornum #38826: Regular Expression Denial of Service in urllib.request.Abstrac https://bugs.python.org/issue38826 opened by bc #38828: http.cookiejar handle cookie.version to be None https://bugs.python.org/issue38828 opened by kovid #38829: Make the function flush_io accessible in the C-API https://bugs.python.org/issue38829 opened by Jean-Didier #38832: setup.py can report builtin modules as missing modules https://bugs.python.org/issue38832 opened by christian.heimes #38833: Issue with multiprocessing.Pool & multiprocessing.Queue https://bugs.python.org/issue38833 opened by bigbizze #38834: TypedDict: no way to tell which (if any) keys are optional at https://bugs.python.org/issue38834 opened by Zac Hatfield-Dodds #38836: Links are duplicated in documentation search result https://bugs.python.org/issue38836 opened by MaT1g3R #38840: incorrect __all__ list in multiprocessing.managers module https://bugs.python.org/issue38840 opened by xdegaye #38842: test_multiprocessing_spawn altered the execution environment i https://bugs.python.org/issue38842 opened by pablogsal #38843: Document argparse behaviour when custom namespace object alrea https://bugs.python.org/issue38843 opened by zerkms #38845: test_shared_memory_SharedMemoryServer_ignores_sigint and other https://bugs.python.org/issue38845 opened by tlecarrour #38846: async: Return context manager from open(_unix)_connection https://bugs.python.org/issue38846 opened by srittau #38848: compileall fails when the platform lacks a functional sem_ope https://bugs.python.org/issue38848 opened by xdegaye #38849: test_timestamp_naive fails on android https://bugs.python.org/issue38849 opened by xdegaye #38850: test_largefile fails on android https://bugs.python.org/issue38850 opened by xdegaye #38851: UDPLITE tests fail on android https://bugs.python.org/issue38851 opened by xdegaye #38852: test_recursion_limit in test_threading crashes with SIGSEGV on https://bugs.python.org/issue38852 opened by xdegaye #38854: Decorator breaks inspect.getsource https://bugs.python.org/issue38854 opened by crusaderky #38855: test_unpack.py does not catch the unpacking of a set https://bugs.python.org/issue38855 opened by Ylem #38856: wait_closed() can raise ConnectionResetError https://bugs.python.org/issue38856 opened by yselivanov #38858: new_interpreter() should reuse more Py_InitializeFromConfig() https://bugs.python.org/issue38858 opened by vstinner #38860: GenericPyCData_new does not invoke new or init https://bugs.python.org/issue38860 opened by b1tninja #38861: zipfile: Corrupts filenames containing non-UTF8 characters https://bugs.python.org/issue38861 opened by jgoerzen #38862: IDLE: Include end newlines in whitespace fix. https://bugs.python.org/issue38862 opened by terry.reedy #38864: dbm: Can't open database with bytes-encoded filename https://bugs.python.org/issue38864 opened by jgoerzen #38865: Can Py_Finalize() be called if the current interpreter is not https://bugs.python.org/issue38865 opened by vstinner #38866: test_pyclbr replace asyncore https://bugs.python.org/issue38866 opened by jacksonriley #38867: Enable Tkinter on Windows ARM https://bugs.python.org/issue38867 opened by steve.dower #38868: Shutil cannot delete a folder that contains an .ini file https://bugs.python.org/issue38868 opened by QueenSvetlana #38870: Expose ast.unparse in the ast module https://bugs.python.org/issue38870 opened by pablogsal #38871: lib2to3 generates invalid code with filter and ternary operato https://bugs.python.org/issue38871 opened by Zoran Simic #38872: Document exec symbol for codeop.compile_command https://bugs.python.org/issue38872 opened by cheryl.sabella #38873: find_library for libcrypto and libssl on Catalina returns the https://bugs.python.org/issue38873 opened by worldwise001 #38874: asyncio.Queue: putting items out of order when it is full https://bugs.python.org/issue38874 opened by esrse #38876: pickle is raising KeyError insteat of pickle.UnpicklingError u https://bugs.python.org/issue38876 opened by Linus Pithan #38877: Python 3.9 build fails under Debian 9.11 https://bugs.python.org/issue38877 opened by DahlitzFlorian #38878: os.PathLike subclasshook causes subclass checks true on abstra https://bugs.python.org/issue38878 opened by bar.harel #38879: Reordered error checking in PyArena_New(). https://bugs.python.org/issue38879 opened by Zotyamester #38880: Subinterpreters: List interpreters associated with a channel e https://bugs.python.org/issue38880 opened by LewisGaul #38881: unexpected behaviour of random.choices with zero weights https://bugs.python.org/issue38881 opened by IRomanowska #38882: IDLE should not make the about dialog be a transient of the wi https://bugs.python.org/issue38882 opened by culler #38883: Path.home() should ignore HOME env var like os.path.expanduser https://bugs.python.org/issue38883 opened by lazka #38884: __import__ is not thread-safe on Python 3 https://bugs.python.org/issue38884 opened by Valentyn Tymofieiev #38886: permissions too restrictive in zipfile.writestr https://bugs.python.org/issue38886 opened by rdussin #38887: test_asyncio: test_pipe_handle() failed on AMD64 Windows7 SP1 https://bugs.python.org/issue38887 opened by vstinner #38888: Popen should use pidfd_open to implement a non-busy wait https://bugs.python.org/issue38888 opened by SpecLad #38890: A subprocess.Popen created with creationFlags=DETACHED_PROCESS https://bugs.python.org/issue38890 opened by ShaneHarvey #38891: ShareableList read and write access is O(N), should be O(1) https://bugs.python.org/issue38891 opened by Jake Northey #38892: Audit Hook doc typos and confusion https://bugs.python.org/issue38892 opened by terry.reedy #38893: broken container/selinux integration https://bugs.python.org/issue38893 opened by Leif Middelschulte #38894: Path.glob() sometimes misses files that match https://bugs.python.org/issue38894 opened by thierry.parmentelat #38895: performance degradation creating a mock object (by factor 7-8) https://bugs.python.org/issue38895 opened by julianhille Most recent 15 issues with no replies (15) ========================================== #38895: performance degradation creating a mock object (by factor 7-8) https://bugs.python.org/issue38895 #38892: Audit Hook doc typos and confusion https://bugs.python.org/issue38892 #38890: A subprocess.Popen created with creationFlags=DETACHED_PROCESS https://bugs.python.org/issue38890 #38887: test_asyncio: test_pipe_handle() failed on AMD64 Windows7 SP1 https://bugs.python.org/issue38887 #38886: permissions too restrictive in zipfile.writestr https://bugs.python.org/issue38886 #38883: Path.home() should ignore HOME env var like os.path.expanduser https://bugs.python.org/issue38883 #38880: Subinterpreters: List interpreters associated with a channel e https://bugs.python.org/issue38880 #38879: Reordered error checking in PyArena_New(). https://bugs.python.org/issue38879 #38872: Document exec symbol for codeop.compile_command https://bugs.python.org/issue38872 #38867: Enable Tkinter on Windows ARM https://bugs.python.org/issue38867 #38865: Can Py_Finalize() be called if the current interpreter is not https://bugs.python.org/issue38865 #38862: IDLE: Include end newlines in whitespace fix. https://bugs.python.org/issue38862 #38861: zipfile: Corrupts filenames containing non-UTF8 characters https://bugs.python.org/issue38861 #38860: GenericPyCData_new does not invoke new or init https://bugs.python.org/issue38860 #38856: wait_closed() can raise ConnectionResetError https://bugs.python.org/issue38856 Most recent 15 issues waiting for review (15) ============================================= #38886: permissions too restrictive in zipfile.writestr https://bugs.python.org/issue38886 #38880: Subinterpreters: List interpreters associated with a channel e https://bugs.python.org/issue38880 #38878: os.PathLike subclasshook causes subclass checks true on abstra https://bugs.python.org/issue38878 #38876: pickle is raising KeyError insteat of pickle.UnpicklingError u https://bugs.python.org/issue38876 #38870: Expose ast.unparse in the ast module https://bugs.python.org/issue38870 #38866: test_pyclbr replace asyncore https://bugs.python.org/issue38866 #38858: new_interpreter() should reuse more Py_InitializeFromConfig() https://bugs.python.org/issue38858 #38852: test_recursion_limit in test_threading crashes with SIGSEGV on https://bugs.python.org/issue38852 #38848: compileall fails when the platform lacks a functional sem_ope https://bugs.python.org/issue38848 #38845: test_shared_memory_SharedMemoryServer_ignores_sigint and other https://bugs.python.org/issue38845 #38840: incorrect __all__ list in multiprocessing.managers module https://bugs.python.org/issue38840 #38834: TypedDict: no way to tell which (if any) keys are optional at https://bugs.python.org/issue38834 #38823: Improve stdlib module initialization error handling. https://bugs.python.org/issue38823 #38820: Make Python compatible with OpenSSL 3.0.0 https://bugs.python.org/issue38820 #38818: Modify PyInterpreterState.eval_frame to pass tstate (PyThreadS https://bugs.python.org/issue38818 Top 10 most discussed issues (10) ================================= #37228: UDP sockets created by create_datagram_endpoint() allow by def https://bugs.python.org/issue37228 34 msgs #38823: Improve stdlib module initialization error handling. https://bugs.python.org/issue38823 25 msgs #22367: Add open_file_descriptor parameter to fcntl.lockf() (use the n https://bugs.python.org/issue22367 15 msgs #38500: Provide a way to get/set PyInterpreterState.frame_eval without https://bugs.python.org/issue38500 13 msgs #38858: new_interpreter() should reuse more Py_InitializeFromConfig() https://bugs.python.org/issue38858 13 msgs #37334: Add a cancel method to asyncio Queues https://bugs.python.org/issue37334 7 msgs #38021: pep425 tag for AIX is inadequate https://bugs.python.org/issue38021 7 msgs #38884: __import__ is not thread-safe on Python 3 https://bugs.python.org/issue38884 7 msgs #33125: Windows 10 ARM64 platform support https://bugs.python.org/issue33125 6 msgs #33387: Simplify bytecodes for try-finally, try-except and with blocks https://bugs.python.org/issue33387 6 msgs Issues closed (58) ================== #16576: ctypes: structure with bitfields as argument https://bugs.python.org/issue16576 closed by vinay.sajip #21767: singledispatch docs should explicitly mention support for abst https://bugs.python.org/issue21767 closed by lukasz.langa #23667: IDLE to provide option for making trailing whitespace visible https://bugs.python.org/issue23667 closed by terry.reedy #25866: Reference 3. Data Model: miscellaneous minor cleanups on the w https://bugs.python.org/issue25866 closed by rhettinger #26011: Document necesities for cmp argument of sorted https://bugs.python.org/issue26011 closed by serhiy.storchaka #26278: BaseTransport.close() does not trigger connection_lost() https://bugs.python.org/issue26278 closed by vstinner #27647: Update Windows 2.7 build to Tcl/Tk 8.5.19 https://bugs.python.org/issue27647 closed by zach.ware #27724: PEP3119 inconsintent with actual CPython impl https://bugs.python.org/issue27724 closed by gvanrossum #28286: gzip guessing of mode is ambiguous https://bugs.python.org/issue28286 closed by serhiy.storchaka #29275: time module still has Y2K issues note https://bugs.python.org/issue29275 closed by benjamin.peterson #34792: Tutorial doesn''t discuss / and * function arguments https://bugs.python.org/issue34792 closed by pablogsal #34979: Python throws “SyntaxError: Non-UTF-8 code start with \xe8.. https://bugs.python.org/issue34979 closed by ausaki #35409: Async generator might re-throw GeneratorExit on aclose() https://bugs.python.org/issue35409 closed by asvetlov #36277: pdb's recursive debug command is not listed in the docs https://bugs.python.org/issue36277 closed by cheryl.sabella #36854: GC operates out of global runtime state. https://bugs.python.org/issue36854 closed by vstinner #37083: Document TYPE_COMMENT in documentation reference for compound https://bugs.python.org/issue37083 closed by pablogsal #37195: test_utime fails on MacOS Mojave (Kernel Version 18.6.0:) https://bugs.python.org/issue37195 closed by pablogsal #37838: typing.get_type_hints not working with forward-declaration and https://bugs.python.org/issue37838 closed by levkivskyi #38453: ntpath.realpath() does not fully resolve relative paths https://bugs.python.org/issue38453 closed by steve.dower #38526: zipfile.Path has the wrong method name https://bugs.python.org/issue38526 closed by xtreak #38622: _ctypes.dlsym (py_dl_sym) does not trigger audit hooks https://bugs.python.org/issue38622 closed by steve.dower #38639: Optimize floor(), ceil() and trunc() for floats https://bugs.python.org/issue38639 closed by serhiy.storchaka #38650: Add constantness to PyStructSequence_UnnamedField https://bugs.python.org/issue38650 closed by serhiy.storchaka #38651: Add WolfSSL support https://bugs.python.org/issue38651 closed by Daniel Johnson #38678: TypeError for Tutorial 10.3 Example 2 https://bugs.python.org/issue38678 closed by rhettinger #38707: Multiprocessing: bug with Native ID for threading.mainthread() https://bugs.python.org/issue38707 closed by pitrou #38712: add signal.pidfd_send_signal https://bugs.python.org/issue38712 closed by benjamin.peterson #38722: runpy should use io.open_code() instead of open() https://bugs.python.org/issue38722 closed by taleinat #38724: Implement subprocess.Popen.__repr__ https://bugs.python.org/issue38724 closed by taleinat #38778: Document that os.fork is not allowed in subinterpreters https://bugs.python.org/issue38778 closed by eric.snow #38789: difflib lacks a way to check if results are empty https://bugs.python.org/issue38789 closed by tim.peters #38790: test_fcntl failing on macOS CI https://bugs.python.org/issue38790 closed by ned.deily #38807: Better exception message in os.path.join https://bugs.python.org/issue38807 closed by rhettinger #38809: On Windows, build scripts should prefer using python.exe from https://bugs.python.org/issue38809 closed by taleinat #38813: math.modf() change integer returned part as integer instead of https://bugs.python.org/issue38813 closed by mark.dickinson #38814: Python3.7.5 crashes on OSX with my django project https://bugs.python.org/issue38814 closed by ned.deily #38816: Clarify about fork() and the CPython runtime in the C-API docs https://bugs.python.org/issue38816 closed by eric.snow #38819: The redirect https://bugs.python.org/issue38819 closed by terry.reedy #38821: argparse calls ngettext with deprecated non-integer value https://bugs.python.org/issue38821 closed by taleinat #38824: sasddsdsd https://bugs.python.org/issue38824 closed by christian.heimes #38827: [security] requests (lib) connects to a wrong host https://bugs.python.org/issue38827 closed by zach.ware #38830: `A Qt GUI for logging` produces TypeError https://bugs.python.org/issue38830 closed by vinay.sajip #38831: urllib.request header characters being changed to lowercase https://bugs.python.org/issue38831 closed by eric.smith #38835: pyfpe.h: Exclude PyFPE_START_PROTECT and PyFPE_END_PROTECT fro https://bugs.python.org/issue38835 closed by vstinner #38837: struct.pack: Unable to pack more than 256 bytes at a time https://bugs.python.org/issue38837 closed by Dave Lotton #38838: Exception ignored in: module 'threading' in _shutdown, _signal https://bugs.python.org/issue38838 closed by wesinator #38839: Fix some unused functions in test suite https://bugs.python.org/issue38839 closed by brett.cannon #38841: [asyncio] bind() on a unix socket raises PermissionError on An https://bugs.python.org/issue38841 closed by xdegaye #38844: test_multiprocessing_fork emit user warning https://bugs.python.org/issue38844 closed by corona10 #38847: AST Optimization for Single Target List Comprehension https://bugs.python.org/issue38847 closed by rhettinger #38853: set.repr breaches docstring contract https://bugs.python.org/issue38853 closed by josh.r #38857: AsyncMock issue with awaitable return_value/side_effect/wraps https://bugs.python.org/issue38857 closed by lisroach #38859: AsyncMock says it raises StopIteration but that is Impossible https://bugs.python.org/issue38859 closed by lisroach #38863: Improve is_cgi() in http.server https://bugs.python.org/issue38863 closed by asvetlov #38869: Unexpectedly variable result https://bugs.python.org/issue38869 closed by zach.ware #38875: test_capi: test_trashcan_python_class1() and test_trashcan_pyt https://bugs.python.org/issue38875 closed by vstinner #38885: Have os.PathLike inherit from typing.Protocol https://bugs.python.org/issue38885 closed by brett.cannon #38889: Segmentation fault when using EPF Importer https://bugs.python.org/issue38889 closed by eric.smith

1 0

Hold multiple tracebacks per-object in tracemalloc
by Sümer Cip 21 Nov '19

21 Nov '19

Hi everyone, First of all, I would like to thank for such a useful tool for debugging memory issues. I am pretty proud as a Python lover that we have such a tool: tracemalloc:) I would like to ask if something is feasible/practical regarding tracemalloc: AFAIU, tracemalloc holds a single traceback per-object: Example: class A: def __init__(self): self._d = [] def alloc(self): self._d += [1] * 512 def alloc_more(self): self._d += [1] * 512 tracemalloc.start(25) a = A() a.alloc() a.alloc_more() stats = tracemalloc.take_snapshot().statistics('traceback') for t in stats: print(t) print(t.traceback.format()) """ Output: ... 5.py:38: size=9264 B, count=1, average=9264 B [' File "5.py", line 38', ' a.alloc_more()', ' File "5.py", line 32', ' self._d += [1] * 512'] """ Now, allocation of alloc and alloc_more functions seems to be merged into a single traceback. Is it possible we add (maybe a constant number of tracebacks) per object? This might be pretty useful to find the responsible leak in situations where same object is modified in many places? I have been playing with this module only lately on tracemalloc, so please correct if a major piece is missing in my example or my understanding is wrong in some way. Thanks as always! -- Sümer Cip

2 2