[Python-checkins] bpo-13487: Use sys.modules.copy() in inspect.getmodule() for thread safety. (GH-18786)

Gregory P. Smith webhook-mailer at python.org
Wed Mar 4 19:45:36 EST 2020


https://github.com/python/cpython/commit/85cf1d514b84dc9a4bcb40e20a12e1d82ff19f20
commit: 85cf1d514b84dc9a4bcb40e20a12e1d82ff19f20
branch: master
author: Gregory P. Smith <gps at google.com>
committer: GitHub <noreply at github.com>
date: 2020-03-04T16:45:22-08:00
summary:

bpo-13487: Use sys.modules.copy() in inspect.getmodule() for thread safety. (GH-18786)

`list(sys.modules.items())` was apparently not immune to "dictionary
changed size during iteration" errors.

Tested internally using an integration test that has run into this a couple of times in the past two years.  With this patch applied, the test is no longer flaky.

files:
A Misc/NEWS.d/next/Library/2020-03-04-16-10-59.bpo-13487.gqe4Fb.rst
M Lib/inspect.py

diff --git a/Lib/inspect.py b/Lib/inspect.py
index bb82f96fdf374..125bd456a1c46 100644
--- a/Lib/inspect.py
+++ b/Lib/inspect.py
@@ -741,7 +741,7 @@ def getmodule(object, _filename=None):
         return sys.modules.get(modulesbyfile[file])
     # Update the filename to module name cache and check yet again
     # Copy sys.modules in order to cope with changes while iterating
-    for modname, module in list(sys.modules.items()):
+    for modname, module in sys.modules.copy().items():
         if ismodule(module) and hasattr(module, '__file__'):
             f = module.__file__
             if f == _filesbymodname.get(modname, None):
diff --git a/Misc/NEWS.d/next/Library/2020-03-04-16-10-59.bpo-13487.gqe4Fb.rst b/Misc/NEWS.d/next/Library/2020-03-04-16-10-59.bpo-13487.gqe4Fb.rst
new file mode 100644
index 0000000000000..5a1f02a7bdf37
--- /dev/null
+++ b/Misc/NEWS.d/next/Library/2020-03-04-16-10-59.bpo-13487.gqe4Fb.rst
@@ -0,0 +1,3 @@
+Avoid a possible *"RuntimeError: dictionary changed size during iteration"*
+from :func:`inspect.getmodule` when it tried to loop through
+:attr:`sys.modules`.



More information about the Python-checkins mailing list