[issue16421] importlib.machinery.ExtensionFileLoader cannot load several modules from the same shared object
New submission from Václav Šmilauer: This issue was split off issue16194 (I am not copying the whole discussion here). It was suggested a new issue is opened for Python3, where a proper fix can be done. Python internally caches dynamically loaded modules, but the cache is based on the filename only. If one file contains several modules, only the first of them is imported and initialized properly. This interface was previously exposed via imp.load_dynamic, the same codepath is used by importlib.machinery.ExtensionFileLoader now. A solution is to cache by the (filename, modulename) tuple, which avoids any ambiguity. I am attaching a simple patch for that, agains current hg tip (80272:ec00f8570c55), and tested with the scripot attached to issue16194. I have not modified the test suite, I am not sure whether testing compiled modules is actually supported (did not see any compiled files in there), I will be glad for help. ---------- components: Extension Modules files: many-modules-in-one-so_1.diff keywords: patch messages: 174967 nosy: Arfrever, amaury.forgeotdarc, brett.cannon, docs@python, eudoxos, ncoghlan, r.david.murray priority: normal severity: normal status: open title: importlib.machinery.ExtensionFileLoader cannot load several modules from the same shared object type: behavior versions: Python 3.5 Added file: http://bugs.python.org/file27909/many-modules-in-one-so_1.diff _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Storing several modules in single so/pyd file is crazy idea from my perspective. The test is definitely required. BTW, Why version is set to 3.5? Should component be set to "Interpreter code"? ---------- nosy: +asvetlov _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Amaury Forgeot d'Arc added the comment: It's not that crazy, if you consider that all builtin modules are stored in python33.dll. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: Storing several modules in one .so file offloads some issues which have to be dealt with manually (like one module needing symbols from other module, or even cross-dependencies) to the linker. In any case, unless forbidden and signalled, it should be supported. I set version to 3.4 and component to "Interpreter core", as you suggested, it is probably more appropriate. How do I write test which requires a custom module to be compiled? ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Changes by Václav Šmilauer <eu@doxos.eu>: ---------- components: +Interpreter Core -Extension Modules versions: +Python 3.4 -Python 3.5 _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Amaury, I'm ok with pushing several modules into python33.dll or embedding it directly into executable. For standard so/dll files you have to use different file names for modules to make regular import statement work. It can be done via symlink/hardlink, but looks a bit hairy. Václav, python already have _testbuffer and _testcapi modules used for testing only. I think you can add yet another one. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
R. David Murray added the comment: There is an example in the test suite somewhere. Probably in the distutils tests. Search for xxmodule...but you'll need to create your own source. I'd see if you can write it out from the test rather than checking in another data file, but a data file is an option if needed. ---------- components: +Extension Modules -Interpreter Core type: behavior -> enhancement _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: @Andrew: I was using symlinks to achieve this, until I found recently that some exotic systems (read: windows) have still troubles there, like not letting non-admins create symlinks. ---------- type: enhancement -> behavior versions: +Python 3.5 -Python 3.4 _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
R. David Murray added the comment: Sorry, didn't mean to change the component back. ---------- components: +Interpreter Core -Extension Modules type: behavior -> enhancement versions: +Python 3.4 -Python 3.5 _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: I added the test, with a module Modules/_testimportmultiple.c. The test uses the (undocumented) imp module, but all othet tests in Lib/test/test_imp.py do the same, so I assume it is OK? ---------- Added file: http://bugs.python.org/file27911/many-modules-in-one-so_2.diff _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Brett Cannon added the comment: It's fine to cheat in tests, although test_imp predates importlib which is why it uses an undocumented API. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Reviewed and commented the last patch. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: Attaching patch based on Andrew's review, agains latest hg (80291:859ef54bdce). For the MSVC files, I copied what was there for _testcapimodule in PC/VS9.0 and PCbuild, and created two new UUIDs: one for _testimportmultiple itself (36D0C52C-DF4E-45D0-8BC7-E294C3ABC781; used in .sln, .vcproj and .vcxproj files), and one for _testimportmultiple.vcxproj.filters (1ec38ad9-1abf-4b80-8628-ac43ccba324b; used only once). Please check that I did that correctly. (I am wondering how can one maintain such a build system.) I also added myself to Misc/ACKS (and sent contributor agreement by mail), added the entry to Misc/NEWS. ---------- components: +Extension Modules -Interpreter Core type: enhancement -> behavior versions: +Python 3.5 -Python 3.4 Added file: http://bugs.python.org/file27918/many-modules-in-one-so_3.diff _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Looks better, will check on Windows a bit later. BTW, ACKS and NEWS are usually edited by committer, but leave that as is for now. ---------- versions: +Python 3.4 -Python 3.5 _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: Good, will let editors do that next time. I was following http://docs.python.org/devguide/patch.html#preparation which says "Sixth, if you are not already in the Misc/ACKS file then add your name." For NEWS, I was reading http://docs.python.org/devguide/committing.html#news-entries, but it is true it talks about commits, not about patches. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Nick Coghlan added the comment: Yeah, ACKS is fine (we just don't mind doing it if the submitter leaves it out). Updating NEWS is less useful because it almost inevitably causes a conflict when the patch is applied. (We occasionally mutter about adopting a less conflict-prone approach to handling NEWS entries, but nobody has ever found it annoying enough to design a solution and officially propose switching to it) ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Václav, your patch passed on Windows. Will commit it after double check. Thanks. ---------- assignee: -> asvetlov _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Changes by Eric Snow <ericsnowcurrently@gmail.com>: ---------- nosy: +eric.snow _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Nick Coghlan added the comment: One nice feature of this is the potential to simplify single-file distribution - pack your application into a zip file, and only need to extract a single shared library for *all* your extension modules, which could be handled via a utility function called in __main__.py rather than needing to be built into the interpreter. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Brett Cannon added the comment: Are you still planning on committing this, Andrew? ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Roundup Robot added the comment: New changeset 6eefe4d537b3 by Andrew Svetlov in branch 'default': Issue #16421: allow to load multiple modules from the same shared object. http://hg.python.org/cpython/rev/6eefe4d537b3 ---------- nosy: +python-dev _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Committed. Sorry for delay. Thanks, Vaclav! ---------- resolution: -> fixed stage: -> committed/rejected status: open -> closed _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
STINNER Victor added the comment: Some tests are failing since the changeset 6eefe4d537b3. Example: http://buildbot.python.org/all/builders/x86%20RHEL%206%203.x/builds/1431/ste... Please check buildbots. [176/371] test_pkgutil test_getdata_filesys (test.test_pkgutil.PkgutilTests) ... ok test_getdata_zipfile (test.test_pkgutil.PkgutilTests) ... ok test_unreadable_dir_on_syspath (test.test_pkgutil.PkgutilTests) ... ok test_alreadyloaded (test.test_pkgutil.PkgutilPEP302Tests) ... ERROR test_getdata_pep302 (test.test_pkgutil.PkgutilPEP302Tests) ... ERROR test_mixed_namespace (test.test_pkgutil.ExtendPathTests) ... ERROR test_simple (test.test_pkgutil.ExtendPathTests) ... ERROR test_nested (test.test_pkgutil.NestedNamespacePackageTest) ... ok test_get_importer_avoids_emulation (test.test_pkgutil.ImportlibMigrationTests) ... ok test_get_loader_avoids_emulation (test.test_pkgutil.ImportlibMigrationTests) ... ok test_importer_deprecated (test.test_pkgutil.ImportlibMigrationTests) ... ok test_iter_importers_avoids_emulation (test.test_pkgutil.ImportlibMigrationTests) ... ok test_loader_deprecated (test.test_pkgutil.ImportlibMigrationTests) ... ok ====================================================================== ERROR: test_alreadyloaded (test.test_pkgutil.PkgutilPEP302Tests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/test/test_pkgutil.py", line 139, in test_alreadyloaded self.assertEqual(foo.loads, 1) AttributeError: 'module' object has no attribute 'loads' ====================================================================== ERROR: test_getdata_pep302 (test.test_pkgutil.PkgutilPEP302Tests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/pkgutil.py", line 502, in find_loader return importlib.find_loader(fullname, path) File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/importlib/__init__.py", line 64, in find_loader loader = sys.modules[name].__loader__ AttributeError: 'module' object has no attribute '__loader__' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/test/test_pkgutil.py", line 131, in test_getdata_pep302 self.assertEqual(pkgutil.get_data('foo', 'dummy'), "Hello, world!") File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/pkgutil.py", line 625, in get_data loader = get_loader(package) File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/pkgutil.py", line 480, in get_loader return find_loader(fullname) File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/pkgutil.py", line 508, in find_loader raise ImportError(msg.format(fullname, type(ex), ex)) from ex ImportError: Error while finding loader for 'foo' (<class 'AttributeError'>: 'module' object has no attribute '__loader__') ====================================================================== ERROR: test_mixed_namespace (test.test_pkgutil.ExtendPathTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "<frozen importlib._bootstrap>", line 1523, in _find_and_load_unlocked AttributeError: 'module' object has no attribute '__path__' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/test/test_pkgutil.py", line 198, in test_mixed_namespace import foo.bar ImportError: No module named 'foo.bar'; foo is not a package ====================================================================== ERROR: test_simple (test.test_pkgutil.ExtendPathTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "<frozen importlib._bootstrap>", line 1523, in _find_and_load_unlocked AttributeError: 'module' object has no attribute '__path__' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/test/test_pkgutil.py", line 170, in test_simple import foo.bar ImportError: No module named 'foo.bar'; foo is not a package ---------------------------------------------------------------------- Ran 13 tests in 0.027s ---------- nosy: +haypo resolution: fixed -> status: closed -> open _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Antoine Pitrou added the comment: Indeed it looks like this commit may be the culprit for numerous buildbot failures. ---------- nosy: +pitrou _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Antoine Pitrou added the comment: Naming the test modules "foo" and "bar" was perhaps not the best idea. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Roundup Robot added the comment: New changeset 2e492a9a1845 by Andrew Svetlov in branch 'default': Rename test module names for #16421 to don't clash with other tests. http://hg.python.org/cpython/rev/2e492a9a1845 ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Fixed. Antoine, you are right: foo and bar was bad names. ---------- resolution: -> fixed status: open -> closed _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Storing several modules in single so/pyd file is crazy idea from my perspective. The test is definitely required. BTW, Why version is set to 3.5? Should component be set to "Interpreter code"? ---------- nosy: +asvetlov _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Amaury Forgeot d'Arc added the comment: It's not that crazy, if you consider that all builtin modules are stored in python33.dll. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: Storing several modules in one .so file offloads some issues which have to be dealt with manually (like one module needing symbols from other module, or even cross-dependencies) to the linker. In any case, unless forbidden and signalled, it should be supported. I set version to 3.4 and component to "Interpreter core", as you suggested, it is probably more appropriate. How do I write test which requires a custom module to be compiled? ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Changes by Václav Šmilauer <eu@doxos.eu>: ---------- components: +Interpreter Core -Extension Modules versions: +Python 3.4 -Python 3.5 _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Amaury, I'm ok with pushing several modules into python33.dll or embedding it directly into executable. For standard so/dll files you have to use different file names for modules to make regular import statement work. It can be done via symlink/hardlink, but looks a bit hairy. Václav, python already have _testbuffer and _testcapi modules used for testing only. I think you can add yet another one. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
R. David Murray added the comment: There is an example in the test suite somewhere. Probably in the distutils tests. Search for xxmodule...but you'll need to create your own source. I'd see if you can write it out from the test rather than checking in another data file, but a data file is an option if needed. ---------- components: +Extension Modules -Interpreter Core type: behavior -> enhancement _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: @Andrew: I was using symlinks to achieve this, until I found recently that some exotic systems (read: windows) have still troubles there, like not letting non-admins create symlinks. ---------- type: enhancement -> behavior versions: +Python 3.5 -Python 3.4 _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
R. David Murray added the comment: Sorry, didn't mean to change the component back. ---------- components: +Interpreter Core -Extension Modules type: behavior -> enhancement versions: +Python 3.4 -Python 3.5 _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: I added the test, with a module Modules/_testimportmultiple.c. The test uses the (undocumented) imp module, but all othet tests in Lib/test/test_imp.py do the same, so I assume it is OK? ---------- Added file: http://bugs.python.org/file27911/many-modules-in-one-so_2.diff _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Brett Cannon added the comment: It's fine to cheat in tests, although test_imp predates importlib which is why it uses an undocumented API. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Reviewed and commented the last patch. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: Attaching patch based on Andrew's review, agains latest hg (80291:859ef54bdce). For the MSVC files, I copied what was there for _testcapimodule in PC/VS9.0 and PCbuild, and created two new UUIDs: one for _testimportmultiple itself (36D0C52C-DF4E-45D0-8BC7-E294C3ABC781; used in .sln, .vcproj and .vcxproj files), and one for _testimportmultiple.vcxproj.filters (1ec38ad9-1abf-4b80-8628-ac43ccba324b; used only once). Please check that I did that correctly. (I am wondering how can one maintain such a build system.) I also added myself to Misc/ACKS (and sent contributor agreement by mail), added the entry to Misc/NEWS. ---------- components: +Extension Modules -Interpreter Core type: enhancement -> behavior versions: +Python 3.5 -Python 3.4 Added file: http://bugs.python.org/file27918/many-modules-in-one-so_3.diff _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Looks better, will check on Windows a bit later. BTW, ACKS and NEWS are usually edited by committer, but leave that as is for now. ---------- versions: +Python 3.4 -Python 3.5 _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Václav Šmilauer added the comment: Good, will let editors do that next time. I was following http://docs.python.org/devguide/patch.html#preparation which says "Sixth, if you are not already in the Misc/ACKS file then add your name." For NEWS, I was reading http://docs.python.org/devguide/committing.html#news-entries, but it is true it talks about commits, not about patches. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Nick Coghlan added the comment: Yeah, ACKS is fine (we just don't mind doing it if the submitter leaves it out). Updating NEWS is less useful because it almost inevitably causes a conflict when the patch is applied. (We occasionally mutter about adopting a less conflict-prone approach to handling NEWS entries, but nobody has ever found it annoying enough to design a solution and officially propose switching to it) ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Václav, your patch passed on Windows. Will commit it after double check. Thanks. ---------- assignee: -> asvetlov _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Changes by Eric Snow <ericsnowcurrently@gmail.com>: ---------- nosy: +eric.snow _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Nick Coghlan added the comment: One nice feature of this is the potential to simplify single-file distribution - pack your application into a zip file, and only need to extract a single shared library for *all* your extension modules, which could be handled via a utility function called in __main__.py rather than needing to be built into the interpreter. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Brett Cannon added the comment: Are you still planning on committing this, Andrew? ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Roundup Robot added the comment: New changeset 6eefe4d537b3 by Andrew Svetlov in branch 'default': Issue #16421: allow to load multiple modules from the same shared object. http://hg.python.org/cpython/rev/6eefe4d537b3 ---------- nosy: +python-dev _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Committed. Sorry for delay. Thanks, Vaclav! ---------- resolution: -> fixed stage: -> committed/rejected status: open -> closed _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
STINNER Victor added the comment: Some tests are failing since the changeset 6eefe4d537b3. Example: http://buildbot.python.org/all/builders/x86%20RHEL%206%203.x/builds/1431/ste... Please check buildbots. [176/371] test_pkgutil test_getdata_filesys (test.test_pkgutil.PkgutilTests) ... ok test_getdata_zipfile (test.test_pkgutil.PkgutilTests) ... ok test_unreadable_dir_on_syspath (test.test_pkgutil.PkgutilTests) ... ok test_alreadyloaded (test.test_pkgutil.PkgutilPEP302Tests) ... ERROR test_getdata_pep302 (test.test_pkgutil.PkgutilPEP302Tests) ... ERROR test_mixed_namespace (test.test_pkgutil.ExtendPathTests) ... ERROR test_simple (test.test_pkgutil.ExtendPathTests) ... ERROR test_nested (test.test_pkgutil.NestedNamespacePackageTest) ... ok test_get_importer_avoids_emulation (test.test_pkgutil.ImportlibMigrationTests) ... ok test_get_loader_avoids_emulation (test.test_pkgutil.ImportlibMigrationTests) ... ok test_importer_deprecated (test.test_pkgutil.ImportlibMigrationTests) ... ok test_iter_importers_avoids_emulation (test.test_pkgutil.ImportlibMigrationTests) ... ok test_loader_deprecated (test.test_pkgutil.ImportlibMigrationTests) ... ok ====================================================================== ERROR: test_alreadyloaded (test.test_pkgutil.PkgutilPEP302Tests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/test/test_pkgutil.py", line 139, in test_alreadyloaded self.assertEqual(foo.loads, 1) AttributeError: 'module' object has no attribute 'loads' ====================================================================== ERROR: test_getdata_pep302 (test.test_pkgutil.PkgutilPEP302Tests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/pkgutil.py", line 502, in find_loader return importlib.find_loader(fullname, path) File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/importlib/__init__.py", line 64, in find_loader loader = sys.modules[name].__loader__ AttributeError: 'module' object has no attribute '__loader__' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/test/test_pkgutil.py", line 131, in test_getdata_pep302 self.assertEqual(pkgutil.get_data('foo', 'dummy'), "Hello, world!") File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/pkgutil.py", line 625, in get_data loader = get_loader(package) File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/pkgutil.py", line 480, in get_loader return find_loader(fullname) File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/pkgutil.py", line 508, in find_loader raise ImportError(msg.format(fullname, type(ex), ex)) from ex ImportError: Error while finding loader for 'foo' (<class 'AttributeError'>: 'module' object has no attribute '__loader__') ====================================================================== ERROR: test_mixed_namespace (test.test_pkgutil.ExtendPathTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "<frozen importlib._bootstrap>", line 1523, in _find_and_load_unlocked AttributeError: 'module' object has no attribute '__path__' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/test/test_pkgutil.py", line 198, in test_mixed_namespace import foo.bar ImportError: No module named 'foo.bar'; foo is not a package ====================================================================== ERROR: test_simple (test.test_pkgutil.ExtendPathTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "<frozen importlib._bootstrap>", line 1523, in _find_and_load_unlocked AttributeError: 'module' object has no attribute '__path__' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/buildbot/buildarea/3.x.coghlan-redhat/build/Lib/test/test_pkgutil.py", line 170, in test_simple import foo.bar ImportError: No module named 'foo.bar'; foo is not a package ---------------------------------------------------------------------- Ran 13 tests in 0.027s ---------- nosy: +haypo resolution: fixed -> status: closed -> open _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Antoine Pitrou added the comment: Indeed it looks like this commit may be the culprit for numerous buildbot failures. ---------- nosy: +pitrou _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Antoine Pitrou added the comment: Naming the test modules "foo" and "bar" was perhaps not the best idea. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Roundup Robot added the comment: New changeset 2e492a9a1845 by Andrew Svetlov in branch 'default': Rename test module names for #16421 to don't clash with other tests. http://hg.python.org/cpython/rev/2e492a9a1845 ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
Andrew Svetlov added the comment: Fixed. Antoine, you are right: foo and bar was bad names. ---------- resolution: -> fixed status: open -> closed _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue16421> _______________________________________
participants (10)
-
Amaury Forgeot d'Arc -
Andrew Svetlov
-
Antoine Pitrou
-
Brett Cannon
-
Eric Snow
-
Nick Coghlan
-
R. David Murray
-
Roundup Robot
-
STINNER Victor
-
Václav Šmilauer