Buildbot failure in Python on whole buildset

The Buildbot has detected a new failure on builder PPC64LE RHEL8 LTO 3.10 while building python/cpython. Full details are available at: https://buildbot.python.org/all/#builders/680/builds/346
Buildbot URL: https://buildbot.python.org/all/
Worker for this Build: cstratak-RHEL8-ppc64le
Build Reason: <unknown> Blamelist: Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com>, Serhiy Storchaka <storchaka@gmail.com>, Łukasz Langa <lukasz@langa.pl>
BUILD FAILED: failed test (failure)
Summary of the results of the build (if available):
== Tests result: ENV CHANGED ==
414 tests OK.
10 slowest tests:
- test_peg_generator: 5 min 24 sec
- test_gdb: 3 min 28 sec
- test_concurrent_futures: 3 min 4 sec
- test_multiprocessing_spawn: 2 min 9 sec
- test_multiprocessing_fork: 1 min 37 sec
- test_multiprocessing_forkserver: 1 min 28 sec
- test_tokenize: 1 min 25 sec
- test_unparse: 1 min 16 sec
- test_asyncio: 1 min 4 sec
- test_lib2to3: 1 min 3 sec
1 test altered the execution environment: test_asyncio
12 tests skipped: test_devpoll test_ioctl test_kqueue test_msilib test_startfile test_tix test_tk test_ttk_guionly test_winconsoleio test_winreg test_winsound test_zipfile64
Total duration: 8 min 24 sec
Captured traceback
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_e2ff1643'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/asyncio/sslproto.py", line 321, in __del__ self.close() File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/asyncio/sslproto.py", line 316, in close self._ssl_protocol._start_shutdown() File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/asyncio/sslproto.py", line 590, in _start_shutdown self._abort() File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/asyncio/sslproto.py", line 731, in _abort self._transport.abort() File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/asyncio/selector_events.py", line 680, in abort self._force_close(None) File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/asyncio/selector_events.py", line 731, in _force_close self._loop.call_soon(self._call_connection_lost, exc) File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/asyncio/base_events.py", line 745, in call_soon self._check_closed() File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/asyncio/base_events.py", line 510, in _check_closed raise RuntimeError('Event loop is closed') RuntimeError: Event loop is closed
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_25ae987c'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-RHEL8-ppc64le.lto/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_e19ad09a'
Test report
Sincerely, -The BuildbotThe Buildbot has detected a new failure on builder PPC64LE Fedora Rawhide LTO + PGO 3.10 while building python/cpython. Full details are available at: https://buildbot.python.org/all/#builders/616/builds/332
Buildbot URL: https://buildbot.python.org/all/
Worker for this Build: cstratak-fedora-rawhide-ppc64le
Build Reason: <unknown> Blamelist: Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com>, Serhiy Storchaka <storchaka@gmail.com>, Łukasz Langa <lukasz@langa.pl>
BUILD FAILED: failed test (failure)
Summary of the results of the build (if available):
== Tests result: ENV CHANGED ==
413 tests OK.
10 slowest tests:
- test_concurrent_futures: 2 min 41 sec
- test_multiprocessing_spawn: 1 min 37 sec
- test_multiprocessing_forkserver: 1 min 23 sec
- test_tokenize: 1 min 14 sec
- test_multiprocessing_fork: 1 min 12 sec
- test_nntplib: 1 min 2 sec
- test_asyncio: 58.6 sec
- test_unparse: 48.8 sec
- test_signal: 47.8 sec
- test_lib2to3: 44.0 sec
1 test altered the execution environment: test_ftplib
13 tests skipped: test_devpoll test_gdb test_ioctl test_kqueue test_msilib test_startfile test_tix test_tk test_ttk_guionly test_winconsoleio test_winreg test_winsound test_zipfile64
Total duration: 4 min 41 sec
Captured traceback
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_2f292793'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/asyncore.py", line 90, in read obj.handle_read_event() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/test/test_ftplib.py", line 384, in handle_read_event self._do_ssl_handshake() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/test/test_ftplib.py", line 345, in _do_ssl_handshake self.socket.do_handshake() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/ssl.py", line 1341, in do_handshake self._sslobj.do_handshake() ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:997)
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_5116e75d'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_e82a0df2'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/threading.py", line 1009, in _bootstrap_inner self.run() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/test/test_ftplib.py", line 298, in run asyncore.loop(timeout=0.1, count=1) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/asyncore.py", line 214, in loop poll_fun(timeout, map) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/asyncore.py", line 157, in poll read(obj) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/asyncore.py", line 94, in read obj.handle_error() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-ppc64le.lto-pgo/build/Lib/test/test_ftplib.py", line 421, in handle_error raise Exception Exception
Test report
Sincerely, -The BuildbotThe Buildbot has detected a new failure on builder aarch64 Fedora Rawhide 3.10 while building python/cpython. Full details are available at: https://buildbot.python.org/all/#builders/636/builds/323
Buildbot URL: https://buildbot.python.org/all/
Worker for this Build: cstratak-fedora-rawhide-aarch64
Build Reason: <unknown> Blamelist: Brett Cannon <brett@python.org>, Erlend Egeberg Aasland <erlend.aasland@innova.no>, Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com>, Serhiy Storchaka <storchaka@gmail.com>, Łukasz Langa <lukasz@langa.pl>
BUILD FAILED: failed test (failure)
Summary of the results of the build (if available):
== Tests result: FAILURE then ENV CHANGED ==
414 tests OK.
10 slowest tests:
- test_gdb: 6 min 2 sec
- test_peg_generator: 3 min 44 sec
- test_multiprocessing_spawn: 3 min 29 sec
- test_concurrent_futures: 3 min 27 sec
- test_asyncio: 2 min 34 sec
- test_multiprocessing_forkserver: 1 min 54 sec
- test_multiprocessing_fork: 1 min 35 sec
- test_unparse: 1 min 29 sec
- test_nntplib: 1 min 22 sec
- test_zipfile: 1 min 17 sec
1 test altered the execution environment: test_ftplib
12 tests skipped: test_devpoll test_ioctl test_kqueue test_msilib test_startfile test_tix test_tk test_ttk_guionly test_winconsoleio test_winreg test_winsound test_zipfile64
1 re-run test: test_signal
Total duration: 6 min 46 sec
Captured traceback
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/asyncore.py", line 90, in read obj.handle_read_event() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/test/test_ftplib.py", line 384, in handle_read_event self._do_ssl_handshake() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/test/test_ftplib.py", line 345, in _do_ssl_handshake self.socket.do_handshake() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/ssl.py", line 1341, in do_handshake self._sslobj.do_handshake() ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:997)
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/test/test_signal.py", line 1120, in test_pthread_kill_main_thread stdout, stderr = process.communicate() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/subprocess.py", line 1149, in communicate stdout, stderr = self._communicate(input, endtime, timeout) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/subprocess.py", line 2026, in _communicate self.wait(timeout=self._remaining_time(endtime)) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/subprocess.py", line 1204, in wait return self._wait(timeout=timeout) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/subprocess.py", line 1938, in _wait (pid, sts) = self._try_wait(0) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/subprocess.py", line 1896, in _try_wait (pid, sts) = os.waitpid(self.pid, wait_flags) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/test/test_signal.py", line 712, in sig_vtalrm raise signal.ItimerError("setitimer didn't disable ITIMER_VIRTUAL " signal.itimer_error: setitimer didn't disable ITIMER_VIRTUAL timer.
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_d3b72214'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_6964c871'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/threading.py", line 1009, in _bootstrap_inner self.run() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/test/test_ftplib.py", line 298, in run asyncore.loop(timeout=0.1, count=1) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/asyncore.py", line 214, in loop poll_fun(timeout, map) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/asyncore.py", line 157, in poll read(obj) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/asyncore.py", line 94, in read obj.handle_error() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-aarch64/build/Lib/test/test_ftplib.py", line 421, in handle_error raise Exception Exception
Test report
Failed tests:
- test_signal
Failed subtests:
- test_pthread_kill_main_thread - test.test_signal.PendingSignalsTests
Sincerely, -The BuildbotThe Buildbot has detected a new failure on builder AMD64 Fedora Rawhide Clang 3.10 while building python/cpython. Full details are available at: https://buildbot.python.org/all/#builders/643/builds/381
Buildbot URL: https://buildbot.python.org/all/
Worker for this Build: cstratak-fedora-rawhide-x86_64
Build Reason: <unknown> Blamelist: Brett Cannon <brett@python.org>, Erlend Egeberg Aasland <erlend.aasland@innova.no>, Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com>, Serhiy Storchaka <storchaka@gmail.com>, Łukasz Langa <lukasz@langa.pl>
BUILD FAILED: failed test (failure)
Summary of the results of the build (if available):
== Tests result: FAILURE then ENV CHANGED ==
414 tests OK.
10 slowest tests:
- test_concurrent_futures: 2 min 41 sec
- test_peg_generator: 2 min 13 sec
- test_multiprocessing_spawn: 1 min 41 sec
- test_nntplib: 1 min 20 sec
- test_multiprocessing_forkserver: 1 min 19 sec
- test_multiprocessing_fork: 1 min 12 sec
- test_asyncio: 1 min
- test_signal: 47.8 sec
- test_io: 41.7 sec
- test_socket: 38.6 sec
1 test altered the execution environment: test_ftplib
12 tests skipped: test_devpoll test_ioctl test_kqueue test_msilib test_startfile test_tix test_tk test_ttk_guionly test_winconsoleio test_winreg test_winsound test_zipfile64
1 re-run test: test_signal
Total duration: 4 min 41 sec
Captured traceback
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_a7eeb372'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/threading.py", line 1009, in _bootstrap_inner self.run() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/test_ftplib.py", line 298, in run asyncore.loop(timeout=0.1, count=1) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/asyncore.py", line 214, in loop poll_fun(timeout, map) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/asyncore.py", line 157, in poll read(obj) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/asyncore.py", line 94, in read obj.handle_error() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/test_ftplib.py", line 421, in handle_error raise Exception Exception
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/test_signal.py", line 856, in test_pthread_kill assert_python_ok('-c', code) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/support/script_helper.py", line 160, in assert_python_ok return _assert_python(True, *args, **env_vars) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/support/script_helper.py", line 143, in _assert_python res, cmd_line = run_python_until_end(*args, **env_vars) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/support/script_helper.py", line 91, in run_python_until_end env_required = interpreter_requires_environment() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/support/script_helper.py", line 48, in interpreter_requires_environment subprocess.check_call([sys.executable, '-E', File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/subprocess.py", line 364, in check_call retcode = call(*popenargs, **kwargs) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/subprocess.py", line 347, in call return p.wait(timeout=timeout) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/subprocess.py", line 1204, in wait return self._wait(timeout=timeout) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/subprocess.py", line 1938, in _wait (pid, sts) = self._try_wait(0) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/subprocess.py", line 1896, in _try_wait (pid, sts) = os.waitpid(self.pid, wait_flags) File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/test_signal.py", line 712, in sig_vtalrm raise signal.ItimerError("setitimer didn't disable ITIMER_VIRTUAL " signal.itimer_error: setitimer didn't disable ITIMER_VIRTUAL timer.
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_a0ac0763'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/multiprocessing/resource_tracker.py", line 209, in main cache[rtype].remove(name) KeyError: '/psm_1b6fc185'
Traceback (most recent call last): File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/asyncore.py", line 90, in read obj.handle_read_event() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/test_ftplib.py", line 384, in handle_read_event self._do_ssl_handshake() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/test/test_ftplib.py", line 345, in _do_ssl_handshake self.socket.do_handshake() File "/home/buildbot/buildarea/3.10.cstratak-fedora-rawhide-x86_64.clang/build/Lib/ssl.py", line 1341, in do_handshake self._sslobj.do_handshake() ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:997)
Test report
Failed tests:
- test_signal
Failed subtests:
- test_pthread_kill - test.test_signal.PendingSignalsTests
Sincerely, -The Buildbot
participants (1)
-
buildbot@python.org