Buildbot failure in Python on PPC64 AIX 3.x

The Buildbot has detected a failed build on builder PPC64 AIX 3.x while building python/cpython. Full details are available at: https://buildbot.python.org/all/#builders/227/builds/1036
Buildbot URL: https://buildbot.python.org/all/
Worker for this Build: edelsohn-aix-ppc64
Build Reason: <unknown> Blamelist: Dong-hee Na <donghee.na92@gmail.com>, Miro Hrončok <miro@hroncok.cz>
BUILD FAILED: failed test (failure)
Summary of the results of the build (if available):
== Tests result: FAILURE then FAILURE ==
406 tests OK.
10 slowest tests:
- test_bufio: 6 min 29 sec
- test_concurrent_futures: 4 min 25 sec
- test_multiprocessing_spawn: 4 min 15 sec
- test_tokenize: 2 min 58 sec
- test_unparse: 2 min 46 sec
- test_subprocess: 2 min 38 sec
- test_compileall: 2 min 35 sec
- test_mailbox: 2 min 21 sec
- test_pathlib: 2 min 14 sec
- test_multiprocessing_forkserver: 2 min 12 sec
1 test failed: test_os
18 tests skipped: test_devpoll test_epoll test_gdb test_ioctl test_kqueue test_msilib test_ossaudiodev test_spwd test_startfile test_tix test_tk test_ttk_guionly test_unicode_file test_unicode_file_functions test_winconsoleio test_winreg test_winsound test_zipfile64
1 re-run test: test_os
Total duration: 12 min 4 sec
Captured traceback
Traceback (most recent call last): File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 757, in test_utime_current_old self._test_utime_current(set_time) File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 744, in _test_utime_current self.assertAlmostEqual(st.st_mtime, current, AssertionError: 1590426760.9609613 != 1590426761.4539788 within 0.05 delta (0.49301743507385254 difference) : st_time=1590426760.9609613, current=1590426761.4539788, dt=-0.49301743507385254
Traceback (most recent call last): File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 751, in test_utime_current self._test_utime_current(set_time) File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 744, in _test_utime_current self.assertAlmostEqual(st.st_mtime, current, AssertionError: 1590426601.5486567 != 1590426602.038996 within 0.05 delta (0.4903392791748047 difference) : st_time=1590426601.5486567, current=1590426602.038996, dt=-0.4903392791748047
Traceback (most recent call last): File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 757, in test_utime_current_old self._test_utime_current(set_time) File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 744, in _test_utime_current self.assertAlmostEqual(st.st_mtime, current, AssertionError: 1590426601.7683556 != 1590426602.261903 within 0.05 delta (0.4935474395751953 difference) : st_time=1590426601.7683556, current=1590426602.261903, dt=-0.4935474395751953
Traceback (most recent call last): File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 751, in test_utime_current self._test_utime_current(set_time) File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 744, in _test_utime_current self.assertAlmostEqual(st.st_mtime, current, AssertionError: 1590426760.900067 != 1590426761.391216 within 0.05 delta (0.4911489486694336 difference) : st_time=1590426760.900067, current=1590426761.391216, dt=-0.4911489486694336
Test report
Failed tests:
- test_os
Failed subtests:
- test_utime_current - test.test_os.UtimeTests
- test_utime_current_old - test.test_os.UtimeTests
Sincerely, -The Buildbot

Dear all,
- This issue is not related to Python - or AIX. The environment for this bot is migrating - and currently the bot file system is on a NFS server to minimize downtime for the GGC Farm Team. The root cause of the failure below is the time difference between the AIX server and the NFS server is greater that 0.05:
Traceback (most recent call last): File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 757, in test_utime_current_old self._test_utime_current(set_time) File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_os.py", line 744, in _test_utime_current self.assertAlmostEqual(st.st_mtime, current, AssertionError: 1590426760.9609613 != 1590426761.4539788 within 0.05 delta (0.49301743507385254 difference) : st_time=1590426760.9609613, current=1590426761.4539788, dt=-0.49301743507385254
This conclusion is based on experience I had in my own environment where I run the bot over an NFS connection.
One way or another I expect to have at least a work-around in the next 48 hours.
On 25/05/2020 19:12, buildbot@python.org wrote:
Worker for this Build: edelsohn-aix-ppc64
participants (2)
-
buildbot@python.org
-
Michael Felt