Windows 10 build agent failures
Hi, Just kind of "looking around" at stuff I can help with, and I noticed a few days ago that Windows 10 AMD64 builds of Python 3.6/3.7/3.x are generally failing. It seems like the failures started April 16th around 1am per BuildBot and went from consistently passing to consistently failing. The errors appear to be timeouts; the test runs are going over 15 minutes. I can run the tests locally and things seem fine. The one thing which seems to have changed is, under the "10 slowest tests" header, test_io has shot up in terms of time to complete: 3.6: 2 min 13 sec <http://buildbot.python.org/all/#/builders/31/builds/273/steps/3/logs/stdio> to 9 min 25 sec <http://buildbot.python.org/all/#/builders/31/builds/297/steps/3/logs/stdio> 3.7: 2 min 10 sec <http://buildbot.python.org/all/#/builders/121/builds/182/steps/3/logs/stdio> to 9 min 26 sec <http://buildbot.python.org/all/#/builders/121/builds/215/steps/3/logs/stdio> 3.x: 3 min 39 sec <http://buildbot.python.org/all/#/builders/3/builds/794/steps/3/logs/stdio> to 9 min 17 sec <http://buildbot.python.org/all/#/builders/3/builds/844/steps/3/logs/stdio> Locally this test suite runs in around 36 seconds. I see no real change between running one of the last "good" changesets versus the current head of master. I'm suspecting an issue on the build agent perhaps? Thoughts? Best Regards, Paul Goins
On Sun, May 6, 2018 at 3:05 AM, Paul Goins <general@vultaire.net> wrote:
Hi,
Just kind of "looking around" at stuff I can help with, and I noticed a few days ago that Windows 10 AMD64 builds of Python 3.6/3.7/3.x are generally failing.
It seems like the failures started April 16th around 1am per BuildBot and went from consistently passing to consistently failing. The errors appear to be timeouts; the test runs are going over 15 minutes.
I can run the tests locally and things seem fine.
The one thing which seems to have changed is, under the "10 slowest tests" header, test_io has shot up in terms of time to complete:
3.6: 2 min 13 sec to 9 min 25 sec 3.7: 2 min 10 sec to 9 min 26 sec 3.x: 3 min 39 sec to 9 min 17 sec
Locally this test suite runs in around 36 seconds. I see no real change between running one of the last "good" changesets versus the current head of master. I'm suspecting an issue on the build agent perhaps? Thoughts?
We have an open issue for this at https://bugs.python.org/issue33355. -- Zach
Thanks for the heads-up; I skimmed python-dev but did not check bpo. - Paul On Sun, May 6, 2018, 11:35 AM Zachary Ware <zachary.ware+pydev@gmail.com> wrote:
Hi,
Just kind of "looking around" at stuff I can help with, and I noticed a few days ago that Windows 10 AMD64 builds of Python 3.6/3.7/3.x are generally failing.
It seems like the failures started April 16th around 1am per BuildBot and went from consistently passing to consistently failing. The errors appear to be timeouts; the test runs are going over 15 minutes.
I can run the tests locally and things seem fine.
The one thing which seems to have changed is, under the "10 slowest tests" header, test_io has shot up in terms of time to complete:
3.6: 2 min 13 sec to 9 min 25 sec 3.7: 2 min 10 sec to 9 min 26 sec 3.x: 3 min 39 sec to 9 min 17 sec
Locally this test suite runs in around 36 seconds. I see no real change between running one of the last "good" changesets versus the current
On Sun, May 6, 2018 at 3:05 AM, Paul Goins <general@vultaire.net> wrote: head of
master. I'm suspecting an issue on the build agent perhaps? Thoughts?
We have an open issue for this at https://bugs.python.org/issue33355.
-- Zach _______________________________________________ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/general%40vultaire.net
For me, Tcl/Tk failed to build with SDK 10.0.16299.0 , I had to expicitly fall back to 10.0.15063.0 ( https://stackoverflow.com/questions/48559337/error-when-building-tcltk-in-vi... ). May be related if VS was (auto)updated on the builders.|| On 06.05.2018 11:05, Paul Goins wrote: ||
Hi,
Just kind of "looking around" at stuff I can help with, and I noticed a few days ago that Windows 10 AMD64 builds of Python 3.6/3.7/3.x are generally failing.
It seems like the failures started April 16th around 1am per BuildBot and went from consistently passing to consistently failing. The errors appear to be timeouts; the test runs are going over 15 minutes.
I can run the tests locally and things seem fine.
The one thing which seems to have changed is, under the "10 slowest tests" header, test_io has shot up in terms of time to complete:
3.6: 2 min 13 sec <http://buildbot.python.org/all/#/builders/31/builds/273/steps/3/logs/stdio> to 9 min 25 sec <http://buildbot.python.org/all/#/builders/31/builds/297/steps/3/logs/stdio> 3.7: 2 min 10 sec <http://buildbot.python.org/all/#/builders/121/builds/182/steps/3/logs/stdio> to 9 min 26 sec <http://buildbot.python.org/all/#/builders/121/builds/215/steps/3/logs/stdio> 3.x: 3 min 39 sec <http://buildbot.python.org/all/#/builders/3/builds/794/steps/3/logs/stdio> to 9 min 17 sec <http://buildbot.python.org/all/#/builders/3/builds/844/steps/3/logs/stdio>
Locally this test suite runs in around 36 seconds. I see no real change between running one of the last "good" changesets versus the current head of master. I'm suspecting an issue on the build agent perhaps? Thoughts?
Best Regards, Paul Goins
_______________________________________________ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe:https://mail.python.org/mailman/options/python-dev/vano%40mail.mipt.ru
-- Regards, Ivan
participants (4)
-
Ivan Pozdeev -
Paul Goins -
Paul Goins -
Zachary Ware