Mailman 3 April 2019 - Python-Buildbots

buildtimes, success-rate
by Michael Felt April 28, 2019

April 28, 2019

Hi. Is there something missing from the AIX buildbots that there is no record for the buildtime? And, while I know my bot, runnig on xlc continues to fail the multiprocessing tests (as a bot) the gccfarm bot passes all tests, but has some link warnings (from a bad 3rd party library). Besides having a "yellow" exit color (warnings) - is this also preventing the gccfarm AIX bot from showing as "successful" (in the graph)? If there is something additional needed - please indicate what - if you know. Thanks, Michael

3 2

Added a new ClangUnixInstalledBuild config
by Charalampos Stratakis April 18, 2019

April 18, 2019

Hello everyone, I recently added a new ClangUnixInstalledBuild config for the buildbot fleet. It inherits from UnixInstalledBuild and uses clang instead of gcc, and it currently runs on cstratak-fedora worker. -- Regards, Charalampos Stratakis Software Engineer Python Maintenance Team, Red Hat

1 0

Random failure when deploying the new buildbot config
by Victor Stinner April 12, 2019

April 12, 2019

Hi, I just deployed the new config for https://github.com/python/buildmaster-config/pull/88 but I got an assertion error which gone away when I re-run "buildbot reconfig master". Should I worry or not? buildbot@virt-et2yi0:~$ /data/buildbot/venv/bin/buildbot checkconfig master/master.cfg Config file is good! buildbot@virt-et2yi0:~$ /data/buildbot/venv/bin/buildbot reconfig master sending SIGHUP to process 29619 2019-04-12 12:50:58+0000 [-] beginning configuration update 2019-04-12 12:50:58+0000 [-] Loading configuration from '/data/buildbot/master/master.cfg' 2019-04-12 12:50:58+0000 [-] adding 1 new services, removing 1 2019-04-12 12:50:58+0000 [-] Starting factory <buildbot.reporters.irc.IrcStatusFactory object at 0x2af30410d518> 2019-04-12 12:50:58+0000 [-] adding 10 new builders, removing 0 2019-04-12 12:50:58+0000 [IrcStatusBot,client] not scheduling reconnection attempt 2019-04-12 12:50:58+0000 [-] Stopping factory <buildbot.reporters.irc.IrcStatusFactory object at 0x2af2fb6fc358> 2019-04-12 12:51:04+0000 [-] initializing www plugin 'waterfall_view' 2019-04-12 12:51:04+0000 [-] initializing www plugin 'console_view' 2019-04-12 12:51:04+0000 [-] initializing www plugin 'grid_view' 2019-04-12 12:51:04+0000 [Broker,160838,8.43.85.216] during reconfig: Traceback (most recent call last): File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1475, in gotResult _inlineCallbacks(r, g, status) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1416, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/python/failure.py", line 491, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) --- <exception caught here> --- File "/data/buildbot/venv/lib/python3.6/site-packages/buildbot/master.py", line 393, in doReconfig yield self.reconfigServiceWithBuildbotConfig(new_config) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1416, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/python/failure.py", line 491, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/data/buildbot/venv/lib/python3.6/site-packages/buildbot/util/service.py", line 49, in reconfigServiceWithBuildbotConfig yield svc.reconfigServiceWithBuildbotConfig(new_config) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1416, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/python/failure.py", line 491, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/data/buildbot/venv/lib/python3.6/site-packages/buildbot/process/measured_service.py", line 31, in reconfigServiceWithBuildbotConfig yield super(MeasuredBuildbotServiceManager, self).reconfigServiceWithBuildbotConfig(new_config) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1416, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/python/failure.py", line 491, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/data/buildbot/venv/lib/python3.6/site-packages/buildbot/util/service.py", line 520, in reconfigServiceWithBuildbotConfig yield svc.reconfigServiceWithSibling(config_sibling) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1416, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/python/failure.py", line 491, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/data/buildbot/venv/lib/python3.6/site-packages/buildbot/worker/base.py", line 302, in reconfigServiceWithSibling yield self.updateWorker() File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1418, in _inlineCallbacks result = g.send(result) File "/data/buildbot/venv/lib/python3.6/site-packages/buildbot/worker/base.py", line 509, in sendBuilderList d1 = self.attachBuilder(b) File "/data/buildbot/venv/lib/python3.6/site-packages/buildbot/worker/base.py", line 514, in attachBuilder return builder.attached(self, self.worker_commands) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1613, in unwindGenerator return _cancellableInlineCallbacks(gen) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1529, in _cancellableInlineCallbacks _inlineCallbacks(None, g, status) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 1421, in _inlineCallbacks status.deferred.callback(getattr(e, "value", None)) File "/data/buildbot/venv/lib/python3.6/site-packages/twisted/internet/defer.py", line 459, in callback assert not isinstance(result, Deferred) builtins.AssertionError: 2019-04-12 12:51:04+0000 [Broker,160838,8.43.85.216] WARNING: reconfig partially applied; master may malfunction Reconfiguration failed. Please inspect the master.cfg file for errors, correct them, then try 'buildbot reconfig' again. buildbot@virt-et2yi0:~$ /data/buildbot/venv/bin/buildbot reconfig master sending SIGHUP to process 29619 2019-04-12 12:51:20+0000 [-] beginning configuration update 2019-04-12 12:51:20+0000 [-] Loading configuration from '/data/buildbot/master/master.cfg' 2019-04-12 12:51:21+0000 [-] Starting factory <buildbot.reporters.irc.IrcStatusFactory object at 0x2af3047c3c88> 2019-04-12 12:51:21+0000 [IrcStatusBot,client] not scheduling reconnection attempt 2019-04-12 12:51:21+0000 [-] Stopping factory <buildbot.reporters.irc.IrcStatusFactory object at 0x2af30410d518> 2019-04-12 12:51:25+0000 [-] initializing www plugin 'waterfall_view' 2019-04-12 12:51:25+0000 [-] initializing www plugin 'console_view' 2019-04-12 12:51:25+0000 [-] initializing www plugin 'grid_view' 2019-04-12 12:51:25+0000 [-] configuration update complete Reconfiguration appears to have completed successfully Victor -- Night gathers, and now my watch begins. It shall not end until my death.

2 1

Windows 8.1 worker (bolen-worker8) retirement
by David Bolen April 12, 2019

April 12, 2019

My Windows 8.1 worker got hit on Wednesday by some "encrypt the world" ransomware. I'm not quite sure the path by which it reached the Azure VM, but regardless, it's toast. I don't think I see enough value in re-installation, given the existence of the Windows 10 worker, plus I can probably bump some Windows 10 worker resources with the budget freed up by Windows 8. So I'm planning on letting the Windows 8 worker end its run at this point. -- David

2 2

Buildbot 2.1.0 and TLS between master and worker
by Craig Rodrigues April 11, 2019

April 11, 2019

Buildbot 2.1.0 (which is running at https://buildbot.python.org/all/ ) now supports TLS between a buildbot worker and the buildbot master. There is an example of setting this up here: http://docs.buildbot.net/current/manual/installation/worker.html#worker-tls… For folks interested in TLS between the buildbot master and buildbot worker, that is something that the Python buildbot team might want to help get going. -- Craig

1 0

Windows 3.x buildbots now also have a "load average"!
by Victor Stinner April 11, 2019

April 11, 2019

Thanks for Ammar Askar: https://github.com/python/cpython/pull/8357/files https://bugs.python.org/issue34060 Example: https://ci.appveyor.com/project/python/cpython/builds/23768195 ... 0:04:40 load avg: 5.36 [321/420] test_xdrlib passed 0:04:41 load avg: 5.73 [322/420] test_future3 passed 0:04:41 load avg: 5.73 [323/420] test_unary passed 0:04:42 load avg: 5.73 [324/420] test_unpack_ex passed 0:04:49 load avg: 6.15 [325/420] test_tools passed 0:04:51 load avg: 6.15 [326/420] test_bz2 passed 0:04:52 load avg: 6.15 [327/420] test_robotparser passed 0:04:53 load avg: 7.58 [328/420] test_zlib passed 0:04:53 load avg: 7.58 [329/420] test_float passed 0:04:53 load avg: 7.58 [330/420] test_gdb skipped ... Victor -- Night gathers, and now my watch begins. It shall not end until my death.

1 0

Disable notifiations on broken workers
by Victor Stinner April 10, 2019

April 10, 2019

Hi, I propose to disable email and IRC notifications on workers which were never green (tests always failed): https://github.com/python/buildmaster-config/pull/86 * Alpine Linux * Cygwin * "AMD64 Clang UBSan 3." (3.6, 3.7 and 3.x, surprisingly, 2.7 is green) Does anyone have a good reason to keep notifications for these workers? I proposed this change because the Cygwin sent 2 emails in 2 days, whereas this worker is failing since it has been registered. Victor -- Night gathers, and now my watch begins. It shall not end until my death.

2 2

Adding a Fedora Rawhide x86_64 to the buildbot fleet
by Charalampos Stratakis April 8, 2019

April 8, 2019

Hello everyone, We've recently got a Fedora Rawhide virtual machine which should be available and up at all times and I'd like to add it to the existing fleet of buildbots. Thus I'd like to request for a worker name and a password for it. I'm currently following the instructions at [0] for setting up the buildbot. https://devguide.python.org/buildworker/ -- Regards, Charalampos Stratakis Software Engineer Python Maintenance Team, Red Hat

3 4