Snow Leopard buildbot failing again...
I see that parc-snowleopard-1 went down again. I've done a software update, rebooted, and installed the latest buildslave, 0.8.4. I can ping dinsdale.python.org successfully from the machine. However, when I start the buildslave, I get this: $ buildslave start ~/buildarea/ /Library/Python/2.6/site-packages/Twisted-8.2.0-py2.6-macosx-10.6-universal.egg/twisted/internet/_sslverify.py:5: DeprecationWarning: the md5 module is deprecated; use hashlib instead import itertools, md5 Following twistd.log until startup finished.. /Library/Python/2.6/site-packages/buildbot_slave-0.8.4-py2.6.egg/buildslave/scripts/logwatcher.py:67: PotentialZombieWarning: spawnProcess called, but the SIGCHLD handler is not installed. This probably means you have not yet called reactor.run, or called reactor.run(installSignalHandler=0). You will probably never see this process finish, and it may become a zombie process. env=os.environ, /Library/Python/2.6/site-packages/Twisted-8.2.0-py2.6-macosx-10.6-universal.egg/twisted/persisted/sob.py:12: DeprecationWarning: the md5 module is deprecated; use hashlib instead import os, md5, sys /Library/Python/2.6/site-packages/Twisted-8.2.0-py2.6-macosx-10.6-universal.egg/twisted/python/filepath.py:12: DeprecationWarning: the sha module is deprecated; use the hashlib module instead import sha 2011-06-27 09:45:31-0700 [-] Log opened. 2011-06-27 09:45:31-0700 [-] twistd 8.2.0 (/usr/bin/python 2.6.1) starting up. 2011-06-27 09:45:31-0700 [-] reactor class: twisted.internet.selectreactor.SelectReactor. 2011-06-27 09:45:31-0700 [-] Starting BuildSlave -- version: 0.8.4 2011-06-27 09:45:31-0700 [-] recording hostname in twistd.hostname The buildslave took more than 10 seconds to start, so we were unable to confirm that it started correctly. Please 'tail twistd.log' and look for a line that says 'configuration update complete' to verify correct startup. $ Now, I thought of updating Twisted, but the Twisted downloads page says, ``Twisted is no longer making a .dmg for OS X because OS X versions 10.5 and greater ship with Twisted installed and the default Python path configuration makes it impossible for a user to upgrade Twisted without possibly breaking applications which depend on the system Twisted installation.'' Anyone know just what those applications are? All this machine is doing is running the Python buildbot. Bill
On 27/06/2011 18:01, Bill Janssen wrote:
Well the calendar server (at least) uses the system twisted. It is best to leave the system python alone and install / use a python.org python install. Are the buildbot scripts hardcoded to use the system python on Macs? If so you will have to stick with the system version of twisted, which seems to be problematic. All the best, Michael
-- http://www.voidspace.org.uk/ May you do good and not evil May you find forgiveness for yourself and forgive others May you share freely, never taking more than you give. -- the sqlite blessing http://www.sqlite.org/different.html
exarkun@twistedmatrix.com wrote:
Um... not to look for "configuration update complete", I'm afraid. Isn't that a buildmaster-only thing? Here's what was there. 2011-06-27 09:45:31-0700 [-] Log opened. 2011-06-27 09:45:31-0700 [-] twistd 8.2.0 (/usr/bin/python 2.6.1) starting up. 2011-06-27 09:45:31-0700 [-] reactor class: twisted.internet.selectreactor.SelectReactor. 2011-06-27 09:45:31-0700 [-] Starting BuildSlave -- version: 0.8.4 2011-06-27 09:45:31-0700 [-] recording hostname in twistd.hostname 2011-06-27 09:46:01-0700 [-] Starting factory <buildslave.bot.BotFactory instance at 0x101637368> 2011-06-27 09:46:01-0700 [-] Connecting to dinsdale.python.org:9020 2011-06-27 09:46:02-0700 [Broker,client] message from master: attached 2011-06-27 09:46:02-0700 [Broker,client] I have a leftover directory '3.1.parc-snowleopard-1' that is not being used by the buildmaster: you can delete it now 2011-06-27 09:46:03-0700 [Broker,client] SlaveBuilder.remote_print(AMD64 Snow Leopard 2 custom): message from master: attached 2011-06-27 09:46:03-0700 [Broker,client] SlaveBuilder.remote_print(AMD64 Snow Leopard 2 2.7): message from master: attached 2011-06-27 09:46:03-0700 [Broker,client] SlaveBuilder.remote_print(AMD64 Snow Leopard 2 3.x): message from master: attached 2011-06-27 09:46:03-0700 [Broker,client] SlaveBuilder.remote_print(AMD64 Snow Leopard 2 3.2): message from master: attached 2011-06-27 09:46:05-0700 [Broker,client] Connected to dinsdale.python.org:9020; slave is ready 2011-06-27 09:46:05-0700 [Broker,client] sending application-level keepalives every 600 seconds There is that 30-second lag between "recording hostname in twistd.hostname" and "Starting factory", which is presumably what triggers the warning from buildslave. See <http://trac.buildbot.net/ticket/68> and <http://trac.buildbot.net/ticket/745>. Bill
I also find <http://trac.buildbot.net/ticket/1854> interesting, because it seems a good explanation of why the build slave might go into the zombie state of attempting to reconnect to the master. Bill
Antoine Pitrou <solipsis@pitrou.net> wrote:
It does seem to have connected, but the error message from buildslave is new. Let's see if it goes into the zombie state again running 0.8.4. The Tiger buildbot (an old dual-1GHz G4 running buildbot-slave 0.8.1p1) is the only one which seems to run reliably :-). Bill
On 27/06/2011 18:01, Bill Janssen wrote:
Well the calendar server (at least) uses the system twisted. It is best to leave the system python alone and install / use a python.org python install. Are the buildbot scripts hardcoded to use the system python on Macs? If so you will have to stick with the system version of twisted, which seems to be problematic. All the best, Michael
-- http://www.voidspace.org.uk/ May you do good and not evil May you find forgiveness for yourself and forgive others May you share freely, never taking more than you give. -- the sqlite blessing http://www.sqlite.org/different.html
exarkun@twistedmatrix.com wrote:
Um... not to look for "configuration update complete", I'm afraid. Isn't that a buildmaster-only thing? Here's what was there. 2011-06-27 09:45:31-0700 [-] Log opened. 2011-06-27 09:45:31-0700 [-] twistd 8.2.0 (/usr/bin/python 2.6.1) starting up. 2011-06-27 09:45:31-0700 [-] reactor class: twisted.internet.selectreactor.SelectReactor. 2011-06-27 09:45:31-0700 [-] Starting BuildSlave -- version: 0.8.4 2011-06-27 09:45:31-0700 [-] recording hostname in twistd.hostname 2011-06-27 09:46:01-0700 [-] Starting factory <buildslave.bot.BotFactory instance at 0x101637368> 2011-06-27 09:46:01-0700 [-] Connecting to dinsdale.python.org:9020 2011-06-27 09:46:02-0700 [Broker,client] message from master: attached 2011-06-27 09:46:02-0700 [Broker,client] I have a leftover directory '3.1.parc-snowleopard-1' that is not being used by the buildmaster: you can delete it now 2011-06-27 09:46:03-0700 [Broker,client] SlaveBuilder.remote_print(AMD64 Snow Leopard 2 custom): message from master: attached 2011-06-27 09:46:03-0700 [Broker,client] SlaveBuilder.remote_print(AMD64 Snow Leopard 2 2.7): message from master: attached 2011-06-27 09:46:03-0700 [Broker,client] SlaveBuilder.remote_print(AMD64 Snow Leopard 2 3.x): message from master: attached 2011-06-27 09:46:03-0700 [Broker,client] SlaveBuilder.remote_print(AMD64 Snow Leopard 2 3.2): message from master: attached 2011-06-27 09:46:05-0700 [Broker,client] Connected to dinsdale.python.org:9020; slave is ready 2011-06-27 09:46:05-0700 [Broker,client] sending application-level keepalives every 600 seconds There is that 30-second lag between "recording hostname in twistd.hostname" and "Starting factory", which is presumably what triggers the warning from buildslave. See <http://trac.buildbot.net/ticket/68> and <http://trac.buildbot.net/ticket/745>. Bill
I also find <http://trac.buildbot.net/ticket/1854> interesting, because it seems a good explanation of why the build slave might go into the zombie state of attempting to reconnect to the master. Bill
Antoine Pitrou <solipsis@pitrou.net> wrote:
It does seem to have connected, but the error message from buildslave is new. Let's see if it goes into the zombie state again running 0.8.4. The Tiger buildbot (an old dual-1GHz G4 running buildbot-slave 0.8.1p1) is the only one which seems to run reliably :-). Bill
participants (5)
-
"Martin v. Löwis" -
Antoine Pitrou -
Bill Janssen -
exarkun＠twistedmatrix.com -
Michael Foord