MemoryError and other bugs on AMD64 OpenIndiana 3.x
Hi, The buildbot AMD64 OpenIndiana 3.x is always red since at least 6 months. Almost always, tests fail because the buildbot has not enough memory. Well, it's fun to see how Python handles MemoryError (it's pretty good, there is no hard crash! my work on failmalloc was maybe useful ;-)), but it doesn't help to detect regressions. Would it be possible to enhance this buildbot? I copy this email to the owner of buildbot. But I also sent it to python-dev because MemoryError is not the only error, please take care of our buildbots! Thanks, Victor
Sorry, I am currently traveling. Away from real computer until April 7th. On 28/03/15 10:48, Victor Stinner wrote:
Hi,
The buildbot AMD64 OpenIndiana 3.x is always red since at least 6 months. Almost always, tests fail because the buildbot has not enough memory. Well, it's fun to see how Python handles MemoryError (it's pretty good, there is no hard crash! my work on failmalloc was maybe useful ;-)), but it doesn't help to detect regressions.
Would it be possible to enhance this buildbot?
Those buildbots are hosted in OpenIndiana infraestructure. I take care of the Solaris Zone (similar to docker but better :-)) but I can't interact with the "real" machine. Sometimes changes in the "real" machine had impacted us and nobody realized until some time later, when nobody remembers what was changed or who did it. I have contacted the machine manager and he has said to me that 16GB were taken in the "/tmp" directory by buildbot user. He has deleted them and everything should be fine now. Lets see. Anyway if buildbot is leaving garbage behind we should take care of it. Doing a daily cron for manual cleaning up seems a bit hacky :). I would be interested, too, in getting an email when one of my buildbots is red for more than, lets say, 4 days in a row. An email per day would be fine. BTW, buildbot pages are painfully slow. The manager had to "insist" and be patient to see <http://buildbot.python.org/all/waterfall?show=x86%20OpenIndiana%203.x>, etc. How can that be improved?.
I copy this email to the owner of buildbot. But I also sent it to python-dev because MemoryError is not the only error, please take care of our buildbots!
Thanks for keeping me in the loop. I hope everything is going green for a while now :) -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea@jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz
Hi, 2015-03-29 21:03 GMT+02:00 Jesus Cea <jcea@jcea.es>:
I have contacted the machine manager and he has said to me that 16GB were taken in the "/tmp" directory by buildbot user. He has deleted them and everything should be fine now. Lets see.
Anyway if buildbot is leaving garbage behind we should take care of it. Doing a daily cron for manual cleaning up seems a bit hacky :).
Usually, created files are all removed. Serhiy even added a test recently for that in regrtest. The problem is that Python may keep some created files on test failures.
I would be interested, too, in getting an email when one of my buildbots is red for more than, lets say, 4 days in a row. An email per day would be fine.
There are still MemoryError: http://buildbot.python.org/all/builders/AMD64%20OpenIndiana%203.x/builds/954... http://buildbot.python.org/all/builders/AMD64%20OpenIndiana%203.x/builds/954... http://buildbot.python.org/all/builders/AMD64%20OpenIndiana%203.x/builds/954... etc. Victor
participants (2)
-
Jesus Cea -
Victor Stinner