Running doctests on buildbots
Hi all, It seems to me that the buildbots should be running the doctests in addition to the unit tests, but right now the buildbot test command "numpy.test(level=9999,verbosity=9999)" doesn't do that. We could either add "doctests=True" to the buildbot test command, or make "level" above some threshhold run them (currently the level argument is just ignored anyway). Since the level and verbosity parameters are going away in the release after 1.2, it seems more appropriate to just add the doctests argument. Any thoughts? Thanks, Alan P.S. Thanks to whoever installed nose on the buildbots!
On Mon, Jun 30, 2008 at 13:38, Alan McIntyre
Hi all,
It seems to me that the buildbots should be running the doctests in addition to the unit tests, but right now the buildbot test command "numpy.test(level=9999,verbosity=9999)" doesn't do that. We could either add "doctests=True" to the buildbot test command, or make "level" above some threshhold run them (currently the level argument is just ignored anyway). Since the level and verbosity parameters are going away in the release after 1.2, it seems more appropriate to just add the doctests argument. Any thoughts?
Add the doctests argument. -- Robert Kern "I have come to believe that the whole world is an enigma, a harmless enigma that is made terrible by our own mad attempt to interpret it as though it had an underlying truth." -- Umberto Eco
On Mon, Jun 30, 2008 at 14:06, Alan McIntyre
On Mon, Jun 30, 2008 at 2:55 PM, Robert Kern
wrote: Add the doctests argument.
Where is the buildbot configuration kept?
I have not the slightest idea. Stéfan? -- Robert Kern "I have come to believe that the whole world is an enigma, a harmless enigma that is made terrible by our own mad attempt to interpret it as though it had an underlying truth." -- Umberto Eco
2008/6/30 Robert Kern
On Mon, Jun 30, 2008 at 14:06, Alan McIntyre
wrote: On Mon, Jun 30, 2008 at 2:55 PM, Robert Kern
wrote: Add the doctests argument.
Where is the buildbot configuration kept?
I have not the slightest idea. Stéfan?
Sorry for the slow response, I'm still catching up. The Buildbot configuration is kept on buildmaster.scipy.org, that won't help you. It sends a request to the client for (something similar to) "make build; make install; make test" to be run. The administrator of each slave has control over the Makefile itself, so we'll have to ask those individuals to fix the problem. Regards Stéfan
On Thu, Jul 3, 2008 at 3:16 AM, Stéfan van der Walt
Sorry for the slow response, I'm still catching up.
I think if we turned on doctests right now, there would be about 100 test failures, so I've got plenty of my own catching up to do before doctests really need to be enabled. ;)
The Buildbot configuration is kept on buildmaster.scipy.org, that won't help you. It sends a request to the client for (something similar to) "make build; make install; make test" to be run. The administrator of each slave has control over the Makefile itself, so we'll have to ask those individuals to fix the problem.
I wonder how hard it would be to have simpler local makefiles that pull the build/install/test instructions out of svn after the update? That way we don't have to bother the slave maintainers whenever we want to tweak the build/test parameters. If I recall correctly, Python does something like this. I could look into it if it seems worth doing.
2008/7/3 Alan McIntyre
The Buildbot configuration is kept on buildmaster.scipy.org, that won't help you. It sends a request to the client for (something similar to) "make build; make install; make test" to be run. The administrator of each slave has control over the Makefile itself, so we'll have to ask those individuals to fix the problem.
I wonder how hard it would be to have simpler local makefiles that pull the build/install/test instructions out of svn after the update? That way we don't have to bother the slave maintainers whenever we want to tweak the build/test parameters.
If I recall correctly, Python does something like this. I could look into it if it seems worth doing.
We used to keep the build instructions in a central location, but it turned out that many maintainers needed to modify the Makefile to do machine-specific setups (setting up paths, mainly). What we could do is to leave the current "make build" in place, but to change the "make test" step to be common to all. We'd have to figure out which Python binary to run because, again, it depends on the build-slave setup. Regards Stéfan
participants (3)
-
Alan McIntyre
-
Robert Kern
-
Stéfan van der Walt