Re: [Speed] New benchmark suite for Python
Zachary Ware schrieb am 18.08.2016 um 06:47:
On Wed, Aug 17, 2016 at 7:37 PM, Victor Stinner wrote:
PyPy, Pyston, Pyjion, Numba, etc. : Hey! it's now time to start to take a look at my project and test it ;-) Tell me what is broken, what is missing, and I will try to help you to move your project to this new benchmark suite!
Also, if you're interested in having your interpreter benchmarked on speed.python.org, contact me with clear instructions (preferably in the form of a shell or Python script) on how to build, test, install, and invoke your interpreter from a fresh Ubuntu 16.04 installation. As an example, here's an untested version for CPython 3.x:
#!/bin/sh # set up dependencies sudo apt-get build-dep -y python3 sudo apt-get install -y --no-install-recommends mercurial # get the code hg clone https://hg.python.org/cpython cd cpython # build ./configure --prefix=/opt/python/default make -j12 # test make buildbottest TESTOPTS=-j12 # install make install # invoke /opt/python/default/bin/python3
I don't know when I'll have a chance to work on it, but I'd like to get as many projects as possible benchmarked on speed.python.org.
Is there a repository somewhere with existing runner scripts that I could look at and send a pull request to? I saw the python/speed.python.org project on github, but that seems rather dead.
Victor: Thanks for getting the new repository set up and for all your work on the new runner! I'm looking forward to trying it out.
+1
Stefan
On Thu, Aug 18, 2016 at 1:46 AM, Stefan Behnel stefan_ml@behnel.de wrote:
Is there a repository somewhere with existing runner scripts that I could look at and send a pull request to? I saw the python/speed.python.org project on github, but that seems rather dead.
The whole speed.python.org project is a bit of a mess currently, my goal when getting it set up was to just get it actually working without much regard for keeping things tidy. https://github.com/python/speed.python.org was a placeholder site, speed.python.org is now serving https://github.com/zware/codespeed. The benchmark runner is currently the standard perf.py in hg.python.org/benchmarks, driven by a script very similar to the 'run_and_upload.py' in http://bugs.python.org/file41202/benchmarks.diff which lives on the benchmark runner and is not currently version-controlled. Benchmark runs are started by buildbot.python.org, see http://buildbot.python.org/all/buildslaves/speed-python (the master config is not public, that's also on my list of things to get to along with rewriting the master config to handle the GitHub move and other improvements. The commands passed to the runner can be gleaned from the buildbot logs, though). There's not really any good way to send a PR on anything but the speed.python.org site right now.
participants (2)
-
Stefan Behnel -
Zachary Ware