I would be interested in getting this going as well

The runner machine is managed through the python chef repo https://github.com/python/psf-chef repo under the role "python-speed".

I can think of two ways to have this run, one as a cron job added to  a recipe and then run via psf-chef/roles/python-speed.rb

The other would be to hook the runner machine into the buildbot infrastructure as a nightly "build" task, this is the way PyPy runs its benchmarks. The advantage to this method is that it would be trivial to link in other benchmarking hardware, they would simply appear as buildbot slaves.

A third, temporary way (until chef reconfigures the runner machine) would simply be to set up a cron job on the runner machine and call it a day, check back every couple of weeks that it is still running.
I could do this over the next few days just to get the data flowing
Matti

On 28/06/18 07:38, Victor Stinner wrote:
I'm not aware of any existing doc... Let me see:

* There are two servers: the runner and the web servers. Here I only
care about the runner who I run benchmarks.
* I automated all steps to run a benchmark in the "performance"
project. At the end, the command is just "python3 -m performance
compile_all ~/bench.conf". But for pratical reasons, I chose to clone
"perf" and "performance" repositories manually, and I updated them
manually as well.

To run benchmark, I open a SSH connection, open a screen, run
"./run_benchmarks.sh" and that's it.

My request would be to automate this in a cron tab.

I'm not aware of any automation for these servers: check many in
psf-salt and psf-chef projects. My notes about the Python infra:
http://pythondev.readthedocs.io/cpython.html#python-infrastructure

I might share additional details with you in private. I'm not sure if
some parts of the infra should be kept secret or not :-)

Victor

2018-06-28 15:20 GMT+02:00 Andrii Soldatenko <andrii.soldatenko@gmail.com>:

Hi Viktor,

If you can point me to repo and docs, I can automate it.



On Jun 28, 2018, at 2:13 AM, Victor Stinner <vstinner@redhat.com> wrote:

Hi,

FYI I'm still running *manually* "./run_benchmark.sh" in a screen on
the benchmark runner to sometimes upload new results to
speed.python.org.

Since Python 3.7.0 is going to be released, I ran benchmarks.

Results: https://speed.python.org/

Is there anyone interested to write a cron task to automate running
run_benchmark.sh?

Victor
_______________________________________________
Speed mailing list
Speed@python.org
https://mail.python.org/mailman/listinfo/speed

_______________________________________________
Speed mailing list
Speed@python.org
https://mail.python.org/mailman/listinfo/speed