[Python-Dev] speed.python.org (was: 2.7 is here until 2020, please don't call it a waste.)

[Philip Jenvey]

> On Jun 22, 2015, at 6:58 PM, Zachary Ware <zachary.ware+pydev at gmail.com> wrote:
> 
> On Thu, Jun 4, 2015 at 10:51 AM, Maciej Fijalkowski <fijall at gmail.com> wrote:
>> On Thu, Jun 4, 2015 at 4:32 PM, R. David Murray <rdmurray at bitdance.com> wrote:
>>> OK, so what you are saying is that speed.python.org will run a buildbot
>>> slave so that when a change is committed to cPython, a speed run will be
>>> triggered?  Is "the runner" a normal buildbot slave, or something
>>> custom?  In the normal case the master controls what the slave
>>> runs...but regardless, you'll need to let us know how the slave
>>> invocation needs to be configured on the master.
>> 
>> Ideally nightly (benchmarks take a while). The setup for pypy looks like this:
>> 
>> 
>> https://bitbucket.org/pypy/buildbot/src/5fa1f1a4990f842dfbee416c4c2e2f6f75d451c4/bot2/pypybuildbot/builds.py?at=default#cl-734
>> 
>> so fairly easy. This already generates a json file that you can plot.
>> We can setup an upload automatically too.
> 
> I've been looking at what it will take to set up the buildmaster for
> this, and it looks like it's just a matter of checking out the
> benchmarks, building Python, testing it, and running the benchmarks.
> There is the question of which benchmark repo to use:
> https://bitbucket.org/pypy/benchmarks or
> https://hg.python.org/benchmarks; ideally, we should use
> hg.python.org/benchmarks for CPython benchmarks, but it looks like
> pypy/benchmarks has the necessary runner, so I suppose we'll be using
> it for now.  Is there interest from both sides to merge those
> repositories?

PyPy’s is a more extensive suite but it does not fully support Python 3 yet. It makes sense to merge them.

--
Philip Jenvey