I have begun to dive into the performance/perf code. My goal is to get
pypy benchmarks running on http://speed.python.org. Since PyPy has a
JIT, the benchmark runs must have a warmup stage. There are some
first-cut warmup values hardcoded inside a few of the benchmarks. I
think I would prefer to use a different mechanism - a separate
calibrated data file alongside the performance benchmarks. We could
start off with a rough guess for the benchmarks and get the system up
and running, and then calibrate the warmups hopefully finding some
statistical basis for the values.
Assuming the idea of an external data file is acceptable, I have begun
diving into the code, trying to figure out the interaction between the
performance package and the perf package. It seems that running
"pyperformance run -b telco --warmups 10" does not work, the
pyperformance cli runner accepts only a subset of the perf Runner
command line options.Shouldn't the performance.cli parse_args() start
with the perf._runner.py parser?
Would a pull request along those lines be a worthwhile goal?
Thanks,
Matti
