[pypy-dev] benchmarking input

Franck Pommereau pommereau at univ-paris12.fr
Mon Sep 28 09:31:20 CEST 2009


> I need some input for the benchmarking infrastructure. I'm nearly
> at the point where I need to have some place to run it before
> continuing (i.e. I need to try and use it, not just speculate).

This is not an answer to your question but might interest you.

We it comes to benchmarking, the following paper is certainly worth
reading: http://www-plan.cs.colorado.edu/diwan/asplos09.pdf
It explains how many benchmarks are biased and result in faulty measures
(in important proportions), and how this can be compensated.

Cheers,
Franck



More information about the Pypy-dev mailing list