On Fri, 29 Apr 2011 14:29:46 +0200 DasIch firstname.lastname@example.org wrote:
Given those facts I think including pybench is a mistake. It does not allow for a fair or meaningful comparison between implementations which is one of the things the suite is supposed to be used for in the future.
"Including" is quite vague. pybench is "included" in the suite of benchmarks at hg.python.org, but that doesn't mean it is given any particular importance: you can select whichever benchmarks you want to run when "perf.py" is executed (there are even several predefined benchmark groups, none of which pybench is a member IIRC).