[Python-Dev] performance testing recommendations in devguide
solipsis at pitrou.net
Wed May 29 21:19:43 CEST 2013
On Wed, 29 May 2013 21:59:21 +0300
Carlos Nepomuceno <carlosnepomuceno at outlook.com> wrote:
>  "pybench - run the standard Python PyBench benchmark suite. This is considered
> an unreliable, unrepresentative benchmark; do not base decisions
> off it. It is included only for completeness."
"unrepresentative" is the main criticism against pybench. PyBench is a
suite of micro-benchmarks (almost nano-benchmarks, actually :-)) that
don't try to simulate any real-world situation.
PyBench may also be unreliable, because its tests are so static that
they could be optimized away by a clever enough (JIT) compiler.
More information about the Python-Dev