I annoyed many of you on this mailing list with all my WTF performance issues. I consider that I now succeeded to get benchmarks stable enough to become "usable" (reliable). Two days ago, I gave a talk "How to run a stable benchmark" at FOSDEM (Brussels, Belgium) on my findings.
Slides and video of my talk are now online, enjoy! https://fosdem.org/2017/schedule/event/python_stable_benchmark/
- Tune system to run benchmarks: python3 -m perf system tune
- Stop using timeit!: python3 -m timeit STMT ⇒ python3 -m perf timeit STMT
- Use perf and its documentation! http://perf.rtfd.io/