Hi all,<div><br></div><div>As an experiment, I thought I'd test JKM's djangobench (<a href="https://github.com/jacobian/djangobench">https://github.com/jacobian/djangobench</a>) under pypy as a way of determining a (hopefully) more useful benchmark than the template-only "django" benchmark that's standard on <a href="http://speed.pypy.org">speed.pypy.org</a> and also to get an idea as to whether switching to pypy for production django apps could (currently) be a good idea.</div>
<div><br></div><div>djangobench is designed to fairly comprehensively compare the performance of different aspects of differing versions of django in an effort to detect performance degradation/regression/etc.</div><div>
<br>
</div><div>It's based on perf.py from the unladen swallow project, so it was fairly easy to crudely hack up to instead compare a single django version running under cpython 2.6 vs pypy 1.6.</div><div><br></div><div>---</div>
<div><div>$ python -V</div><div>Python 2.6.5</div></div><div><div>$ pypy -V</div><div>Python 2.7.1 (d8ac7d23d3ec, Aug 17 2011, 11:51:19)</div><div>[PyPy 1.6.0 with GCC 4.4.3]</div></div><div>---</div><div><br></div><div>
The results were a little surprising (and not in a good way): <a href="http://pastie.org/2463906">http://pastie.org/2463906</a></div>
<div><br></div><div>Based on the highly degraded performance (>2 orders of magnitude in some cases) I'm guessing there's some sort of issue in the way I'm benchmarking things.</div><div><br></div><div>Code can be found here: <a href="https://github.com/fennb/djangobench">https://github.com/fennb/djangobench</a></div>
<div><br></div><div>Environment is ubuntu 10.04 64bit running in a VM on a macbook pro. cpython was the current ubuntu binary package, pypy was 1.6 precompiled binary from <a href="http://pypy.org">pypy.org</a>. It's quite possible memory size issues may have impacted some of the benchmarks (but not all).</div>
<div><br></div><div>Any ideas as to why the performance drop-off would be so significant?</div><div><br></div><div>Cheers,</div><div><br></div><div> Fenn.</div>