[Python-Dev] [GSoC] Developing a benchmark suite (for Python 3.x)

[Stefan Behnel]

Jesse Noller, 07.04.2011 22:28:
> On Thu, Apr 7, 2011 at 3:54 PM, Anthony Scopatz wrote:
>> Hi Daniel,
>> Thanks for putting this together.  I am a huge supporter of benchmarking
>> efforts.  My brief comment is below.
>>
>> On Wed, Apr 6, 2011 at 11:52 AM, DasIch wrote:
>>>
>>> 1. Definition of the benchmark suite. This will entail contacting
>>> developers of Python implementations (CPython, PyPy, IronPython and
>>> Jython), via discussion on the appropriate mailing lists. This might
>>> be achievable as part of this proposal.
>>>
>>
>> If you are reaching out to other projects at this stage, I think you should
>> also be in touch with the Cython people  (even if its 'implementation'
>> sits on top of CPython).
>> As a scientist/engineer what I care about is how Cython benchmarks to
>> CPython.  I believe that they have some ideas on benchmarking and have
>> also explored this space.  Their inclusion would be helpful to me thinking
>> this GSoC successful at the end of the day (summer).
>> Thanks for your consideration.
>> Be Well
>> Anthony
>
> Right now, we are talking about building "speed.python.org" to test
> the speed of python interpreters, over time, and alongside one another
> - cython *is not* an interpreter.

Would you also want to exclude Psyco then? It clearly does not qualify as a 
Python interpreter.


> Cython is out of scope for this.

Why? It should be easy to integrate Cython using pyximport. Basically, all 
you have to do is register the pyximport module as an import hook. Cython 
will then try to compile the imported Python modules and fall back to the 
normal .py file import if the compilation fails for some reason.

So, once CPython is up and running in the benchmark test, adding Cython 
should be as easy as copying the configuration, installing Cython and 
adding two lines to site.py.

Obviously, we'd have to integrate a build of the latest Cython development 
sources as well, but it's not like installing a distutils enabled Python 
package from sources is so hard that it pushes Cython out of scope for this 
GSoC.

Stefan