[SciPy-user] some benchmark data for numarray, Numeric and scipy-newcore

[David M. Cooke]

On Dec 3, 2005, at 7:14 , Gerard Vermeulen wrote:

> I have benchmarked some array manipulations using the default
> Numeric and numarray on my Mandrake-10.2 and a recent snapshot
> of the new scipy core.
>
> I used the following script which takes two arguments: a string
> indicating which Numerical extension to use and an integer
> setting the size of the arrays.
>
>
> The results follow below, where the label column indicates the  
> corresponding
> statement in the klein() function above:

I've attached a version that runs all three packages at once, with  
results in columns.

> [packer at titan JUNK]$ ./bench.py Numeric 12
> Numeric-23.1: benchmark size = 12

This is an old Numeric version; there were speedups made in 23.8.

> numarray-1.2.3: benchmark size = 12

Also old.

> Conclusion:
> - the overal performance of numarray is 23 % better than scipy- 
> newcore and
>   27 % better than Numeric.
> - numarray is consistently faster than the other packages.
> - scipy newcore is on average somewhat faster than Numeric3, but  
> some operations
>   are really slow in comparison with the other packages. In  
> partical the
>   statements labeled 2, 3, 4, 6 and 7 take 2 times more time using  
> scipy-newcore
>   than using Numeric.

These are my numbers. They don't support the above conclusions :-)  
This is on an Athlon 64 3200+, running Debian. Numeric and numarray  
are from Debian unstable.

cookedm at arbutus$ py bench.py 12
Numeric-24.2
numarray-1.4.0
scipy-core-0.7.4.1550
benchmark size = 12  (vectors of length 16777216)
label            Numeric       numarray     scipy.base
     1             0.5642          1.086          0.541
     2              1.044          1.952         0.8472
     3             0.7367         0.7428         0.6201
     4              1.965         0.8811           2.45
     5              1.048         0.9061         0.9241
     6             0.7419         0.7496         0.5371
     7              1.972          1.293          2.412
     8              1.222           0.94         0.9529
     9              23.99          13.65          13.16
    10              14.96          13.65          11.42
    11              10.86          10.61          9.056
TOTAL               59.1          46.47          42.92

-- 
|>|\/|<
/------------------------------------------------------------------\
|David M. Cooke              http://arbutus.physics.mcmaster.ca/dmc/
|cookedm at physics.mcmaster.ca
-------------- next part --------------
A non-text attachment was scrubbed...
Name: bench.py
Type: text/x-python-script
Size: 3067 bytes
Desc: not available
URL: <http://mail.scipy.org/pipermail/scipy-user/attachments/20051203/7e8ddd29/attachment.bin>
-------------- next part --------------