[pypy-dev] Idea for speed.pypy.org

Wed Dec 22 11:19:29 CET 2010

@Alex: added!

2010/12/22 Alex Gaynor <alex.gaynor at gmail.com>:
> ai: runs a bruce force n-queens solver
>
> Alex
>
> On Wed, Dec 22, 2010 at 2:26 AM, Miquel Torres <tobami at googlemail.com>
> wrote:
>>
>> so, what about the ai and spectral-norm benchmarks. Anybody can come
>> up with a description for them?
>>
>>
>> 2010/12/15 Paolo Giarrusso <p.giarrusso at gmail.com>:
>> > On Mon, Dec 13, 2010 at 09:31, Miquel Torres <tobami at googlemail.com>
>> > wrote:
>> >> Oh, btw., the "normalized" stacked bars now display a warning note
>> >> about its correctness, and how it must be viewed as giving results a
>> >> weighting instead of them being normalized. It even includes a link to
>> >> the proper paper. I hope that is enough for the strict statisticians
>> >> among us ;-)
>> >
>> > I see. Thanks!
>> >
>> >> See:
>> >>
>> >> http://speed.pypy.org/comparison/?exe=1%2B172,3%2B172,1%2BL,3%2BL&ben=1,2,25,3,4,5,22,6,7,8,23,24,9,10,11,12,13,14,15,16,17,18,19,20&env=1&hor=true&bas=2%2B35&chart=stacked+bars
>> >>
>> >> PS: there is a bug in the jqPlot plotting library when null values are
>> >> present. Trying to display PyPy 1.3 results for the newer go, pyflake
>> >> or  raytrace will create some nasty js loops. It also has problems
>> >> with autoscaling the axis sometimes.
>> >>
>> >>
>> >>
>> >> 2010/12/13 Miquel Torres <tobami at googlemail.com>:
>> >>> Thanks all for the input.
>> >>> I've compiled a list based on your mails, the Unladen benchmarks page
>> >>> (http://code.google.com/p/unladen-swallow/wiki/Benchmarks), and the
>> >>> alioth descriptions. Here is an extract of the current speed.pypy.org
>> >>> admin:
>> >>>
>> >>> ai
>> >>> chaos   Creates chaosgame-like fractals
>> >>> crypto_pyaes    A pure python implementation of AES
>> >>> django          Uses the Django template system to build a
>> >>> 150x150-cell HTML table
>> >>>
>> >>> fannkuch                Indexed-access to tiny integer-sequence. The
>> >>> fannkuch
>> >>> benchmark is defined by programs in Performing Lisp Analysis of the
>> >>> FANNKUCH Benchmark, Kenneth R. Anderson and Duane Rettig.
>> >>>
>> >>> float           Creates an array of points using circular projection
>> >>> and then
>> >>> normalizes and maximizes them. Floating-point heavy.
>> >>> go              A go (chess like game) computer player AI.
>> >>> html5lib        Parses the HTML 5 spec using html5lib
>> >>> meteor-contest  Searchs for solutions to shape packing puzzle.
>> >>> nbody_modified          Double-precision N-body simulation. It models
>> >>> the
>> >>> orbits of Jovian planets, using a simple symplectic-integrator.
>> >>> pyflate-fast            Stand-alone pure-Python DEFLATE (gzip) and
>> >>> bzip2
>> >>> decoder/decompressor.
>> >>> raytrace-simple A raytracer renderer
>> >>> richards                Medium-sized language benchmark that simulates
>> >>> the task
>> >>> dispatcher in the kernel of an operating system.
>> >>> rietveld        A Django application benchmark.
>> >>> slowspitfire
>> >>> spambayes       Runs a canned mailbox through a SpamBayes ham/spam
>> >>> classifier
>> >>> spectral-norm
>> >>> spitfire        Uses the Spitfire template system to build a
>> >>> 1000x1000-cell HTML table.
>> >>> spitfire_cstringio      Uses the Spitfire template system to build a
>> >>> 1000x1000-cell HTML table, using the cstringio module.
>> >>> telco
>> >>> twisted_iteration
>> >>> twisted_names
>> >>> twisted_pb
>> >>> twisted_tcp     Connects one Twised client to one Twisted server over
>> >>> TCP
>> >>> (on the loopback interface) and then writes bytes as fast as it can.
>> >>> waf     Python-based framework for configuring, compiling and
>> >>> installing
>> >>> applications. It derives from the concepts of other build tools such
>> >>> as Scons, Autotools, CMake or Ant.
>> >>>
>> >>>
>> >>> So the remaining descriptions are
>> >>> ai
>> >>> slowspitfire (what is the exact difference between the three spitfire
>> >>> benches?)
>> >>> spectral-norm
>> >>> telco
>> >>> twisted (most of them)
>> >>>
>> >>> Are the descriptions all right so far?. They can be made much longer
>> >>> if you deem it desirable.
>> >>>
>> >>> on speed.pypy.org you will currently see the descriptions in 3 places:
>> >>> - Changes view: A tooltip on hover over each benchmark
>> >>> - Timeline: a description box beneath each plot
>> >>> - Comparison: A tooltip over each benchmark when hovering the
>> >>> selection menu on the left side.
>> >>>
>> >>> Any suggestions on how to improve it further are welcome ;-)
>> >>>
>> >>> Miquel
>> >>>
>> >>>
>> >>> 2010/12/9 Paolo Giarrusso <p.giarrusso at gmail.com>:
>> >>>> On Thu, Dec 9, 2010 at 14:14, Leonardo Santagada
>> >>>> <santagada at gmail.com> wrote:
>> >>>>> Here is a incomplete draft list:
>> >>>>
>> >>>>> [slow]spitfire[cstringio]: Spitfire is a template language, the
>> >>>>> cstringio version uses a modified engine (that uses cstringio)
>> >>>>
>> >>>>> spambayes: Spambayes is a bayesian spam filter
>> >>>>
>> >>>> Why is [slow]spitfire slower with PyPy? Is it regex-related? I
>> >>>> remember when, because of this, spambayes was slower (including
>> >>>> release 1.3, now solved). But for spitfire, 1.3 was faster than 1.4
>> >>>> and the head (for slowspitfire it's the opposite).
>> >>>>
>> >>>> For the rest, I see no significant case of slowdown of PyPy over
>> >>>> time.
>> >>>>
>> >>>> http://speed.pypy.org/comparison/?exe=2%2B35,1%2B41,1%2B172,1%2BL&ben=1,2,25,3,4,5,22,6,7,8,23,24,9,10,11,12,13,14,15,16,17,18,19,20,26&env=1&hor=true&bas=2%2B35&chart=normal+bars
>> >>>> --
>> >>>> Paolo Giarrusso - Ph.D. Student
>> >>>> http://www.informatik.uni-marburg.de/~pgiarrusso/
>> >>>>
>> >>>
>> >>
>> >
>> >
>> >
>> > --
>> > Paolo Giarrusso - Ph.D. Student
>> > http://www.informatik.uni-marburg.de/~pgiarrusso/
>> >
>> _______________________________________________
>> pypy-dev at codespeak.net
>> http://codespeak.net/mailman/listinfo/pypy-dev
>
>
>
> --
> "I disapprove of what you say, but I will defend to the death your right to
> say it." -- Evelyn Beatrice Hall (summarizing Voltaire)
> "The people's good is the highest law." -- Cicero
> "Code can always be simpler than you think, but never as simple as you want"
> -- Me
>