Mercurial repository for Python benchmarks

Hey Dirkjan, Would it be possible for us to get a Mercurial repository on python.org for the Unladen Swallow benchmarks? Maciej and I would like to move the benchmark suite out of Unladen Swallow and into python.org, where all implementations can share it and contribute to it. PyPy has been adding some benchmarks to their copy of the Unladen benchmarks, and we'd like to have as well, and Mercurial seems to be an ideal solution to this. Thanks, Collin Winter

Hi Collin (and others), On Sun, Feb 21, 2010 at 15:28, Collin Winter <collinwinter@google.com> wrote:
Just a repository on hg.python.org? Sounds good to me. Are you staying for the sprints? We'll just do it. (Might need to figure out some hooks we want to put up with it.) Cheers, Dirkjan

On Sun, Feb 21, 2010 at 2:28 PM, Collin Winter <collinwinter@google.com>wrote:
If and when you have a benchmark repository set up, could you announce it via a reply to this thread? I'd like to check it out. -- Daniel Stutzbach, Ph.D. President, Stutzbach Enterprises, LLC <http://stutzbachenterprises.com>

On Sun, Feb 21, 2010 at 21:31, Maciej Fijalkowski <fijall@gmail.com> wrote:
We probably also need some people, besides CPython devs having some access to it (like me).
Right. I've setup a public repository on hg.python.org: http://hg.python.org/benchmarks/ Right now, I still need to have Martin change some configuration so I will be able to set up push access for people other than me, so it's pull-only for now. I've already sent an email to Martin to help me get this fixed, so it should be fixed soon. Let me know if there are any issues. Cheers, Dirkjan

2010/2/21 Dirkjan Ochtman <djc.ochtman@gmail.com>:
Right. I've setup a public repository on hg.python.org:
I think we should probably develop a policy about hg.python.org repos before we start handing them out. Who will be able to have a repo on hg.python.org? What kinds of projects? -- Regards, Benjamin

Benjamin Peterson wrote:
This is pretty much the same approach we use for creating subdirectories of /sandbox on the SVN side so it sounds reasonable to me too. Cheers, Nick. -- Nick Coghlan | ncoghlan@gmail.com | Brisbane, Australia ---------------------------------------------------------------

Hey Daniel, On Sun, Feb 21, 2010 at 4:51 PM, Daniel Stutzbach <daniel@stutzbachenterprises.com> wrote:
Will do. In the meantime, you can read http://code.google.com/p/unladen-swallow/wiki/Benchmarks to find out how to check out the current draft of the benchmarks, as well as which benchmarks are currently included. Thanks, Collin Winter

On Sun, Feb 21, 2010 at 9:43 PM, Collin Winter <collinwinter@google.com> wrote:
The benchmarks repository is now available at http://hg.python.org/benchmarks/. It contains all the benchmarks that the Unladen Swallow svn repository contains, including the beginnings of a README.txt that describes the available benchmarks and a quick-start guide for running perf.py (the main interface to the benchmarks). This will eventually contain all the information from http://code.google.com/p/unladen-swallow/wiki/Benchmarks, as well as guidelines on how to write good benchmarks. If you have svn commit access, you should be able to run `hg clone ssh://hg@hg.python.org/repos/benchmarks`. I'm not sure how to get read-only access; Dirkjan can comment on that. Still todo: - Replace the static snapshots of 2to3, Mercurial and other hg-based projects with clones of the respective repositories. - Fix the 2to3 and nbody benchmarks to work with Python 2.5 for Jython and PyPy. - Import some of the benchmarks PyPy has been using. Any access problems with the hg repo should be directed to Dirkjan. Thanks so much for getting the repo set up so fast! Thanks, Collin Winter

On Mon, Feb 22, 2010 at 21:17, Collin Winter <collinwinter@google.com>wrote:
It would be http://hg.python.org/benchmarks (http, not ssh; no username; no '/repos' toplevel directory.)
-- Thomas Wouters <thomas@python.org> Hi! I'm a .signature virus! copy me into your .signature file to help me spread!

On Mon, Feb 22, 2010 at 15:42, Thomas Wouters <thomas@python.org> wrote:
It would be http://hg.python.org/benchmarks (http, not ssh; no username; no '/repos' toplevel directory.)
Correct. Another todo is to get commit mails; I'm currently working on that. Cheers, Dirkjan

On Mon, Feb 22, 2010 at 3:17 PM, Collin Winter <collinwinter@google.com> wrote:
We now have a "Benchmarks" component in the bug tracker. Suggestions for new benchmarks, feature requests for perf.py, and bugs in existing benchmarks should be reported under that component. Thanks, Collin Winter

Hi Collin (and others), On Sun, Feb 21, 2010 at 15:28, Collin Winter <collinwinter@google.com> wrote:
Just a repository on hg.python.org? Sounds good to me. Are you staying for the sprints? We'll just do it. (Might need to figure out some hooks we want to put up with it.) Cheers, Dirkjan

On Sun, Feb 21, 2010 at 2:28 PM, Collin Winter <collinwinter@google.com>wrote:
If and when you have a benchmark repository set up, could you announce it via a reply to this thread? I'd like to check it out. -- Daniel Stutzbach, Ph.D. President, Stutzbach Enterprises, LLC <http://stutzbachenterprises.com>

On Sun, Feb 21, 2010 at 21:31, Maciej Fijalkowski <fijall@gmail.com> wrote:
We probably also need some people, besides CPython devs having some access to it (like me).
Right. I've setup a public repository on hg.python.org: http://hg.python.org/benchmarks/ Right now, I still need to have Martin change some configuration so I will be able to set up push access for people other than me, so it's pull-only for now. I've already sent an email to Martin to help me get this fixed, so it should be fixed soon. Let me know if there are any issues. Cheers, Dirkjan

2010/2/21 Dirkjan Ochtman <djc.ochtman@gmail.com>:
Right. I've setup a public repository on hg.python.org:
I think we should probably develop a policy about hg.python.org repos before we start handing them out. Who will be able to have a repo on hg.python.org? What kinds of projects? -- Regards, Benjamin

Benjamin Peterson wrote:
This is pretty much the same approach we use for creating subdirectories of /sandbox on the SVN side so it sounds reasonable to me too. Cheers, Nick. -- Nick Coghlan | ncoghlan@gmail.com | Brisbane, Australia ---------------------------------------------------------------

Hey Daniel, On Sun, Feb 21, 2010 at 4:51 PM, Daniel Stutzbach <daniel@stutzbachenterprises.com> wrote:
Will do. In the meantime, you can read http://code.google.com/p/unladen-swallow/wiki/Benchmarks to find out how to check out the current draft of the benchmarks, as well as which benchmarks are currently included. Thanks, Collin Winter

On Sun, Feb 21, 2010 at 9:43 PM, Collin Winter <collinwinter@google.com> wrote:
The benchmarks repository is now available at http://hg.python.org/benchmarks/. It contains all the benchmarks that the Unladen Swallow svn repository contains, including the beginnings of a README.txt that describes the available benchmarks and a quick-start guide for running perf.py (the main interface to the benchmarks). This will eventually contain all the information from http://code.google.com/p/unladen-swallow/wiki/Benchmarks, as well as guidelines on how to write good benchmarks. If you have svn commit access, you should be able to run `hg clone ssh://hg@hg.python.org/repos/benchmarks`. I'm not sure how to get read-only access; Dirkjan can comment on that. Still todo: - Replace the static snapshots of 2to3, Mercurial and other hg-based projects with clones of the respective repositories. - Fix the 2to3 and nbody benchmarks to work with Python 2.5 for Jython and PyPy. - Import some of the benchmarks PyPy has been using. Any access problems with the hg repo should be directed to Dirkjan. Thanks so much for getting the repo set up so fast! Thanks, Collin Winter

On Mon, Feb 22, 2010 at 21:17, Collin Winter <collinwinter@google.com>wrote:
It would be http://hg.python.org/benchmarks (http, not ssh; no username; no '/repos' toplevel directory.)
-- Thomas Wouters <thomas@python.org> Hi! I'm a .signature virus! copy me into your .signature file to help me spread!

On Mon, Feb 22, 2010 at 15:42, Thomas Wouters <thomas@python.org> wrote:
It would be http://hg.python.org/benchmarks (http, not ssh; no username; no '/repos' toplevel directory.)
Correct. Another todo is to get commit mails; I'm currently working on that. Cheers, Dirkjan

On Mon, Feb 22, 2010 at 3:17 PM, Collin Winter <collinwinter@google.com> wrote:
We now have a "Benchmarks" component in the bug tracker. Suggestions for new benchmarks, feature requests for perf.py, and bugs in existing benchmarks should be reported under that component. Thanks, Collin Winter
participants (8)
-
Benjamin Peterson
-
Collin Winter
-
Daniel Stutzbach
-
Dirkjan Ochtman
-
Dirkjan Ochtman
-
Maciej Fijalkowski
-
Nick Coghlan
-
Thomas Wouters