Mailman 3 October 2012 - Speed

Re: [Speed] Status of speed.python.org?
by Carsten Senger 21 Oct '12

21 Oct '12

Am 21.10.2012 11:08, schrieb Maciej Fijalkowski: > On Sat, Oct 20, 2012 at 1:21 PM, Carsten Senger <senger(a)rehfisch.de> wrote: >> Am 19.10.2012 21:38, schrieb Miquel Torres: >>> Right. On the webapp (Codespeed) side of things I am willing to help >>> in anything you need. >>> The blocker has been mostly the benchmark runner, AFAIK. >> >> Some month ago I worked on the benchmark runner and the build slave >> helpers in the pypy repository. They can run the test suite for both >> pypy and cpython. It will need no or minor tweeks to use python3. What >> was missing back then, and IIRC planned to be discussed at PyCo, was the >> port of the benchmarks to python 3. >> >> Now it can be set up on speed.p.o (with minor adjustments if necessary). >> I'd do work on that too. >> >> ..Carsten >> > > FYI the running on python 2 never worked (because of option passing). > It roughly shows up how people care (or how much they know). I suppose > we can declare "running benchmarks on python 2" a completely pointless > exercise. I know I cared. It worked with my patches that where merged by you. They removed the hard coded configuration from the build factories and the runner. I stopped then cause nobody was interested to collect data for 2.7 which would not receive notable changes. Same applied to historical data for python 2. Pointless describes that very well, but for different reasons. There where no python 3 benchmarks and the how and when seemed more like a political discussion to me. ..Carsten -- Carsten Senger - Schumannstr. 38 - 65193 Wiesbaden senger(a)rehfisch.de - (0611) 5324176 PGP: gpg --recv-keys --keyserver hkp://subkeys.pgp.net 0xE374C75A

2 1

Re: [Speed] Status of speed.python.org?
by Carsten Senger 21 Oct '12

21 Oct '12

Am 19.10.2012 21:38, schrieb Miquel Torres: > Right. On the webapp (Codespeed) side of things I am willing to help > in anything you need. > The blocker has been mostly the benchmark runner, AFAIK. Some month ago I worked on the benchmark runner and the build slave helpers in the pypy repository. They can run the test suite for both pypy and cpython. It will need no or minor tweeks to use python3. What was missing back then, and IIRC planned to be discussed at PyCo, was the port of the benchmarks to python 3. Now it can be set up on speed.p.o (with minor adjustments if necessary). I'd do work on that too. ..Carsten > 2012/10/19 Maciej Fijalkowski <fijall(a)gmail.com>: >> On Fri, Oct 19, 2012 at 12:46 PM, Jesse Noller <jnoller(a)gmail.com> wrote: >>> >>> >>> On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall(a)gmail.com> wrote: >>> >>>> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner >>>> <victor.stinner(a)gmail.com> wrote: >>>>> Hi, >>>>> >>>>> What is the status of speed.python.org? Where are the benchmarks? Does >>>>> anyone try to setup something to run regulary benchmarks and display >>>>> data on web pages? >>>>> >>>>> How can I help? >>>>> >>>>> Victor >>>> >>>> Hi Victor. >>>> >>>> The status is "noone cares". >>> >>> Hi. I care. Other people do too. Maybe you don't - that's ok. The problem is lack of time / project planning. >> >> Ok, to be precise "noone cares enough to make things happen", this is >> a fact. I actually care to some extend and I'm willing to help with >> stuff, however, there must be someone who cares more on the python >> core development team to make the exercise not-completely-pointless. >> >> Cheers, >> fijal >> _______________________________________________ >> Speed mailing list >> Speed(a)python.org >> http://mail.python.org/mailman/listinfo/speed > _______________________________________________ > Speed mailing list > Speed(a)python.org > http://mail.python.org/mailman/listinfo/speed > -- Carsten Senger - Schumannstr. 38 - 65193 Wiesbaden senger(a)rehfisch.de - (0611) 5324176 PGP: gpg --recv-keys --keyserver hkp://subkeys.pgp.net 0xE374C75A

2 1

Re: [Speed] Status of speed.python.org?
by Miquel Torres 20 Oct '12

20 Oct '12

Maciej: Last year, as the project begun, I immediately set up an instance. We removed it from port 80 because nothing was ready yet, but it has been there since: http://speed.python.org:8080/ As soon as there is data somewhere I can upgrade and setup the Codespeed version properly. 2012/10/20 Maciej Fijalkowski <fijall(a)gmail.com>: > On Sat, Oct 20, 2012 at 12:08 AM, Brett Cannon <brett(a)python.org> wrote: >> >> >> On Fri, Oct 19, 2012 at 3:38 PM, Miquel Torres <tobami(a)gmail.com> wrote: >>> >>> Right. On the webapp (Codespeed) side of things I am willing to help >>> in anything you need. >>> The blocker has been mostly the benchmark runner, AFAIK. >>> >> >> And how specifically is that a blocker so we can work on eliminating those >> issues? >> >> -Brett > > Log in, setup a buildbot, make sure it's connected to the python > buildmaster and it's running. Before that go to Noah and ask for an > account. Then set up a codespeed instance somewhere (not sure where) > and connect the two together.

1 0

Re: [Speed] Status of speed.python.org?
by Maciej Fijalkowski 20 Oct '12

20 Oct '12

On Sat, Oct 20, 2012 at 12:08 AM, Brett Cannon <brett(a)python.org> wrote: > > > On Fri, Oct 19, 2012 at 3:38 PM, Miquel Torres <tobami(a)gmail.com> wrote: >> >> Right. On the webapp (Codespeed) side of things I am willing to help >> in anything you need. >> The blocker has been mostly the benchmark runner, AFAIK. >> > > And how specifically is that a blocker so we can work on eliminating those > issues? > > -Brett Log in, setup a buildbot, make sure it's connected to the python buildmaster and it's running. Before that go to Noah and ask for an account. Then set up a codespeed instance somewhere (not sure where) and connect the two together.

1 0

Re: [Speed] Status of speed.python.org?
by Nick Coghlan 19 Oct '12

19 Oct '12

On Sat, Oct 20, 2012 at 8:25 AM, Andrew Svetlov <andrew.svetlov(a)gmail.com> wrote: > I like to be a volunteer. > What shall I do? Is there some roadmap for this project? The issue tracker for the project is now on the PSF's BitBucket org account: https://bitbucket.org/PSF/python-speed/issues?status=new&status=open It would be great if people could update those issues to indicate what they're working on - I just sent a bunch of invitations to make sure respondents to this thread have appropriate access. Cheers, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

1 0

Re: [Speed] Status of speed.python.org?
by Andrew Svetlov 19 Oct '12

19 Oct '12

I like to be a volunteer. What shall I do? Is there some roadmap for this project? On Sat, Oct 20, 2012 at 1:08 AM, Brett Cannon <brett(a)python.org> wrote: > > > On Fri, Oct 19, 2012 at 3:38 PM, Miquel Torres <tobami(a)gmail.com> wrote: >> >> Right. On the webapp (Codespeed) side of things I am willing to help >> in anything you need. >> The blocker has been mostly the benchmark runner, AFAIK. >> > > And how specifically is that a blocker so we can work on eliminating those > issues? > > -Brett > >> >> Miquel >> >> >> 2012/10/19 Maciej Fijalkowski <fijall(a)gmail.com>: >> > On Fri, Oct 19, 2012 at 12:46 PM, Jesse Noller <jnoller(a)gmail.com> >> > wrote: >> >> >> >> >> >> On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall(a)gmail.com> >> >> wrote: >> >> >> >>> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner >> >>> <victor.stinner(a)gmail.com> wrote: >> >>>> Hi, >> >>>> >> >>>> What is the status of speed.python.org? Where are the benchmarks? >> >>>> Does >> >>>> anyone try to setup something to run regulary benchmarks and display >> >>>> data on web pages? >> >>>> >> >>>> How can I help? >> >>>> >> >>>> Victor >> >>> >> >>> Hi Victor. >> >>> >> >>> The status is "noone cares". >> >> >> >> Hi. I care. Other people do too. Maybe you don't - that's ok. The >> >> problem is lack of time / project planning. >> > >> > Ok, to be precise "noone cares enough to make things happen", this is >> > a fact. I actually care to some extend and I'm willing to help with >> > stuff, however, there must be someone who cares more on the python >> > core development team to make the exercise not-completely-pointless. >> > >> > Cheers, >> > fijal >> > _______________________________________________ >> > Speed mailing list >> > Speed(a)python.org >> > http://mail.python.org/mailman/listinfo/speed >> _______________________________________________ >> Speed mailing list >> Speed(a)python.org >> http://mail.python.org/mailman/listinfo/speed > > > > _______________________________________________ > Speed mailing list > Speed(a)python.org > http://mail.python.org/mailman/listinfo/speed > -- Thanks, Andrew Svetlov

1 0

Re: [Speed] Status of speed.python.org?
by Brett Cannon 19 Oct '12

19 Oct '12

On Fri, Oct 19, 2012 at 3:38 PM, Miquel Torres <tobami(a)gmail.com> wrote: > Right. On the webapp (Codespeed) side of things I am willing to help > in anything you need. > The blocker has been mostly the benchmark runner, AFAIK. > > And how specifically is that a blocker so we can work on eliminating those issues? -Brett > Miquel > > > 2012/10/19 Maciej Fijalkowski <fijall(a)gmail.com>: > > On Fri, Oct 19, 2012 at 12:46 PM, Jesse Noller <jnoller(a)gmail.com> > wrote: > >> > >> > >> On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall(a)gmail.com> > wrote: > >> > >>> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner > >>> <victor.stinner(a)gmail.com> wrote: > >>>> Hi, > >>>> > >>>> What is the status of speed.python.org? Where are the benchmarks? > Does > >>>> anyone try to setup something to run regulary benchmarks and display > >>>> data on web pages? > >>>> > >>>> How can I help? > >>>> > >>>> Victor > >>> > >>> Hi Victor. > >>> > >>> The status is "noone cares". > >> > >> Hi. I care. Other people do too. Maybe you don't - that's ok. The > problem is lack of time / project planning. > > > > Ok, to be precise "noone cares enough to make things happen", this is > > a fact. I actually care to some extend and I'm willing to help with > > stuff, however, there must be someone who cares more on the python > > core development team to make the exercise not-completely-pointless. > > > > Cheers, > > fijal > > _______________________________________________ > > Speed mailing list > > Speed(a)python.org > > http://mail.python.org/mailman/listinfo/speed > _______________________________________________ > Speed mailing list > Speed(a)python.org > http://mail.python.org/mailman/listinfo/speed >

1 0

Re: [Speed] Status of speed.python.org?
by Miquel Torres 19 Oct '12

19 Oct '12

Right. On the webapp (Codespeed) side of things I am willing to help in anything you need. The blocker has been mostly the benchmark runner, AFAIK. Miquel 2012/10/19 Maciej Fijalkowski <fijall(a)gmail.com>: > On Fri, Oct 19, 2012 at 12:46 PM, Jesse Noller <jnoller(a)gmail.com> wrote: >> >> >> On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall(a)gmail.com> wrote: >> >>> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner >>> <victor.stinner(a)gmail.com> wrote: >>>> Hi, >>>> >>>> What is the status of speed.python.org? Where are the benchmarks? Does >>>> anyone try to setup something to run regulary benchmarks and display >>>> data on web pages? >>>> >>>> How can I help? >>>> >>>> Victor >>> >>> Hi Victor. >>> >>> The status is "noone cares". >> >> Hi. I care. Other people do too. Maybe you don't - that's ok. The problem is lack of time / project planning. > > Ok, to be precise "noone cares enough to make things happen", this is > a fact. I actually care to some extend and I'm willing to help with > stuff, however, there must be someone who cares more on the python > core development team to make the exercise not-completely-pointless. > > Cheers, > fijal > _______________________________________________ > Speed mailing list > Speed(a)python.org > http://mail.python.org/mailman/listinfo/speed

1 0

Re: [Speed] Status of speed.python.org?
by Jesse Noller 19 Oct '12

19 Oct '12

On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall(a)gmail.com> wrote: > On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner > <victor.stinner(a)gmail.com> wrote: >> Hi, >> >> What is the status of speed.python.org? Where are the benchmarks? Does >> anyone try to setup something to run regulary benchmarks and display >> data on web pages? >> >> How can I help? >> >> Victor > > Hi Victor. > > The status is "noone cares". Hi. I care. Other people do too. Maybe you don't - that's ok. The problem is lack of time / project planning. > Brett ported a bunch of py3k benchmarks, > so I suppose this is a very good start. Someone has to add a > buildslave there (preferably for cpython buildbots) that runs > runner.py from US and uploads the info to codespeed. > > Codespeed can be also set up somewhere (I did, it's not the end of the world). > > Cheers, > fijal > _______________________________________________ > Speed mailing list > Speed(a)python.org > http://mail.python.org/mailman/listinfo/speed

2 1

Re: [Speed] Status of speed.python.org?
by Maciej Fijalkowski 19 Oct '12

19 Oct '12

On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner <victor.stinner(a)gmail.com> wrote: > Hi, > > What is the status of speed.python.org? Where are the benchmarks? Does > anyone try to setup something to run regulary benchmarks and display > data on web pages? > > How can I help? > > Victor Hi Victor. The status is "noone cares". Brett ported a bunch of py3k benchmarks, so I suppose this is a very good start. Someone has to add a buildslave there (preferably for cpython buildbots) that runs runner.py from US and uploads the info to codespeed. Codespeed can be also set up somewhere (I did, it's not the end of the world). Cheers, fijal

1 0