Re: [Speed] Codespeed up and running
Great Tennessee. Feel free to use your project to do the actual benchmarking. He Who Codes Decides. That is Open Source ;-)
The tool used for PyPy (Unladen Swallow¨s) does several runs and gets the average and standard deviation. That value is currently not used much (and a VM/JIT makes that number probably not very useful at all), but it does help sometimes to tell whether a strange result is caused by the infrastructure (measuring error) or it is a genuine change in performance. Does benchmarker.py cover that?
The Codespeed instance is already working and accessible through http://speed.python.org I added user "tleeuwenburg" pass "speed" so that you can adjust environments and projects.
Ready to save data!
Anyway great to hear you are going to give it a try. Miquel
2011/9/26 Tennessee Leeuwenburg <tleeuwenburg@gmail.com>:
Thanks, at the point where I'm doing something, I'll remember I've got someone I can ask a few questions of... much appreciated!
-T
On Mon, Sep 26, 2011 at 10:05 AM, Noah Kantrowitz <noah@coderanger.net> wrote:
I'm on IRC and XMPP (coderanger, coderanger@gmail.com) if you want another pair of eyes on anything.
--Noah
On Sep 25, 2011, at 4:35 PM, Tennessee Leeuwenburg wrote:
Sweet. Well, that was the biggest obstacle. Now we're back to time being the bottleneck. I'll try to find some in the next day or two and get *something* going.
Cheers, -T
On Mon, Sep 26, 2011 at 9:32 AM, Noah Kantrowitz <noah@coderanger.net> wrote:
I think the plan is not to worry about Chef-izing things right now. The box can be wiped and rebuilt at a later date but right now getting something up and running is a higher priority.
--Noah
On Sep 25, 2011, at 4:30 PM, Tennessee Leeuwenburg wrote:
I am more than happy to do the work (still), but am idle waiting for instructions on how to do about it. It seemed like I needed to use Chef, and make some (hopefully easy) choices about how to do it. I'll dig out the email I sent round outlining a task list and with a few queries...
On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller <jnoller@gmail.com> wrote:
We need someone to do it. Are there instructions everywhere
On Sep 25, 2011, at 1:55 PM, Miquel Torres <tobami@googlemail.com> wrote:
> So, is anyone working on the benchmark runner part? or should we > "resign" that task, or look for other possibilities? > > Miquel > > > 2011/9/14 Miquel Torres <tobami@googlemail.com>: >> Ok, great! >> >> I can help out by giving you the rough recipe outline: >> ============================================ >> include_recipe "apache2::mod_wsgi" >> >> easy_install "codespeed" >> >> web_app "codespeed" do >> server_name node['hostname'] >> server_aliases [node['fqdn'], "speed.python.org"] >> template "speed.conf.erb" >> docroot "/home/tobami/speed/" # though we can change that >> end >> ============================================ >> >> As a base for the custom template you can take the current >> /etc/apache2/sites-enables/codespeed >> >> Now this is were things get more complicated. The Django project is >> under /home/tobami/speed/, with www-data permissions (so you can copy >> anything). >> The speed/templates/ contains the basic templates for the views. and >> the content of sitestatic was created with "./manage.py >> collectstatic". >> >> So this last part will need some execute block or similar. For >> anything else you need just ask and I'll help! >> >> Miquel >> >> >> PS: Python logo is up ;-) >> >> >> 2011/9/14 Noah Kantrowitz <noah@coderanger.net>: >>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>> >>> --Noah >>> >>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>> >>>> Hi Noah, >>>> >>>> I didn't use any recipes for it, was more of a one-off. Would of >>>> course like to have a cookbook and run_list for it all, but I am not >>>> there yet. >>>> >>>> Miquel >>>> >>>> >>>> 2011/9/13 Noah Kantrowitz <noah@coderanger.net>: >>>>> Just wanted to poke about this again post-weekend :-) >>>>> >>>>> --Noah >>>>> >>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>> >>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>> >>>>>> --Noah >>>>>> >>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>> >>>>>>> Hi all, >>>>>>> >>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>> proper Codespeed instance! >>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>> >>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>> looks like we are going to directly test on that big server, bare >>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>> >>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>> want to announce. >>>>>>> >>>>>>> What do you think? >>>>>>> Miquel >>>>>>> _______________________________________________ >>>>>>> Speed mailing list >>>>>>> Speed@python.org >>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>> >>>>>> _______________________________________________ >>>>>> Speed mailing list >>>>>> Speed@python.org >>>>>> http://mail.python.org/mailman/listinfo/speed >>>>> >>>>> >>> >>> >> > _______________________________________________ > Speed mailing list > Speed@python.org > http://mail.python.org/mailman/listinfo/speed
Speed mailing list Speed@python.org http://mail.python.org/mailman/listinfo/speed
--
Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think"
Speed mailing list Speed@python.org http://mail.python.org/mailman/listinfo/speed
-----BEGIN PGP SIGNATURE-----
iEYEARECAAYFAk5/ui8ACgkQA9fEp2eRsU+h3ACgqZ/hbABNeaTaOF9KFgG74vMd VXUAoIdhQV/sCgLtLOP+/MLUEGGXk8zZ =JlrA -----END PGP SIGNATURE-----
--
Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think"
-----BEGIN PGP SIGNATURE-----
iEYEARECAAYFAk5/wdQACgkQA9fEp2eRsU8HiACgj0YYa4Gd87G+2F0IsLek8tV5 p+IAoLobJ2dBZnIvipB6FusJgqJSq3A/ =+vkF -----END PGP SIGNATURE-----
--
Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think"
Speed mailing list Speed@python.org http://mail.python.org/mailman/listinfo/speed
participants (1)
-
Miquel Torres