[scikit-learn] Continues monitoring of benchmark performances

[Nicolas Hug]

I agree having benchmarks for non regression would be very helpful. A 
seemingly simple change in Cython code can lead to drastic performance drop.

I can't find it back but I think Jérémie has submitted an issue about this?


On 7/22/19 9:59 AM, Tom Augspurger wrote:
> Thanks Adrin,
>
> A month or so ago I started running scikit-learn benchmarks, but I had 
> to disable them since they were taking too long (longer than a day).
> I haven't had time to investigate why, but I assume it was an issue 
> with how I set them up.
>
> Just FYI, I'm planning to include "maintain and improve the benchmark 
> running tools" as part of the pandas' application for the CZI grant.
> All that is in https://github.com/asv-runner (a mix of Ansible, 
> Airflow, and GitHub bots). If anyone is interested in (possibly) 
> having funding
> to work on this, feel free to reach out to me off list and we can 
> discuss things.
>
> Tom
>
> On Mon, Jul 22, 2019 at 8:53 AM Adrin <adrin.jalali at gmail.com 
> <mailto:adrin.jalali at gmail.com>> wrote:
>
>     Hi,
>
>     There is this
>     [page](https://pandas.pydata.org/speed/scikit-learn/) maintained
>     by some of the pandas maintainers (@TomAugspurger in particular),
>     and it seems like a really good idea to have an eye on the
>     performance of different benchmarks through time just in case a PR
>     introduces some major drawbacks.
>
>     However, he doesn't have the bandwidth to maintain it much more,
>     and not really the hardware. I think it'd be a good idea for us to
>     have that, wanted to bring it up and see what you think!
>
>     Cheers,
>     Adrin.
>     _______________________________________________
>     scikit-learn mailing list
>     scikit-learn at python.org <mailto:scikit-learn at python.org>
>     https://mail.python.org/mailman/listinfo/scikit-learn
>
>
> _______________________________________________
> scikit-learn mailing list
> scikit-learn at python.org
> https://mail.python.org/mailman/listinfo/scikit-learn
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/scikit-learn/attachments/20190722/9ca28579/attachment-0001.html>