[scikit-learn] Continues monitoring of benchmark performances

[Joel Nothman]

Isn't Jérémie's project at
https://github.com/jeremiedbb/scikit-learn_benchmarks meant to be doing
this? What's its status? How does it relate to Tom's work?

(Can we please take http://scikit-learn.org/ml-benchmarks/ offline?)

On Tue, 23 Jul 2019 at 00:17, Nicolas Hug <niourf at gmail.com> wrote:

> I agree having benchmarks for non regression would be very helpful. A
> seemingly simple change in Cython code can lead to drastic performance drop.
>
> I can't find it back but I think Jérémie has submitted an issue about this?
>
> On 7/22/19 9:59 AM, Tom Augspurger wrote:
>
> Thanks Adrin,
>
> A month or so ago I started running scikit-learn benchmarks, but I had to
> disable them since they were taking too long (longer than a day).
> I haven't had time to investigate why, but I assume it was an issue with
> how I set them up.
>
> Just FYI, I'm planning to include "maintain and improve the benchmark
> running tools" as part of the pandas' application for the CZI grant.
> All that is in https://github.com/asv-runner (a mix of Ansible, Airflow,
> and GitHub bots). If anyone is interested in (possibly) having funding
> to work on this, feel free to reach out to me off list and we can discuss
> things.
>
> Tom
>
> On Mon, Jul 22, 2019 at 8:53 AM Adrin <adrin.jalali at gmail.com> wrote:
>
>> Hi,
>>
>> There is this [page](https://pandas.pydata.org/speed/scikit-learn/)
>> maintained by some of the pandas maintainers (@TomAugspurger in
>> particular), and it seems like a really good idea to have an eye on the
>> performance of different benchmarks through time just in case a PR
>> introduces some major drawbacks.
>>
>> However, he doesn't have the bandwidth to maintain it much more, and not
>> really the hardware. I think it'd be a good idea for us to have that,
>> wanted to bring it up and see what you think!
>>
>> Cheers,
>> Adrin.
>> _______________________________________________
>> scikit-learn mailing list
>> scikit-learn at python.org
>> https://mail.python.org/mailman/listinfo/scikit-learn
>>
>
> _______________________________________________
> scikit-learn mailing listscikit-learn at python.orghttps://mail.python.org/mailman/listinfo/scikit-learn
>
> _______________________________________________
> scikit-learn mailing list
> scikit-learn at python.org
> https://mail.python.org/mailman/listinfo/scikit-learn
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/scikit-learn/attachments/20190723/71ad3b04/attachment.html>