[scikit-learn] Plot Cross-validated ROCs for multi-class classification problem

Brown J.B. jbbrown at kuhp.kyoto-u.ac.jp
Sat Jul 21 10:02:02 EDT 2018


Hello Makis,

2018-07-20 23:44 GMT+09:00 Andreas Mueller <t3kcit at gmail.com>:

> There is no single roc curve for a 3 class problem. So what do you want to
> plot?
>
> On 07/20/2018 10:40 AM, serafim loukas wrote:
>
> What I want to do is to plot the average(mean) ROC across Folds for a
> 3-class case.
>
>
The prototypical ROC curve uses True Positive Rate and False Positive Rate
for its axes, so it is for 2-class problems, and not for 3+-class problems,
as Andy mentioned.
Perhaps you are wanting the mean and confidence intervals of the n-class
Cohen Kappa metric as estimated by either many folds of cross validation,
or you want to evaluate your classifier by repeated subsampling experiments
and Kappa value distribution/histogram?

Hope this helps,
J.B.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/scikit-learn/attachments/20180721/91a030b9/attachment.html>


More information about the scikit-learn mailing list