The Multiclass ROC Front method for cost-sensitive classification

The Multiclass ROC Front method for cost-sensitive classification

Bernard, Simon and Chatelain, Clément and Adam, Sébastien and Sabourin, Robert

Pattern Recognition 2016

Abstract : This paper addresses the problem of learning a multiclass classification system that can suit to any environment. By that we mean that particular (imbalanced) misclassification costs are taken into account by the classifier for predictions. However, these costs are not well known during the learning phase in most cases, or may evolve afterwards. There is a need in that case to learn a classifier that can potentially suit to any of these costs in prediction phase. The learning method proposed in this work, named the Multiclass ROC Front (MROCF) method, responds to this issue by exploiting ROC-based tools through a multiobjective optimization process. While this type of ROC-based multiobjective optimization approach has been successfully used for two-class problems, it has never been proposed in real-world multiclass classification problems. Experiments led on several real-world datasets show that the MROCF method offers a major improvement over a cost-insensitive classifier and is competitive with the state-of-the-art cost-sensitive optimization method on all but one of the 20 datasets.