Title Class Switching Ensembles for Ordinal Regression
Authors Antonio Gutierrez, Pedro , PÉREZ ORTIZ, MARÍA, Suarez, Alberto
External publication No
Means Lecture Notes in Computer Science
Scope Proceedings Paper
Nature Científica
JCR Quartile 4
SJR Quartile 2
SJR Impact 0.295
Web https://www.scopus.com/inward/record.uri?eid=2-s2.0-85020530016&doi=10.1007%2f978-3-319-59153-7_36&partnerID=40&md5=65dae5f374437cd0a6d6e33206f84088
Publication date 01/01/2017
ISI 000443108200036
Scopus Id 2-s2.0-85020530016
DOI 10.1007/978-3-319-59153-7_36
Abstract The term ordinal regression refers to classification tasks in which the categories have a natural ordering. The main premise of this learning paradigm is that the ordering can be exploited to generate more accurate predictors. The goal of this work is to design class switching ensembles that take into account such ordering so that they are more accurate in ordinal regression problems. In standard (nominal) class switching ensembles, diversity among the members of the ensemble is induced by injecting noise in the class labels of the training instances. Assuming that the classes are interchangeable, the labels are modified at random. In ordinal class switching, the ordering between classes is taken into account by reducing the transition probabilities to classes that are further apart. In this manner smaller label perturbations in the ordinal scale are favoured. Two different specifications of these transition probabilities are considered; namely, an arithmetic and a geometric decrease with the absolute difference of the class ranks. These types of ordinal class switching ensembles are compared with an ensemble method that does not consider class-switching, a nominal class-switching ensemble, an ordinal variant of boosting, and two state-of-the-art ordinal classifiers based on support vector machines and Gaussian processes, respectively. These methods are evaluated and compared in a total of 15 datasets, using three different performance metrics. From the results of this evaluation one concludes that ordinal class-switching ensembles are more accurate than standard class-switching ones and than the ordinal ensemble method considered. Furthermore, their performance is comparable to the state-of-the-art ordinal regression methods considered in the analysis. Thus, class switching ensembles with specifically designed transition probabilities, which take into account the relationships between classes, are shown to provide very accurate predictions in ordinal regression problems.
Keywords Class switching; Ordinal regression; Ensemble learning
Universidad Loyola members

Change your preferences Manage cookies