Título A dynamic over-sampling procedure based on sensitivity for multi-class problems
Autores FERNÁNDEZ NAVARRO, FRANCISCO DE ASÍS, Hervas-Martinez, Cesar , Antonio Gutierrez, Pedro
Publicación externa Si
Medio Pattern Recogn.
Alcance Article
Naturaleza Científica
Cuartil JCR 1
Cuartil SJR 1
Impacto JCR 2.29200
Impacto SJR 1.17100
Fecha de publicacion 01/08/2011
ISI 000290054200022
DOI 10.1016/j.patcog.2011.02.019
Abstract Classification with imbalanced datasets supposes a new challenge for researches in the framework of machine learning. This problem appears when the number of patterns that represents one of the classes of the dataset (usually the concept of interest) is much lower than in the remaining classes. Thus, the learning model must be adapted to this situation, which is very common in real applications. In this paper, a dynamic over-sampling procedure is proposed for improving the classification of imbalanced datasets with more than two classes. This procedure is incorporated into a memetic algorithm (MA) that optimizes radial basis functions neural networks (RBFNNs). To handle class imbalance, the training data are resampled in two stages. In the first stage, an over-sampling procedure is applied to the minority class to balance in part the size of the classes. Then, the MA is run and the data are over-sampled in different generations of the evolution, generating new patterns of the minimum sensitivity class (the class with the worst accuracy for the best RBFNN of the population). The methodology proposed is tested using 13 imbalanced benchmark classification datasets from well-known machine learning problems and one complex problem of microbial growth. It is compared to other neural network methods specifically designed for handling imbalanced data. These methods include different over-sampling procedures in the preprocessing stage, a threshold-moving method where the output threshold is moved toward inexpensive classes and ensembles approaches combining the models obtained with these techniques. The results show that our proposal is able to improve the sensitivity in the generalization set and obtains both a high accuracy level and a good classification level for each class. (C) 2011 Elsevier Ltd. All rights reserved.
Palabras clave Classification; Multi-class; Sensitivity; Accuracy; Memetic algorithm; Imbalanced datasets; Over-sampling method; SMOTE
Miembros de la Universidad Loyola

Change your preferences Gestionar cookies