Title Global Negative Correlation Learning: A Unified Framework for Global Optimization of Ensemble Models.
Authors PERALES GONZÁLEZ, CARLOS, FERNÁNDEZ NAVARRO, FRANCISCO DE ASÍS, CARBONERO RUZ, MARIANO, PÉREZ RODRÍGUEZ, JAVIER
External publication No
Means IEEE Transactions on Neural Networks and Learning Systems
Scope Article
Nature Científica
JCR Quartile 1
SJR Quartile 1
JCR Impact 14.255
SJR Impact 4.222
Web https://www.scopus.com/inward/record.uri?eid=2-s2.0-85100868702&doi=10.1109%2fTNNLS.2021.3055734&partnerID=40&md5=5c0214443fe510fbbed4c42f71af2f27
Publication date 11/02/2021
ISI 000732412000001
Scopus Id 2-s2.0-85100868702
DOI 10.1109/TNNLS.2021.3055734
Abstract Ensembles are a widely implemented approach in the machine learning\n community and their success is traditionally attributed to the diversity\n within the ensemble. Most of these approaches foster diversity in the\n ensemble by data sampling or by modifying the structure of the\n constituent models. Despite this, there is a family of ensemble models\n in which diversity is explicitly promoted in the error function of the\n individuals. The negative correlation learning (NCL) ensemble framework\n is probably the most well-known algorithm within this group of methods.\n This article analyzes NCL and reveals that the framework actually\n minimizes the combination of errors of the individuals of the ensemble\n instead of minimizing the residuals of the final ensemble. We propose a\n novel ensemble framework, named global negative correlation learning\n (GNCL), which focuses on the optimization of the global ensemble instead\n of the individual fitness of its components. An analytical solution for\n the parameters of base regressors based on the NCL framework and the\n global error function proposed is also provided under the assumption of\n fixed basis functions (although the general framework could also be\n instantiated for neural networks with nonfixed basis functions). The\n proposed ensemble framework is evaluated by extensive experiments with\n regression and classification data sets. Comparisons with other\n state-of-the-art ensemble methods confirm that GNCL yields the best\n overall performance.
Keywords Training; Optimization; Correlation; Estimation; Training data; Data models; Learning systems; Ensemble; global optimization; negative correlation learning (NCL)
Universidad Loyola members

Change your preferences Manage cookies