ReGEC_L1
A generalized eigenvalues classifier with embedded feature selection. Supervised classification is one of the most used methods in machine learning. In case of data characterized by a large number of features, a critical issue is to deal with redundant or irrelevant information. To this extent, an effective algorithm needs to identify a suitable subset of features, as small as possible, for the classification. In this work we present ReGEC_L1, a classifier with embedded feature selection based on the Regularized Generalized Eigenvalue Classifier (ReGEC) and equipped with a L1-norm regularization term. We detail the mathematical formulation and the numerical algorithm. Numerical results, obtained on some de facto standard benchmark data sets, show that the approach we propose produces a remarkable selection of the features, without losing accuracy in the classification. In that respect, our algorithm seems to compare favorably with the SVM_L1 method. A MATLAB implementation of ReGEC_L1 is available at url{http://www.na.icar.cnr.it/ mariog/regec_l1.html}.
Keywords for this software
References in zbMATH (referenced in 4 articles )
Showing results 1 to 4 of 4.
Sorted by year (- Mehmanchi, Erfan; Gómez, Andrés; Prokopyev, Oleg A.: Solving a class of feature selection problems via fractional 0--1 programming (2021)
- Cheng, Yawen; Yin, Hang; Ye, Qiaolin; Huang, Peng; Fu, Liyong; Yang, Zhangjing; Tian, Yuan: Improved multi-view GEPSVM via inter-view difference maximization and intra-view agreement minimization (2020)
- Viola, Marco; Sangiovanni, Mara; Toraldo, Gerardo; Guarracino, Mario R.: Semi-supervised generalized eigenvalues classification (2019)
- Viola, Marco; Sangiovanni, Mara; Toraldo, Gerardo; Guarracino, Mario R.: A generalized eigenvalues classifier with embedded feature selection (2017)