NOEMON: Design, implementation and performance results of an intelligent assistant for classifier selection. he selection of an appropriate classification model and algorithm is crucial for effective knowledge discovery on a dataset. For large databases, common in data mining, such a selection is necessary, because the cost of invoking all alternative classifiers is prohibitive. This selection task is impeded by two factors. First, there are many performance criteria, and the behaviour of a classifier varies considerably with them. Second, a classifier’s performance is strongly affected by the characteristics of the dataset. Classifier selection implies mastering a lot of background information on the dataset, the models and the algorithms in question. An intelligent assistant can reduce this effort by inducing helpful suggestions from background information. In this study, we present such an assistant, NOEMON. For each registered classifier, NOEMON measures its performance for a collection of datasets. Rules are induced from those measurements and accommodated in a knowledge base. The suggestion on the most appropriate classifier(s) for a dataset is then based on those rules. Results on the performance of an initial prototype are also given.
Keywords for this software
References in zbMATH (referenced in 10 articles , 1 standard article )
Showing results 1 to 10 of 10.
- Madzarov, Gjorgji; Gjorgjevikj, Dejan; Chorbev, Ivan: A multi-class SVM classifier utilizing binary decision tree (2009)
- Prud^encio, Ricardo B.C.; Ludermir, Teresa B.: Selective generation of training examples in active meta-learning (2008)
- Kalousis, Alexandros; Gama, João; Hilario, Melanie: On data and algorithms: Understanding inductive performance (2004)
- Brazdil, Pavel B.; Soares, Carlos; Pinto da Costa, Joaquim: Ranking learning algorithms: Using IBL and meta-learning on accuracy and time results (2003)
- Ho, Tu Bao; Nguyen, Trong Dung; Shimodaira, Hiroshi; Kimura, Masayuki: A knowledge discovery system with support for model selection and visualization (2003)
- Prud^encio, Ricardo B. C.; Ludermir, Teresa B.: Selecting and ranking time series models using the NOEMON approach (2003)
- Bensusan, Hilan; Kalousis, Alexandros: Estimating the predictive accuracy of a classifier (2001)
- Hand, D.J.: Measuring diagnostic accuracy of statistical prediction rules. (2001)
- Kalousis, Alexandros; Hilario, Melanie: Feature selection for meta-learning (2001)
- Kalousis, Alexandros; Theoharis, Theoharis: NOEMON: Design, implementation and performance results of an intelligent assistant for classifier selection. (1999)