Input reduction in human sensation modeling using independent component analysis

Lee, K.K.; Xu, Yangsheng

doi:10.1109/iros.2001.976343

Cited by 3 publications

(1 citation statement)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This feature space can then be used for map reconstruction for predicting the response or to train a statistical rule for classification if the response variable Y q i is treated as a target classification variable. Jain [3], Stoica [4], Blum [5], Guyon [6], and Molina [7] present a comprehensive survey of feature selection and extraction techniques that include principal component analysis (PCA) [8], [9], linear discriminant analysis (LDA) [10], support vector machines (SVM) [11], [12], [13], [14], self-organizing maps (SOM) [15], [16], projection pursuit [17], [18], independent compo- [19], [20], [21], and other informationtheoretic techniques [22], [23], [24], [25].…”

Section: Introductionmentioning

confidence: 99%

Information-Theoretic Feature Selection for Classification

Joshi

James

Meckl

et al. 2007

2007 American Control Conference

View full text Add to dashboard Cite

Feature selection has always been an important aspect of statistical model identification and pattern classification. In this paper we introduce a novel information-theoretic index called the compensated quality factor (CQF) which selects the important features from a large amount of irrelevant data. The proposed index does an exhaustive combinatorial search of the input space and selects the feature that maximizes the information criterion conditioned on the decision rules defined by the compensated quality factor. The effectiveness of the proposed CQF-based algorithm was tested against the results of Mallows C p criterion, Akaike information criterion (AIC), and Bayesian information criterion (BIC) using post liver operation survival data [1] (continuous variables) and NIST sonoluminescent light intensity data [2] (categorical variables). Due to computational time and memory constraints, the CQF-based feature selector is only recommended for an input space with dimension p < 20. The problem of higher dimensional input spaces (20 < p < 50) was solved by proposing an information-theoretic stepwise selection procedure. Though this procedure does not guarantee a globally optimal solution, the computational timememory requirements are reduced drastically compared to the exhaustive combinatorial search. Using diesel engine data for fault detection (43 variables, 8-classes, 30000 records), the performance of the information-theoretic selection technique was tested by comparing the misclassification rates before and after the dimension reduction using various classifiers.

show abstract