an increase in data size, number of classes, dimension of the feature space and interclass separability in any pattern classification task, affect the performance of any classifier. It is essential to know the effect of the training dataset size on the recognition performance of a feature extraction method and classifier. In this paper, an attempt is made to measure the performance of the classifier by testing the classifier with two different datasets of different sizes. A desirable recognition performance can be achieved by data fusion in any practical classification applications, if the number of classes and multiple feature sets for pattern samples are given. A framework for feature selection and feature fusion has been proposed in this paper to increase the performance of classification. From the experimental results it is seen that there is an increase of 13.20% in the recognition accuracy.