Nowadays, data dimensions have increased depending on the developments in the information and measurement technologies. Due to the high dimensionality, it is necessary to use pre-analysis data reduction methods for many analyzes such as classification and regression analysis. In the solution of high dimensionality, filter feature selection methods based on statistical criteria are widely used in terms of simplicity and efficiency. One of the important problems with filter feature selection methods is to select multiple features carrying the same information unnecessarily when strong correlations exist between features. In this study, a novel approach is proposed to solve this problem of the filter feature selection methods. In addition, with the proposed new approach, the question of how many appropriate features will be is also solved. The performance of the proposed approach is demonstrated on high-dimensional reflectance data having high correlations between features. The obtained results revealed that the proposed approach improves the classification performance of filter feature selection methods in mixture discriminant analysis in terms of classification accuracy and entropy criteria.