Face recognition is an emerging research area in biometric identification systems, which attracted many researchers in pattern recognition and computer vision. Since, the human facial images are high dimensional in nature, so a new optimization algorithm was proposed in this paper to reduce the dimension of facial images. At first, the input facial images were collected from ORL, YALE, and FAce Semantic SEGmentation (FASSEG) databases. Then, feature extraction was then performed by using Local Ternary Pattern (LTP) and Binary Robust Invariant Scalable Key points (BRISK) to extract the features from the face images. In addition, an enhanced fire-fly optimizer was used to reject the irrelevant features or to reduce the dimension of the extracted features. In enhanced fire-fly optimization algorithm, Chi square distance measure was used to find the distance between the fire-flies and also it uses only a limited number of feature values for representing the data that effectively reduces the "curse of dimensionality" concern. Finally, Deep Belief Network (DBN) was used to classify the individual's facial images. The experimental outcome showed that the proposed work improved recognition accuracy up to 7-20% compared to the existing work.