A face recognition system's initial three processes are face detection, feature extraction, and facial expression recognition. The initial step of face detection involves colour model skin colour detection, lighting adjustment to achieve uniformity on the face, and morphological techniques to maintain the necessary face region. To extract facial characteristics such the eyes, nose, and mouth, the output of the first step is employed. Third-step methodology using automated face emotion recognition. This study's goal is to apply the Adaptive Neuro Fuzzy Inference System (ANFIS) algorithm to increase the precision of the current face recognition systems. For the purpose of removing noise and unwanted information from the data sets, independent data sets and a pre-processing technique are built in this study based on color, texture, and shape, to determine the features of the face. The output of the three-feature extraction process is given to the ANFIS model as input. By using our training picture data sets, it has already been trained. This model receives a test image as input, then evaluates the three aspects of the input image, and then recognizes the test image based on correlation. The determination of whether input has been authenticated or not is made using fuzzy logic. The proposed ANFIS method is compared to the existing methods such as Minimum Distance Classifier (MDC), Support Vector Machine (SVM), Case Based Reasoning (CBR) with the following quality measure like error rate, accuracy, precision, recall. Finally, the performance is analyzed by combining all feature extractions with existing classification methods such as MDC, KNN (K-Nearest Neighbour), SVM, ANFIS and CBR. Based on the performance of classification techniques, it is observed that the face detection failures are reduced, such that overall accuracy for CBR is 92% and it is 97% in ANFIS.