Feature sets in a machine learning algorithm can have an impact on the robustness, interpretability, and characterization of the data. To detect age-related changes, traditional linear methods for analyzing center of pressure (COP) signals offer limited insight into the complex nonlinear dynamics of postural control. To overcome this limitation, a novel approach that combines a partial least squares-discriminant analysis (PLS-DA) classifier with the nonlinear dynamics of COP time series was proposed. Three small feature sets were compared: time-domain features alone, entropy-based features alone, and a hybrid approach incorporating both types of features. The performance of the PLS-DA model was assessed in four different eyes and surface conditions by using the accuracy, sensitivity, selectivity, precision metrics, and ROC curves. The results indicated that the PLS-DA model utilizing the hybrid feature set achieved significantly higher accuracy than the time-domain and entropy-based feature sets. The best classification performance was observed when the eyes were open on a compliant surface, with an overall accuracy of 89% for training and 88% for cross-validation. For the old group, while the results indicated 93% sensitivity, 94% specificity, and 93% precision in the training, the results revealed 88% sensitivity, 93% specificity, and 91% precision in cross-validation. Notably, the hybrid feature set yielded an AUC value of 0.96, indicating a superior performance. This study emphasizes the robust classification capabilities of PLS-DA for age-related postural changes and highlights the effectiveness of utilizing a small hybrid feature set to improve classification accuracy and reliability.