The proposed research utilizes a computational approach to attain a numerical solution for the singularly perturbed delay differential equation (SPDDE) problem arising in the neuronal variability model through artificial neural networks (ANNs) with different solvers. The log-sigmoid function is used to construct the fitness function. The implementation of ANN on SPDDE problems is formulated for different solvers and trained with different weights. The optimization solvers such as the genetic algorithm (GA), sequential quadratic programming (SQP), and pattern search (PS) are hybridized with the active set technique (AST) and the interior-point technique (IPT) and is used to check the accuracy and rapid convergence of the numerical results of the SPDDE model. The numerical outcomes demonstrate that the system is easy to handle and efficient to solve with boundary conditions. Moreover, we used the mean residual error for one hundred runs for each solver to validate the accuracy of the proposed scheme.