A novel numerical algorithm is proposed for solving a coefficient inverse problem of a singularly perturbed reaction-diffusion equation with the final time observation data. Firstly, for the discretization scheme of the direct problem, the barycentric form rational spectral approach based on the sinh transformation is used to discretize the space derivative and the Crank-Nicolson finite difference scheme is utilized to approximate the time derivative. For the construction of inverse problem, we design a new fitness function about the reaction coefficient. Then integrating optimal neighborhood search strategy, random opposition based learning strategy and adaptive predator presence probability strategy, an improved squirrel search algorithm named NOISSA is proposed. Finally, 9 benchmark test functions are used to validate the performance of our proposed NOISSA. Moreover, numerical experiments are carried out to illustrate the advantage of our new algorithm in solving the coefficient inverse problems of singularly perturbed reaction-diffusion problems.