The shaking table has been used extensively in the structure test field to verify the structure's performance against various vibrations, for example earthquakes. In order to replicate the vibrations, which are measured by the acceleration signal, the model of the shaking table should be thoroughly constructed to design the controller. However, parametric uncertainty and strong nonlinearity, such as the nonlinear friction, make it an obstacle to obtaining an accurate model. A neural network-based controller, specifically a long short-term memory neural network-based neural network controller, is designed in this paper to address this issue. The nonlinear systems are estimated by the neural network's universal approximation characteristics, and a long short-term memory neural network is utilized to optimize the time-series-related errors. Furthermore, a robust sliding mode controller is utilized to compensate for the residual error of the neural network and other uncertainties. The semi-global asymptotic stability of the controller is proved by Lyapunov analysis. Comparative experimental results indicate the superiority of the proposed controller.