The efficient solution of the time-varying quaternion matrix inverse (TVQ-INV) is a challenging but crucial topic due to the significance of quaternions in many disciplines, including physics, engineering, and computer science. The main goal of this research is to employ the higher-order zeroing neural network (HZNN) strategy to address the TVQ-INV problem. HZNN is a family of zeroing neural network models that correlates to the hyperpower family of iterative methods with adjustable convergence order. Particularly, three novel HZNN models are created in order to solve the TVQ-INV both directly in the quaternion domain and indirectly in the complex and real domains. The noise-handling version of these models is also presented, and the performance of these models under various types of noises is theoretically and numerically tested. The effectiveness and practicality of these models are further supported by their use in robotic motion tracking. According to the principal results, each of these six models can solve the TVQ-INV effectively, and the HZNN strategy offers a faster convergence rate than the conventional zeroing neural network strategy.