In the traditional shearer-positioning method, an odometer is used to assist the forward velocity correction of the inertial navigation system, but it cannot restrain the system’s error divergence. For this reason, this paper proposes a shearer positioning method based on non-holonomic constraints. In this method, an inertial measurement unit and odometer are installed in the middle of the shearer body and on the traction gear, respectively, the shearer attitude, speed, and position information are calculated through the inertial measurement-unit mechanization, and the shearer’s instantaneous velocity is calculated through the output of the odometer. The mechanization and error transfer process of the inertial navigation system are used to establish a Kalman filtering-state equation. The Kalman filtering observation equation is established through the difference between the projected velocity of the inertial navigation system at the joint and the output velocity of the odometer as the observation vector, and the non-holonomic constraint is introduced. Finally, the error feedback is derived from the results processed by the Kalman filtering algorithm, and the output of the inertial navigation system is corrected to obtain the optimal estimation of the shearer’s attitude, speed and position. The experiment shows that compared with the traditional inertial navigation and odometer combined positioning method, the degree of divergence in the positioning results over time is significantly reduced after adding the non-holonomic constraint. The positioning method has good tracking ability for the trajectory of the shearer. The error of the positioning results in the forward direction is reduced by 66%, the lateral direction is reduced by 62%, and the vertical direction is reduced by 67%.