This paper focuses on the design of badminton robots, and designs high-precision binocular stereo vision synchronous acquisition system hardware and multithreaded acquisition programs to ensure the left and right camera exposure synchronization and timely reading of data. Aiming at specific weak moving targets, a shape-based Brown motion model based on dynamic threshold adjustment based on singular value decomposition is proposed, and a discriminative threshold is set according to the similarity between the background and the foreground to improve detection accuracy. The three-dimensional trajectory points are extended by Kalman filter and the kinematics equation of badminton is established. The parameters of the kinematics equation of badminton are solved by the method of least squares. Based on the fractal Brownian motion algorithm, a real-time robot pose estimation algorithm is proposed to realize the real-time accurate pose estimation of the robot. A PID control model for the badminton robot executive mechanism is established between the omnidirectional wheel speed and the robot’s translation and rotation movements to achieve the precise movement of the badminton robot. All the algorithms can meet the system’s requirements for real-time performance, realize the badminton robot’s simple hit to the ball, and prospect the future research direction.