Recognizing human actions to control the robot has become a challenging task. This paper provides a manipulator control system based on a mobile platform. The bending Angle of the specific connecting rod mechanism is collected to obtain the bending degree of the finger. The nine-axis gyroscope is used to detect the attitudes of the hand and the arm, and the data is transmitted to the HT32F5352 control board. Experimental results show that intelligent robots based on motion sensing can be equipped with automatic and manual control, environmental detection, and other functions.