The accuracy of action detection is limited by the extracted action, and there are problems of high processing complexity and low efficiency. Therefore, a three-dimensional visual detection method of martial art wrong action based on RBF is proposed. After noise reduction and weighting processing of martial art action video images, a martial art action 3D visual transformation model is established. According to the 3D visual model, C3D features are used to represent martial art actions. The video is segmented using sparse coding to determine the detection range. RBF neural network model is established, and the combination of the above 3D visual model and network parameters is obtained by sample training to detect martial art wrong actions. The test method of the experimental results shows the detection of the research under the condition of different degrees of precision, an average of at least 5%, and the method of detection of high efficiency and stability.