Music rhythm detection and tracking is an important part of music understanding system and music visualization system. Based on the important position of rhythm in music expression and the wide range of multimedia applications, rhythm extraction has become an important hotspot in computer music analysis. In the field of audio recognition research, deep learning can automatically learn the features of audio and extract the rhythm of music. This paper takes music audio rhythm recognition as the main research object and carries out a series of researches with deep learning GRU neural network as the main technical support. A residual network is introduced into the GRU network model, and it is found that when the residual network is at 50 layers, the model has the highest accuracy for audio rhythm extraction. After adjusting the model parameters through experiments, this paper concludes that the average recognition accuracy of the ResNet_50-GRU model for recognizing the rhythm of the music audio in the MSD, AudioSet, and FMA data sets is 92.5%.