With the progress of society and the rapid development of computer technology, rumors arise on social media, which seriously affects the social economy. How to detect rumors accurately and rapidly has become one hot research topic. In this paper, a new early rumor detection model is proposed. The aim of this model is to increase the efficiency and the accuracy of rumor detection simultaneously. Specifically, in this model, the input data is firstly refined through account filtering and data standardization, then the BiGRU is used to consider the context relationship, and a reinforcement learning algorithm is applied to detection. Experimental results show that compared with other early rumor detection models (e.g., checkpoints), the accuracy of the proposed model is improved by 0.5% with the same speed, which testifies the effectiveness of this model.