Many Chinese students begin to learn English as a main subject in primary schools. They focus on the written English while ignore the oral part, because a long-term exploration of traditional teaching makes them believe that test paper score is the ultimate goal. Students have few opportunities to practice their oral English. The situation leads to stagnant, even receded, oral English skills. Therefore, it is a challenge that how to help students to develop their oral English. This paper aims to analyze this situation and put forward some suggestions. The findings reveal that three factors affect oral English: Mother-tongue Interference, Discouraged Atmosphere and Unsatisfying Teacher Qualification. For most Chinese learners, native language will influence their oral English unconsciously in terms of segmental and suprasegmental aspects. Discouraged Atmosphere including the neglect of education system, insufficient education fund and tense relationship between teachers and students are also urgent problems. Furthermore, the average teachers' quality is low, especially in rural areas. For these situations, recommendations are provided in this paper. Firstly, it is important to create a real English environment for learners and it is an effective way to improve learners' oral ability by encouraging them to practice oral expression and imitate native speakers' tone. Secondly, schools should carry out preservice training programs for teachers and teachers should look for high-quality educational resources online to improve their levels. Thirdly, the teaching system should be reformed, including putting the oral English in the formal examinations to stimulate learners' learning motivation.