Nowadays, the emphasis of domestic oral English teaching is on grammar and pronunciation. Although many achievements have been made and theories have been established in this field, there are still some deficiencies in such traditional methodologies. Because of the lack of corresponding technologies and practices, few explorations have been made in how to make communication more effective and accurate by both verbal and nonverbal means such as facial expressions and gestures. It is not difficult to understand why the Chinese learners give native speakers the expression that they are dull and uninterested. For the aforementioned problems, in this paper, characterizing a combination of the latest biometric technology (recognition of voices, facial expressions and body movements) and Kinect, an interactive oral English training platform is designed. This platform targets training students' not only verbal but also nonverbal language abilities including pronunciation, intonation, especially facial expressions, body languages. With the evaluation of the practical application of the platform, it proves to be an effective way of improving their overall oral English abilities.