Anxiety as an important emotion of individual differences will affect the language performance. There are many researches on learning and test anxiety involving in language skills, while the detailed foreign language vocabulary test remains relatively less. On the basis of anxiety measurement and word spelling test of concrete and abstract word test, this paper attempts to explore the relationship between the foreign language vocabulary anxiety and vocabulary test performance. 100 freshmen major in English participated in the experiment. Vocabulary test anxiety turns out to be a little higher among English majors and exerts a significant influence on the test performance. There are different test performances and anxiety levels in the concrete and abstract word tests. All these above implicate that both language instructors and learners cannot ignore the common vocabulary test anxiety. On the one hand, they can build up language learners' confidence and self-evaluation. On the other hand, the reduction of vocabulary test anxiety can be practiced through the way of setting up images of words.