Text Value and Linguistic Characterization in Chinese Language Literature Based on Text Mining Techniques

Abstract

This study applies text mining techniques to deeply analyze Chinese language and literature’s text value and linguistic features. The study adopts the methods of textual disambiguation, vector space modeling, semantic network and Labeled-LDA model. Taking the novels of Yu Hua and Ge Fei as an example, it reveals the differences between the two writers in linguistic features such as using punctuation, average word length, and sentence discrete degree. The study provides a comprehensive heat score for the novels based on three dimensions: reading base group, reading gain, and reading discussion. The results show that the frequency of period use in Yu Hua’s works is decentralized, while Ge Fei’s works are more concentrated. Ge Fei’s average word length is slightly higher, showing a tendency to use multi-syllabic words. The novel popularity and heat scores conform to a power law distribution, reflecting the Pareto rule that 80% of the popularity is concentrated on 20% of the hot novels. This study provides a new perspective on Chinese language and literature through the application of text mining technology, and its methods and tools can effectively enhance the effectiveness and efficiency of teaching.