Cereal cyst nematodes (CCNs) lead to major losses in the cereal crop industry worldwide and have been reported in many provinces of China. However, this plant nematode’s distribution and genetic differences are not fully understood. In the present study, 821 soil and host root samples were collected from 16 provinces in 2019–2022 to investigate the distribution of the CCNs. Heterodera avenae was detected in 56.39% of the total samples, primarily in Hubei, Henan, Hebei, Shandong, Shanxi, Gansu, Beijing, Tianjin, Inner Mongolia, Ningxia, Xinjiang, Qinghai, Anhui, Shaanxi, and Jiangsu. H. filipjevi was present in 21 samples, with a detection rate of 2.60%, and it was found mainly in Henan, Anhui, Jiangsu, Shandong, Shanxi, and Qinghai. A phylogenetic analysis of the internal transcribed spacer (ITS) region of the rRNA gene indicated that significant evolutionary and genetic differences existed between the Chinese populations and populations from other countries. Our results indicate that ITS1 can be used as a phylogenetic analysis and genetic target for H. avenae populations. The haplotypes of the ITS1 sequences of H. avenae populations from 14 countries were analyzed, and we speculate that H. avenae originated in a Middle East hotspot, then spread westwards to Europe and the United States and eastwards to China and Australia. Genetic differences between Asian and European populations suggest that the Himalayas and Kunlun Mountains formed a barrier that resulted in the formation of a separate evolutionary group in China. The phylogenetic and haplotype analysis results from different hosts showed significant differences among populations isolated from different hosts, and those isolated from weeds were distinct from those from other hosts, indicating that the rich genetic diversity of H. avenae populations is related to the large number of available hosts. Above all, geographic barriers, time of origin, and host adaptation might explain the current known distribution patterns of Chinese H. avenae populations.