The Honghe Hani Rice Terraces System (HHRTS) of Yunnan Province is an important agricultural and cultural heritage landscape. Until now, a large number of local rice landraces have been planted. Mining excellent genes contained in these landraces provides a reference for variety improvement and new variety breeding. In this study, 96 rice landraces collected from the Hani terraces were planted in Honghe Mengzi, Yunnan Province, in 2013, 2014, 2015, and 2021, and five major grain traits were measured and analyzed. The genomic variation of 96 rice landraces was scanned by 201 simple sequence repeat (SSR) markers. The genetic diversity, population structure, and genetic relationships of the natural population were analyzed. The mixed linear model (MLM) method of the TASSEL software was used to analyze the associations between markers and traits. A total of 936 alleles were amplified by 201 pairs of SSR primers. The average number of observed alleles (Na), the effective number of alleles (Ne), Shannon’s information index (I), heterozygosity (H), and the polymorphism information content (PIC) per marker were 4.66, 2.71, 1.08, 0.15, and 0.55, respectively. Ninety-six landraces were divided into two groups by population structure, clustering, and principal component analysis, and indica rice was the main group. The coefficients of variation of the five traits ranged from 6.80 to 15.24%, and their broad heritabilities were more than 70%. In addition, there were positive correlations among the same grain traits between different years. Through MLM analysis, 2, 36, 7, 7, and 4 SSR markers were significantly associated with grain length (GL), grain width (GW), grain thickness (GT), grain length–width ratio (LWR), and thousand-grain weight (TGW), respectively. The explanation rates of phenotypic variation were 16.31 (RM449, Chr. 1)—23.51% (RM316, Chr. 9), 10.84 (RM523, Chr. 3; RM161/RM305, Chr. 5)—43.01% (RM5496, Chr. 1), 11.98 (RM161/RM305, Chr. 5)—24.72% (RM275, Chr. 6), 12.68 (RM126, Chr. 8)—36.96% (RM5496, Chr. 1), and 17.65 (RM4499, Chr. 2)—26.32% (RM25, Chr. 8), respectively. The associated markers were distributed on 12 chromosomes of the genome.