Granule-bound starch synthase 2 (GBSSII), a paralogous isoform of GBSSI, carries out amylose biosynthesis in rice. Unlike GBSSI, it mainly functions in transient organs, such as leaves. Despite many reports on the starch gene family, little is known about the genetics and genomics of GBSSII. Haplotype analysis was conducted to unveil genetic variations (SNPs and InDels) of GBSSII (OS07G0412100) and it was also performed to gain evolutionary insight through genetic diversity, population genetic structure, and phylogenetic analyses using the KRICE_CORE set (475 rice accessions). Thirty nonsynonymous SNPs (nsSNPs) were detected across the diverse GBSSII coding regions, representing 38 haplotypes, including 13 cultivated, 21 wild, and 4 mixed (a combination of cultivated and wild) varieties. The cultivated haplotypes (C_1–C_13) contained more nsSNPs across the GBSSII genomic region than the wild varieties. Nucleotide diversity analysis highlighted the higher diversity values of the cultivated varieties (weedy = 0.0102, landrace = 0.0093, and bred = 0.0066) than the wild group (0.0045). The cultivated varieties exhibited no reduction in diversity during domestication. Diversity reduction in the japonica and the wild groups was evidenced by the negative Tajima’s D values under purifying selection, suggesting the domestication signatures of GBSSII; however, balancing selection was indicated by positive Tajima’s D values in indica. Principal component analysis and population genetics analyses estimated the ambiguous evolutionary relationships among the cultivated and wild rice groups, indicating highly diverse structural features of the rice accessions within the GBSSII genomic region. FST analysis differentiated most of the classified populations in a range of greater FST values. Our findings provide evolutionary insights into GBSSII and, consequently, a molecular breeding program can be implemented for select desired traits using these diverse nonsynonymous (functional) alleles.