Kenaf (Hibiscus cannabinus L.), in the Malvaceae family, is an important crop for not only fiber production, but also various other industrial materials. We performed phylogenetic analysis and a genome-wide association study (GWAS) of seven agronomic traits: days to flowering, plant height, fresh weight, dry weight, flower color, stem color, and leaf shape, using 96 kenaf genotypes, including gamma-irradiation-derived mutant lines. Genotypes were determined by genotyping-by-sequencing (GBS) and a total of 49,241 single-nucleotide polymorphisms (SNPs) were used in the analysis. Days to flowering, plant height, fresh weight, and dry weight were positively correlated with each other, and stem color was also correlated with fresh weight and dry weight. The phylogenetic analysis divided the 96 lines into nine related groups within two independent groups, and the GWAS analysis detected a total of 49 SNPs for days to flowering, plant height, fresh weight, dry weight, flower color, stem color, and leaf shape with −log10(P) ≥ 4, of which 22 were located in genic regions. The detected SNPs were located in genes with homology ranging from 45% to 96% to plants of the Malvaceae and Betulaceae, and these genes were found to be involved in plant growth and development via various pathways. Our identification of SNP markers related to agronomic traits is expected to help improve the quality of selective breeding programs for kenaf.