Rice, as one of the main food crops, provides a vital source of dietary energy for over half the world’s population. The OsFAD3 gene encodes fatty acid desaturase, catalyzing the conversion of linoleic acid (LA) to alpha-linolenic acid (ALA) in rice. However, the genetic characterization of OsFAD3 and its role in the conversion of LA to ALA remains elusive. Here, we validated the effects of two homologous genes, OsFAD3-1 and OsFAD3-2, on the ALA and LA/ALA ratio in rice grains using near-isogenic lines. Two major haplotypes of OsFAD3-1 are identified with different effects on the ALA and LA/ALA ratio in rice germplasm. High expression of OsFAD3-1 is associated with high ALA accumulation and eating quality of rice grains. Overexpression of OsFAD3-1 driven by a seed-specific promoter increases the ALA content up to 16-fold in the endosperm. A diagnostic marker is designed based on an 8-bp insertion/deletion in the OsFAD3-1 promoter, which can recognize OsFAD3-1 alleles in rice. These results indicate that OsFAD3-1 is a useful target gene in marker-assisted breeding programs to improve varieties with high ALA and appropriate LA/ALA ratio in brown rice.