Understanding the evolutionary forces in speciation is a central goal in evolutionary biology. Asian cultivated rice has two subspecies, indica and japonica, but the underlying mechanism of the partial reproductive isolation between them remains obscure. Here we show a presence-absence variation (PAV) at the Se locus functions as an indica-japonica reproductive barrier by causing hybrid sterility (HS) in indica-japonica crosses. The locus comprises two adjacent genes: ORF3 encodes a sporophytic pollen killer, whereas ORF4 protects pollen in a gametophytic manner. In F1 of indica-japonica crosses, pollen with the japonica haplotype, which lacks the sequence containing the protective ORF4, is aborted due to the pollen-killing effect of ORF3 from indica. Evolutionary analysis suggests ORF3 is a gene associated with the Asian cultivated rice species complex, and the PAV has contributed to the reproductive isolation between the two subspecies of Asian cultivated rice. Our analyses provide perspectives on rice inter-subspecies post-zygotic isolation, and will promote efforts to overcome reproductive barriers in indica-japonica hybrid rice breeding.