The prevention of fertilization through self-pollination (or pollination by a close relative) in the Brassicaceae plant family is determined by the genotype of the plant at the self-incompatibility locus (S locus). The many alleles at this locus exhibit a dominance hierarchy that determines which of the two allelic specificities of a heterozygous genotype is expressed at the phenotypic level. Here, we uncover the evolution of how at least 17 small RNA (sRNA)-producing loci and their multiple target sites collectively control the dominance hierarchy among alleles within the gene controlling the pollen S-locus phenotype in a self-incompatible Arabidopsis species. Selection has created a dynamic repertoire of sRNA-target interactions by jointly acting on sRNA genes and their target sites, which has resulted in a complex system of regulation among alleles.