Understanding the regulation of autotetraploid sterility is essential for harnessing the strong advantages in genomic buffer capacity, biodiversity, and heterosis of autotetraploid rice. miRNAs play crucial roles in fertility regulation, yet information about their reproductive roles and target genes in tetraploid rice remains limited. Here, we used three tetraploid lines, H1 (fertile), HF (fertile), and LF (sterile), to investigate cytological features and identify factors associated with autotetraploid sterility. LF showed abnormal meiosis, resulting in low pollen fertility and viability, ultimately leading to scarce fertilization and a low-seed setting compared to H1 and HF. RNA-seq revealed 30 miRNA-candidate target pairs related to autotetraploid pollen sterility. These pairs showed opposite expression patterns, with differential expression between fertile lines (H1 and HF) and the sterile line (LF). qRT-PCR confirmed that miR9564, miR528, and miR27874 were highly expressed in the anthers of H1 and HF but not in LF, while opposite results were obtained in their targets (ARPS, M2T, and OsRPC53). Haplotype and expression pattern analyses revealed that ARPS was specifically expressed in lines with the same haplotype of MIR9564 (the precursor of miR9564) as LF. Furthermore, the Dual-GFP assay verified that miR9564 inhibited the fluorescence signal of ARPS-GFP. The over-expression of ARPS significantly decreased the seed setting rate (59.10%) and pollen fertility (50.44%) of neo-tetraploid rice, suggesting that ARPS plays important roles in autotetraploid pollen sterility. This study provides insights into the cytological characteristic and miRNA expression profiles of tetraploid lines with different fertility, shedding light on the role of miRNAs in polyploid rice.