The formation of multi-pistil flowers reduces the yield and quality in Japanese apricot (Prunus mume). However, the molecular mechanism underlying the formation of multi-pistil flowers remains unknown. In the current study, overexpression of PmKNAT2/6-a, a class I KNOTTED1-like homeobox (KNOX) member, in Arabidopsis (Arabidopsis thaliana) resulted in a multi-pistil phenotype. Analysis of the upstream regulators of PmKNAT2/6-a showed that AGAMOUS-like 24 (PmAGL24) could directly bind to the PmKNAT2/6-a promoter and regulate its expression. PmAGL24 also interacted with Like Heterochromatin Protein 1 (PmLHP1) to recruit lysine trimethylation at position 27 on histone H3 (H3K27me3) to regulate PmKNAT2/6-a expression, which is indirectly involved in multiple pistils formation in Japanese apricot flowers. Our study reveals that the PmAGL24 transcription factor, an upstream regulator of PmKNAT2/6-a, regulates PmKNAT2/6-a expression via direct and indirect pathways and is involved in the formation of multiple pistils in Japanese apricot.