Fruit size is one of the essential quality traits and influences the economic value of apricots. To explore the underlying mechanisms of the formation of differences in fruit size in apricots, we performed a comparative analysis of anatomical and transcriptomics dynamics during fruit growth and development in two apricot cultivars with contrasting fruit sizes (large-fruit Prunus armeniaca ‘Sungold’ and small-fruit P. sibirica ‘F43’). Our analysis identified that the difference in fruit size was mainly caused by the difference in cell size between the two apricot cultivars. Compared with ‘F43’, the transcriptional programs exhibited significant differences in ‘Sungold’, mainly in the cell expansion period. After analysis, key differentially expressed genes (DEGs) most likely to influence cell size were screened out, including genes involved in auxin signal transduction and cell wall loosening mechanisms. Furthermore, weighted gene co-expression network analysis (WGCNA) revealed that PRE6/bHLH was identified as a hub gene, which interacted with 1 TIR1, 3 AUX/IAAs, 4 SAURs, 3 EXPs, and 1 CEL. Hence, a total of 13 key candidate genes were identified as positive regulators of fruit size in apricots. The results provide new insights into the molecular basis of fruit size control and lay a foundation for future breeding and cultivation of larger fruits in apricot.