Idesia polycarpa Maxim is a high-value species of fruit oil with edible, abundant linoleic acid and polyphenols. Idesia polycarpa is described as a dioecious species, and the flowers are male; female and bisexual flowers are produced on separate plants. In order to explore the flower types of Idesia polycarpa, the morphology of its flowers and inflorescence were investigated in this study. The flower and inflorescence types, the diameter, and the flowering sequencing in male and female inflorescence were determined. We also detected the length, width, and fresh weight of leaves, shoots, and female inflorescence, as well as the length and fresh weight of the petiole during the development. Additionally, we compared the length, width, the length/width ratio, and the flowering density between 5- and 7-year-old female trees. The phenological period observation of Idesia polycarpa showed that the development process can be roughly divided into 12 stages, including bud burst, leaf expansion, inflorescence growth, initial flowering, full flowering, flower decline, initial fruiting, fruit enlargement, fruit color change, fruit ripening, post-ripening of fruit, and leaf fall periods. Furthermore, four elites’ fruit determined the oil content and the composition of fatty acid content during the development. The dynamic of fatty acids contents, the palrnitic acid, palmitoleic acid, stearic acid, oleic acid, and linolenic acid contents were detected during the fruit development of four elites. Moreover, the mineral elements content of fruit of four elites during development were determined. The patterns of vegetative and reproductive growth in young dioecious trees of Idesia polycarpa provided the theoretical basis for artificial pruning and training.