To improve the storage quality of adzuki bean paste from starch aging, the effects of glycolipid addition on the properties of gelatinization and retrogradation properties of adzuki flour obtained by the retrogradation inside adzuki bean during storage and transportation are investigated. The results indicate the significant differences in the gelatinization and the distribution of starch granules for different varieties of beans. The higher gelatinization temperature of adzuki flour results in the lower enthalpy of gelatinization with an undulating tendency of the retrogradation due to the short-term aging of amylose and long-term aging of amylopectin within adzuki flour. In the early stage of aging, the coexistence of protein, fat, and starch inside adzuki flour hinder the aging of starch. An Avrami equation is introduced to characterize the aging process of the starch–protein–fat–water system of different varieties of adzuki flours. The nucleation mode of the crystal nucleus has a significant effect on the aging rate of different varieties of adzuki flour. The fat in the system fails to demonstrate a significant effect on the nucleation mode of starch retrogradation. The addition of glycolipids increases the gelatinization enthalpy of adzuki flour. Glycolipids can reduce the aging degree of adzuki flour, and the inhibition effect on the retrogradation of sucrose monoester is greater than that of maltose monoester. The research results provide the valuable guidance for the high-quality processing and storage of adzuki bean paste from starch aging.