Granule-associated surface lipids (GASLs) and internal lipids showed different lipid−amylose relationships, contents, and distributions, suggesting their differing biological origins and functions, among waxy, normal, and high-amylose rice starch. The GASL content mainly depended on the pore size, while internal lipids regulated starch biosynthesis, as indicated by correlations of internal lipids with the chain length distribution of amylopectin and amylose content. Of the 1346 lipids detected, 628, 562, and 408 differentially expressed lipids were observed between normal−waxy, high-amylose−waxy, and normal−high-amylose starch, respectively. After the removal of GASLs, the higher lysophospholipid content induced greater decreases in the peak and breakdown viscosity and swelling power, while the highest digestibility increase was found with the highest triacylglycerol content. Thus, different GASL compositions led to different digestibility, swelling, and pasting outcomes. This study sheds new light on the mechanism of the role of GASLs in the structure and properties of starch, as well as in potential modifications and amyloplast membrane development.