Agricultural producers in China are presently confronting the challenge of “white pollution” caused by the continuous expansion of plastic film area coverage. The main objective of this research is to address the increasing interest in the effects of film residual on tomato growth, yield, and quality under drip irrigation. To reveal the effects of film residual on tomato physiology, field trials were conducted with five levels of film residual treatment applied in two consecutive cropping seasons from 2019 to 2020. Soil water content, plant height, stem diameter, photosynthetic characteristics, yield, soluble sugar content (SSC), organic acid (OA), vitamin C (VC), and nitrate content (NC) were measured; furthermore, four analysis methods were used to assess the comprehensive tomato quality. The results showed that film residuals significantly affected soil water content in 2019 and 2020 and inhibited tomato plant height and stem diameter. The variations in photosynthetic rate and stomatal conductance showed practically the same trend, increasing with an increase in the film residual at the seedling stage. The maximum yields were observed at 94.02 ton/hm2 and 84.44 ton/hm2 in 2019 and 2020, respectively, and tomato yield exhibited a shape reduction with increasing amounts of film residual in all years. SSC, VC, and NC showed an increasing trend with increasing amounts of film residual. The best tomato comprehensive quality was observed when the amount of film residual was lower than 200 kg/hm2 and declined with an increasing amount of film residual. Overall, the soil water content, tomato growth, and fruit quality changed significantly under the influence of film residual. These results not only deepen our understanding of the harm caused by film residual to tomato growth and fruit quality but also provide reasonable advice to establish a management system for residual pollution on cultivated land.