College English course is an important basic course in colleges and universities. The purpose of this study is to better understand the influence mechanism of geographical environment on English learning and provide scientific basis for formulating targeted English education policies. This study uses the method of machine learning to analyze the collected data and explore the influence of geographical environment on college students' English learning. This study constructs a comprehensive data set including students' English learning achievements, academic background and geographical location, and obtains the results through computer model analysis. The results show that geographical environment has an influence on college English learning, which will lead to differences in students' English learning achievements. This study suggests that geographical factors should be considered when formulating English education policies. This study is of great significance to promoting the development of English education and improving students' learning effect.