With the rapid socio-economic changes in recent years and the intensification of competition in education in various countries, students’ academic performance has become a criterion for judging whether they receive a good education in most countries, and academic performance is also closely related to students’ future job salary and living standard and even the development of the country. This paper wants to study how family factors affect students’ academic performance. By reading a large amount of literature, the author provides an in-depth analysis and discussion of the research related to the family environment and academic performance. The main focus is on exploring the impact of various family factors on student academic performance, such as family structure, parental relationships, and family economic status conditions. The study found some family factors will have a direct impact on students’ academic performance, for example, family income and education investment. Some behavior like receiving higher education from a better school, hiring a tutor, and buying more learning materials, etc. could affect students’ academic performance directly. Nevertheless, many factors will affect academic performance indirectly such as family structure, family relationships, and so on. They are more likely to affect children’s physical and psychological conditions, therefore influencing their academic performance. Moreover, positive or negative results are not determined by a single factor, but by a combination of genes, social environment, and many other factors.