Self-rated health (SRH) is a predictive factor for health-related prognoses such as mortality. This study aimed to comprehensively investigate the risk factors for poor SRH in the general population of Japan, focusing on the combination of the number of teeth and self-rated mastication. Individuals aged at least 40 years in Yamagata Prefecture, Japan, were surveyed from 2017 to 2021. The participants answered a self-administered postal survey on lifestyle factors, medical history, physical and mental conditions, oral health, and dietary intake, and 6,739 participants were included. Multivariate logistic regression analysis showed that individuals with less than 20 teeth and who bite tightly on one side or neither side were at a 1.422- and 1.952-fold significantly higher risk, respectively, of poor SRH than individuals with at least 20 teeth and who bite tightly on both sides. Moreover, individuals who had less than 20 teeth but could bite tightly on both sides did not have a significant risk compared to those who had at least 20 teeth and could bite tightly on both sides. Regarding individuals with more than 20 teeth, there was no difference between those who could and could not bite tightly on both sides, although the odds ratios for poor SRH tended to increase for those who could not bite on one side or neither side. Our results emphasize the importance of having at least 20 teeth without periodontal disease and oral rehabilitation using a type of prostheses for SRH, even with less than 20 teeth.