While many studies have described the association between cognitive decline and eating habits, little attention has been paid to its association with cheese intake. In this epidemiological study of 1035 community-dwelling women aged ≥ 65, we investigated the association between intake/type of cheese and cognitive function. The anthropometry, functional ability, and the frequency of food intake, including cheese, were assessed. The mini-mental state examination (MMSE) was used to assess cognitive function, and a score of 20–26 was operationally defined as mild cognitive decline. We found that the MMSE score was significantly different between the presence of cheese intake and not (cheese intake: 28.4 ± 1.9; non-cheese intake: 27.6 ± 2.4) and between those who consumed Camembert cheese and those who did not (Camembert cheese: 28.7 ± 1.4; others: 28.3 ± 2.0). After adjusting for confounders, multiple logistic regression identified four independent variables significantly associated with mild cognitive decline: Camembert cheese intake (odds ratio = 0.448, 95% confidence interval = 0.214–0.936), age, usual walking speed, and repetitive saliva swallowing test scores. Our results, while based on cross-sectional data from Japanese community-dwelling older women, identified the significant inverse association between Camembert cheese intake and mild cognitive decline.