Background: Numerous studies have consistently demonstrated that depression can be associated with cognitive function decline, primarily focusing on older adults due to the neurodegenerative characteristics of dementia. With persistent depression frequently reported in patients with early-onset or young-onset dementia, this study aimed to assess the impact of depression, specifically the changes in depressive symptoms over time, on the risk of cognitive function decline in middle-aged adults in Korea. Methods: This retrospective study utilized data from the first four waves (2006)(2007)(2008)(2009)(2010)(2011)(2012) of the Korean Longitudinal Study of Aging (KLoSA), focusing on middle-aged adults with normal cognitive function at baseline. Changes in depressive symptoms were categorized into four groups based on the CES-D score, and their association with cognitive function decline was evaluated using a multivariate logistic regression model. Results: Of the initial 10,254 participants, 3,400 were included in the analysis. Depressive status, particularly newly onset (adjusted odds ratio [aOR] 1.96; 95% confidence interval [CI] 1.32-2.93) and persistent depression groups (aOR 5.59; 95% CI 2.90-10.78), were significantly associated with cognitive function decline. In contrast, recovery from depressive symptoms was not significantly associated with cognitive function decline (p=0.809). Conclusions: Our study showed a significant association between changes in depressive symptoms and cognitive function decline in middle-aged Korean adults. This suggests that management of depressive symptoms could be crucial for the prevention of cognitive function decline in this population.