The effect of natural aging on physiologic mechanisms that regulate attentional set-shifting represents an area of high interest in the study of cognitive function. In visual discrimination learning, reward contingency changes in categorization tasks impact individual performance, which is constrained by attention-shifting costs. Perseveration (PE) and learned irrelevance (LI) are viewed as two different mechanisms that shape responses to stimuli, which are predicated on the shift in stimulus form. To date, only studies examining patients with Parkinson’s disease have provided some insight into the relationship between individual age and performance in PE and LI tasks. We enrolled 60 healthy individuals (mean [SD] age, 63.0 [12.6]) without a history of dementia, a cerebrovascular incident, or a neurodegenerative disease. No association was observed between crystallized intelligence or verbal fluency scores and reaction time in both PE (r = 0.074, p = 0.603; r = −0.124, p = 0.346) and LI (r = −0.076, p = 0.562; r = −0.081, p = 0.536) task conditions, respectively. In contrast, a statistically significant linear relationship was observed between age and reaction time (RT) for PE (r = 0.259, p = 0.046) but not for LI (r = 0.226, p = 0.083). No significant linear relationship was observed for changing RTs in PE and LI (r = 0.209, p = 0.110). The present study is the first report that provides a descriptive overview of age-related differences in PE and LI in a sample of cognitively unimpaired middle- to older-aged adults.