Healthy older women typically retain an advantage in verbal memory compared to men (e.g., Zhang, Zhou, Wang, & Zhang, 2017), and men may have an advantage in visuospatial abilities (De Frias, Nilsson, & Herlitz, 2006). Sex is an important factor to consider when evaluating memory with older adults, particularly when using measures that do not provide sex-specific normative data. This present study aimed to examine differences in verbal and nonverbal memory within a clinical sample of older adults (N = 1084). Raw learning and recall scores on the Hopkins Verbal Learning Test, Revised (HVLT-R; Brandt & Benedict, 2001) and Brief Visuospatial Memory Test, Revised (BVMT-R; Benedict, 1997) were compared between sexes within the entire sample and cohorts stratified by age (60 -69, 70 -79, and 80 -89). Within the entire sample, women significantly outperformed men in HVLT-R learning and recall and there were no sex differences in BVMT-R performance. These sex differences, however, were absent or reversed for those with impaired HVLT-R performance and functional deficits, indicating that women retain an early advantage in verbal memory, which is lost with greater indication of disease severity. Sex accounted for a small, but significant portion of variance in HVLT-R learning and recall performance. Overall, the results indicate that women retain an advantage in verbal learning and memory, at least before significant levels of impairment, within a sample of older adults seen at an outpatient neurology clinic, which may have implications for diagnosing memory disorders.