Despite the diversity of ageing, society and academics often describe and label older persons as a vulnerable group. As the term vulnerability is frequently interchangeably used with frailty, dependence, or loss of autonomy, a connection between older age and deficits is promoted. Concerning this, the question arises to what extent it may be helpful to refer to older persons as vulnerable specifically in the context of health care. After analyzing different notions of vulnerability, I argue that it is illegitimate to conclude that older age is related to increased vulnerability. Much more, identifying older adults as a vulnerable group is closely related to ageism and can be associated with paternalistic benevolence and a tendency to overprotection, especially within health care. Additionally, even though older adults are more often in situations of increased vulnerability due to their potentially higher need for health care, I argue further that older adults mainly become a vulnerable group due to ageism. In this way, it can be concluded that the vulnerability of older adults does not originate in certain attributes of the group, but arises from a characteristic of society and, in turn, health personnel, namely ageism. Labeling older adults as vulnerable therefore is only helpful, when it is used to raise awareness of the widespread ageism in society, in this context, especially in the setting of health care, and the negative consequences thereof for older adults.