A growing gap is emerging between the supply of and demand for professional caregivers, not least because of the ever-increasing average age of the world’s population. One strategy to address this growing gap in many regions is the use of care robots. Although there have been numerous ethical debates about the use of robots in nursing and elderly care, an important question remains unexamined: how do the potential recipients of such care perceive situations with care robots compared to situations with human caregivers? Using a large-scale experimental vignette study, we investigated people’s affective attitudes toward care robots. Specifically, we studied the influence of the caregiver’s nature on participants’ perceived comfort levels when confronted with different care scenarios in nursing homes. Our results show that the care-robot-related views of actual care recipients (i.e., people who are already affected by care dependency) differ substantially from the views of people who are not affected by care dependency. Those who do not (yet) rely on care placed care robots’ value far below that of human caregivers, especially in a service-oriented care scenario. This devaluation was not found among care recipients, whose perceived level of comfort was not influenced by the caregiver’s nature. These findings also proved robust when controlled for people’s gender, age, and general attitudes toward robots.