Objective : To evaluate the association between the double vulnerability of being elderly and a caregiver and quality of life assessed by Control, Autonomy, Self-realization and Pleasure factors (CASP-19). Method : 148 elderly caregivers participated in the present study. They were selected for convenience from Brazilian public and private health services - a sample from the study “The Psychological Well-Being of Elderly Persons Caring for Other Elderly Persons in a Family Context”. The variables: caregiver’s state of health, care demands, perception of burden, self-rated health, and quality of life were selected. Descriptive analyses, chi-squared tests, Fisher’s exact test, the Kruskal-Wallis test and analysis of multivariate hierarchical logistics were carried out, with theStepwisecriteria applied for selection of variables. Results : The hierarchical multivariate analyses found that number of symptoms and total burden were significantly associated with a poorer quality of life. Elderly persons with three or more symptoms and those with a high burden level were at a higher risk of poor quality of life. The variables number of diseases, burden, and self-rated health compared with the past, were significantly associated with a poorer quality of life. Conclusion : It can be concluded that for the elderly caregiver, physical aspects (signs and symptoms, chronic diseases and a perception of health deterioration) combined with burden are the aspects that most influence quality of life.