This paper reports findings on the challenges and sources of resilience of carers of Persons with Intellectually Disabilities (PwIDs) in Ghana. Semi-structured interviews were used to gather data from ten (10) institutional carers (House Mothers), and five (5) teachers at three different institutions for PwIDs in the Kumasi metropolis of Ghana. The challenges carers face is because of socio-cultural perceptions regarding PwIDs as well as work related constraints. Even though this research confirmed the fear, apprehension and negative comments by family, friends and the public to care work, it also revealed that this could be due to ignorance, lack of understanding and unfamiliarity of the public with PwIDs. Despite the challenges involved with care work such as aggressive behaviour from PwIDs for instance, carers indicated that PwIDs were 'interesting' and 'funny', making the work enjoyable. The study revealed that religion and the expectation of a future blessing from God were a major source of resilience for carers. Since increased social integration has been suggested to reduce stigma against PwIDs, this study recommends that Ghanaian social workers actively engage in discussions regarding the integration of PwIDs in day-today social processes. Furthermore, while it is important to build the resilience of carers, it is equally relevant for Ghanaian social workers to address the source of challenge (in this case stigma and discrimination) that necessitates this resilience in the first place.