Work-related stress is the response people may have when presented with work demands and pressures that are not matched to their knowledge and abilities and challenge their ability to cope. The World Health Organization (WHO) defines quality of life (QOL) as individuals’ perception of their position in life in the context of the culture and value systems in which they live and in relation to their goals, expectations, standards, and concerns. This study aimed to determine the pattern of perceived work stress and its impact on the QOL of bankers in Ado-Ekiti, Southwest Nigeria. This was a cross-sectional study conducted among three hundred and two bankers in Ado-Ekiti, Ekiti State. The single-stage study obtained data on the socio-demographics, work history, and medical history of respondents with the socio-demographic questionnaire. The perception of work stress by the respondents was assessed with the Perceived Stress Scale (PSS-10), and the QOL was assessed with the WHO QOL Brief Version (WHOQOL-BREF). Fifty-seven (18.9%) had a low perception of stress, 233 (77.1%) had a moderate perception of stress, and 12 (4.0%) had a high perception of stress. In this study, an association was found between perceived work stress and social relationship domain of QOL. This study showed that there is a high prevalence of moderately perceived work stress among bankers. It also showed a significant association between perceived work stress and QOL.