Rheumatoid Arthritis (RA) is a chronic inflammatory disabling disease with significant impact on the Quality of Life (QOL) of patients. Information on the effects of RA on Health-related Quality of Life (HRQoL) is lacking in the Lebanese population. The objective of this study was to evaluate QOL of RA patients compared with non-RA subjects and to suggest possible predictors of their QOL in Lebanon. We conducted a case–control observational study among individuals visiting the external clinics at three hospitals and different private clinics; the QOL was measured using the SF-36 questionnaire administered face to face to the study population, applied to RA (
N
= 90) and non-RA (
N
= 180) groups. RA presented lower Physical Component Scores (PCS) and Mental Component Scores (MCS) as well as overall QOL scores. Among RA patients, MCS and QOL were significantly decreased with morning stiffness duration (
β
= −9.211,
p
= 0.013 and
β
= −9.190,
p
= 0.009, respectively). The frequency of practicing sport per week increases PCS and QOL (
β
= 6.692,
p
= 0.002 and
β
= 6.148,
p
= 0.003, respectively). Workability has a positive effect on PCS (
β
= 5.546,
p
= 0.022) and time between blood transfusion and the onset of the disease has a positive impact on MCS (
β
= 8.415,
p
= 0.007). To improve QOL of patients with RA, health professionals have to take these results into consideration while treating their patients.