Background: Breast cancer (BC) is one of the leading causes of mortality worldwide. There are observed disparities in patients with disability as compared to those without disability, which leads to poor BC screening attendance, thereby worsening disease management. Aim: The aim of this systematic review is to investigate if there are disparities in screening rates in women with disability as compared to those without disability, as well as the different factors that pose barriers to patients with disability for enrolment in BC screening programs. Method: Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we systematically reviewed published articles between 2008 and 2023, which assessed different factors that contributed to poor attendance in BC screening programs held across different countries. Detailed study characteristics were obtained, and methodological quality assessment was performed on the individual studies included in this review. Result: A total of fifty-three articles were identified as eligible studies based on the pre-defined inclusion and exclusion criteria. These included 7,252,913 patients diagnosed with BC (913,902 patients with disability/6,339,011 patients without disability). The results revealed there are demographic, clinical, financial, and service-related barriers that contributed to lower screening rates in disabled patients as compared to non-disabled. Patient age is the most common factor, with the highest effect observed for 80 years (vs. 30–44 years) [odds ratio (OR) = 13.93 (95% confidence interval (CI) = 8.27–23.47), p < 0.0001], followed by race/ethnicity for Hispanic (vs. non-Hispanic white) [OR = 9.5 (95%CI = 1.0–91.9), p < 0.05]. Additionally, patients with multiple disabilities had the highest rate of dropouts [OR = 27.4 (95%CI = 21.5–33.3)]. Other factors like education, income, marital status, and insurance coverage were essential barriers in screening programs. Conclusions: This study presents a holistic view of all barriers to poor BC screening attendance in disabled patients, thereby exacerbating health inequalities. A standardized approach to overcome the identified barriers and the need for a tailored guideline, especially for disability groups, is inevitable.