Background A large proportion of proton pump inhibitor (PPI) prescriptions, including those for stress ulcer prophylaxis (SUP), are inappropriate. Our study purpose was to systematically review the effectiveness of de-implementation strategies aimed at reducing inappropriate PPI use for SUP in hospitalized, non-intensive care unit (non-ICU) patients. Methods We searched MEDLINE and Embase databases (from inception to January 2020). Two authors independently screened references, performed data extraction, and critical appraisal. Randomized trials and comparative observational studies were eligible for inclusion. Criteria developed by the Cochrane Effective Practice and Organisation of Care (EPOC) group were used for critical appraisal. Besides the primary outcome (inappropriate PPI prescription or use), secondary outcomes included (adverse) pharmaceutical effects and healthcare use. Results We included ten studies in this review. Most de-implementation strategies contained an educational component (meetings and/or materials), combined with either clinical guideline implementation (n = 5), audit feedback (n = 3), organizational culture (n = 4), or reminders (n = 1). One study evaluating the de-implementation strategy effectiveness showed a significant reduction (RR 0.14; 95% CI 0.03–0.55) of new inappropriate PPI prescriptions. Out of five studies evaluating the effectiveness of de-implementing inappropriate PPI use, four found a significant reduction (RR 0.21; 95% CI 0.18–0.26 to RR 0.76; 95% CI 0.68–0.86). No significant differences in the occurrence of pharmaceutical effects (n = 1) and in length of stay (n = 3) were observed. Adverse pharmaceutical effects were reported in two studies and five studies reported on PPI or total drug costs. No pooled effect estimates were calculated because of large statistical heterogeneity between studies. Discussion All identified studies reported mainly educational interventions in combination with one or multiple other intervention strategies and all interventions were targeted at providers. Most studies found a small to moderate reduction of (inappropriate) PPI prescriptions or use.