Deleterious mutations in the lipopolysaccharide responsive beige-like anchor protein (LRBA) gene cause severe childhood immune dysregulation. The complexity of the symptoms involving multiple organs and the broad range of unpredictable clinical manifestations of LRBA deficiency complicate the choice of therapeutic interventions. Although LRBA has been linked to Rab11-dependent trafficking of the immune checkpoint protein CTLA-4, its precise cellular role remains elusive. We show that LRBA, however, only slightly colocalizes with Rab11. Instead, LRBA is recruited by members of the small GTPase Arf protein family to the TGN and to Rab4+ endosomes, where it controls intracellular traffic. In patient-derived fibroblasts, loss of LRBA led to defects in the endosomal pathway promoting the accumulation of enlarged endolysosomes and lysosome secretion. Thus, LRBA appears to regulate flow through the endosomal system on Rab4+ endosomes. Our data strongly suggest functions of LRBA beyond CTLA-4 trafficking and provide a conceptual framework to develop new therapies for LRBA deficiency.