Intellectual disability (ID) encompasses a wide spectrum of neurodevelopmental disorders, with many linked genetic loci. However, the underlying molecular mechanism for over 50% of the patients remains elusive. We describe mutations in SMARCA5, encoding the ATPase motor of the ISWI chromatin remodeler, as a cause of a novel neurodevelopmental disorder, identifying twelve individuals with de novo or dominantly segregating rare heterozygous variants. Accompanying phenotypes include mild developmental delay, frequent postnatal short stature, and microcephaly, and recurrent dysmorphic features. Loss of function of the SMARCA5 Drosophila ortholog Iswi led to smaller body size, reduced dendrite complexity, and tiling defects in larvae. In adult flies, Iswi neural knockdown caused decreased brain size, aberrant mushroom body morphology and abnormal locomotor function. Iswi loss of function was rescued by wild-type but not mutant SMARCA5. Our results demonstrate that SMARCA5 pathogenic variants cause a neurodevelopmental syndrome with mild facial dysmorphia.