The SIN3 transcriptional coregulator influences gene expression through multiple interactions that include histone deacetylases (HDACs). Haploinsufficiency and mutations in SIN3 are the underlying cause of Witteveen-Kolk syndrome and related intellectual disability (ID)/autism syndromes, emphasizing its key role in development. However, little is known about the diversity of its interactions and functions in developmental processes. Here we show that loss of SIN-3, the single SIN3 homologue in Caenorhabditis elegans, results in maternal effect sterility associated with deregulation of the germline transcriptome, including desilencing of X-linked genes. We identify at least two distinct SIN3 complexes containing specific HDACs, and show that they differentially contribute to fertility. Single cell smFISH reveals that in sin-3 mutants, the X chromosome becomes re-expressed prematurely and in a stochastic manner in individual germ cells, suggesting a role for SIN-3 in its silencing. Furthermore, we identify histone residues whose acetylation increases in the absence of SIN3. Together, this work provides a powerful framework for the in vivo study of SIN3 and associated proteins.