Purpose Common residual symptoms among survivors of colorectal cancer (CRC) are sleep difficulties and gastrointestinal symptoms. Among patients with various gastrointestinal (inflammatory) diseases, sleep quality has been related to gastrointestinal symptoms. For CRC survivors, this relation is unclear; therefore, we examined the association between sleep quality and quantity with gastrointestinal symptoms among CRC survivors. Methods CRC survivors registered in the Netherlands Cancer Registry—Southern Region diagnosed between 2000 and 2009 received a survey on sleep quality and quantity (Pittsburgh Sleep Quality Index) and gastrointestinal symptoms (European Organisation for Research and Treatment of Cancer, Quality of Life Questionnaire-Colorectal 38, EORTC QLQ-CR38) in 2014 (≥ 4 years after diagnosis). Secondary cross-sectional data analyses related sleep quality and quantity separately with gastrointestinal symptoms by means of logistic regression analyses. Results In total, 1233 CRC survivors were included, of which 15% reported poor sleep quality. The least often reported gastrointestinal symptom was pain in the buttocks (15.1%) and most often reported was bloating (29.2%). CRC survivors with poor sleep quality were more likely to report gastrointestinal symptoms (p’s < 0.01). Survivors who slept < 6 h were more likely to report symptoms of bloating or flatulence, whereas survivors who slept 6–7 h reported more problems with indigestion. Conclusions Worse sleep quality and short sleep duration were associated with higher occurrence of gastrointestinal symptoms. Implications for cancer survivors Understanding the interplay between sleep quality and gastrointestinal symptoms and underlying mechanisms adds to better aftercare and perhaps reduction of residual gastrointestinal symptoms in CRC survivors by improving sleep quality.