Synesthesia has historically been linked with enhanced creativity, but this had never been demonstrated in a systematically recruited sample. The current study offers a broad examination of creativity, personality, cognition, and mental imagery in a small sample of systematically recruited synesthetes and controls (n = 65). Synesthetes scored higher on some measures of creativity, personality traits of absorption and openness, and cognitive abilities of verbal comprehension and mental imagery. The differences were smaller than those reported in the literature, indicating that previous studies may have overestimated group differences, perhaps due to biased recruitment procedures. Nonetheless, most of our results replicated literature findings, yielding two possibilities: (1) our study was influenced by similar biases, or (2) differences between synesthetes and controls, though modest, are robust across recruitment methods. The covariance among our measures warrants interpretation of these differences as a pattern of associations with synesthesia, leaving open the possibility that this pattern could be explained by differences on a single measured trait, or even a hidden, untested trait. More generally, this study highlights the difficulty of comparing groups of people in psychology, not to mention neuropsychology and neuroimaging studies. The requirements discussed here – systematic recruitment procedures, large battery of tests, and large cohorts – are best fulfilled through collaborative efforts and cumulative science.