Geometrical visual illusions are an intriguing phenomenon, in which subjective perception consistently misjudges the objective, physical properties of the visual stimulus. Prominent theoretical proposals have been advanced attempting to find common mechanisms across illusions. But empirically testing the similarity between illusions has been notoriously difficult because illusions have very different visual appearances. Here we overcome this difficulty by capitalizing on the variability of the illusory magnitude across participants. Fifty-nine healthy volunteers participated in the study that included measurement of individual illusion magnitude and structural MRI scanning. We tested the Muller-Lyer, Ebbinghaus, Ponzo, and vertical-horizontal geometrical illusions as well as a non-geometrical, contrast illusion. We found some degree of similarity in behavioral judgments of all tested geometrical illusions, but not between geometrical illusions and non-geometrical, contrast illusion. The highest similarity was found between Ebbinghaus and Muller-Lyer geometrical illusions. Furthermore, the magnitude of all geometrical illusions, and particularly the Ebbinghaus and Muller-Lyer illusions, correlated with local gray matter density in the parahippocampal cortex, but not in other brain areas. Our findings suggest that visuospatial integration and scene construction processes might partly mediate individual differences in geometric illusory perception. Overall, these findings contribute to a better understanding of the mechanisms behind geometrical illusions.