Infants vary significantly in the way they process and respond to sensory stimuli, and altered sensory processing has been reported among infants later diagnosed with autism. Previous work with adolescents and adults suggests that variability in sensory processing may have a strong genetic basis. Yet, little is known about the etiological factors influencing sensory differences in infancy, a period when interactions with caregivers are intense and during which brain circuits supporting social and non-social cognition are sculptured. Here, we used a multivariate, multi-pronged approach to delineate phenotypic and etiological structure of individual variability across different sensory processing domains early in infancy and tested developmental links to later autistic traits. We analysed data from a community sample of monozygotic (MZ) and dizygotic (DZ) same-sex twins at 5 months of age (n=285 pairs, n=158 MZ pairs, n=150 male pairs) from the BabyTwins Study in Sweden (BATSS) using exploratory factor analysis, generalized estimating equations on phenotypic associations, and multivariate twin models comparing different structural model solutions to investigate genetic and environmental influences on variance/covariance across different sensory scores measured at 5 months of age by the Infant/Toddler Sensory Profile (ITSP), and autistic traits as measured by total scores from the Quantitative Checklist for Autism in Toddlers (Q-CHAT) at 36 months. Results suggested separability between sensory processing dimensions (i.e., sensation seeking, sensation avoiding, sensory sensitivity, and low registration) at a structural as well as etiological level, showing different contributions from additive genetics and family environment that were unique to each sensory dimension. Higher incidence of behaviours within the latter three sensory dimensions in infancy, as well as more tactile-related behaviors, were significantly associated with higher levels of autistic traits assessed at three years. The fractionable etiological structure underlying sensory processing early in life revealed by this study implies that sensory oriented interventions (e.g., for autism) may benefit from narrowly targeting each sensory dimension to be maximally effective. The findings can also explain seemingly contra-intuitive findings such as the same child being described at times as an active seeker or avoider in relation to sensory stimulation.