Gene-environment interactions may play an important role in modulating the impact of earlylife stressful events on the clinical course of bipolar disorder (BD), particularly associated to early age at onset. Immune dysfunction is thought to be an important mechanism linking childhood trauma with early-onset BD, thus the genetic diversity of immune-related loci may account for an important part of the interindividual susceptibility to this severe subform. Here we investigated the potential interaction between genetic variants of Toll-like receptors 2 (TLR2) and 4 (TLR4), major innate immune response molecules to pathogens, and the childhood trauma questionnaire (CTQ) in age at onset of BD. We recruited 531 BD patients (type I and II or not otherwise specified), genotyped for the TLR2 rs4696480 and rs3804099 and TLR4 rs1927914 and rs11536891 single-nucleotide polymorphisms and recorded for history of childhood trauma using the CTQ. TLR2 and TLR4 risk genotype carrier state and history of childhood emotional, physical and sexual abuses were evaluated in relation to age at onset as defined by the age at first manic or depressive episode. We observed a combined effect of TLR2 rs3804099 TT genotype and reported sexual abuse on determining an earlier age at onset of BD by means of a Kaplan-Meier survival curve (p = 0.002; corrected p = 0.02). Regression analysis, however, was non-significant for the TLR2-CTQ sexual abuse interaction term. The negative effects of childhood sexual abuse on age at onset of BD may be amplified in TLR2 rs3804099 risk genotype carriers through immune-mediated pathways. Clinical characteristics of illness severity, immune phenotypes and history of early life infectious insults should be included in future studies involving large patient cohorts.