The trait impulsivity theory suggests that a single, highly heritable externalizing liability factor, expressed as temperamental trait impulsivity, represents the core vulnerability for externalizing disorders. The present study sought to test the application of latent factor models derived from this theory to a clinical sample of children. Participants were 474 German children (age 6-12 years, 81% male) with symptoms of attention-deficit/hyperactivity disorder and externalizing behavior problems participating in an ongoing multicenter intervention study. Using confirmatory factor analyses (CFA) and exploratory structural equation modeling (ESEM), we evaluated several factor models of externalizing spectrum disorders (unidimensional; first-order correlated factors; higher-order factor; fully symmetrical bifactor; bifactor S-1 model). Furthermore, we assessed our prevailing factor models for measurement invariance across raters (clinicians, parents, teachers) and assessment modes (interview, questionnaires). While both CFA and ESEM approaches provided valuable insights into the multidimensionality, ESEM solutions were generally superior since they showed a substantially better model fit and less biased factor loadings. Among the models tested, the bifactor S-1 CFA/ESEM models, with a general hyperactivity-impulsivity reference factor, displayed a statistically sound factor structure and allowed for straightforward interpretability. Furthermore, these models showed the same organization of factors and loading patterns, but not equivalent item thresholds across raters and assessment modes, highlighting cross-situational variability in child behavior. Our findings are consistent with the assumption of the trait impulsivity theory that a common trait, presented as hyperactivity-impulsivity symptoms, underlies all externalizing disorders.