Plants have evolved diverse reproductive allocation strategies and seed traits to aid in dispersal, persistence in the seed bank, and establishment. In particular, seed size, dormancy, and early seedling vigor are thought to be key functional traits with important recruitment and fitness consequences across abiotic stress gradients. Selection for favored seed‐trait combinations, or against maladaptive combinations, is likely an important driver shaping recruitment strategies. Here, we test for seed‐trait plasticity and patterns of recruitment using two genotypes representative of contrasting upland and lowland ecotypes of Panicum hallii with field experiments in native versus foreign habitats. Furthermore, we test whether seed traits have been under directional selection in P. hallii using the v‐test based on trait variance in a genetic cross. Finally, we evaluate the genetic architecture of ecotypic divergence for these traits with quantitative trait locus (QTL) mapping. Field experiments reveal little plasticity but support a hypothesis of adaptation divergence among ecotypes based on recruitment. Patterns of segregation within recombinant hybrids provides strong support for directional selection driving ecotypic divergence in seed traits. Genetic mapping revealed a polygenic architecture with evidence of genetic correlation between seed mass, dormancy, and seedling vigor. Our results suggest that the evolution of these traits may involve constraints that affect the direction of adaptive divergence. For example, seed size and germination percentage shared two colocalized QTL with antagonistic additive effects. This supports the hypothesis of a functional genetic relationship between these traits, resulting in either large seed/strong dormancy or small seed/weak dormancy trait combinations. Overall, our study provides insights into the factors facilitating and potentially constraining ecotypic differentiation in seed traits.