Genetically diverse pluripotent stem cells (PSCs) display varied, heritable responses to differentiation cues in the culture environment. By harnessing these disparities through derivation of embryonic stem cells (ESCs) from the BXD mouse genetic reference panel, along with C57BL/6J (B6) and DBA/2J (D2) parental strains, we demonstrate genetically determined biases in lineage commitment and identify major regulators of the pluripotency epigenome. Upon transition to formative pluripotency using epiblast-like cells (EpiLCs), B6 quickly dissolves naïve networks adopting gene expression modules indicative of neuroectoderm lineages; whereas D2 retains aspects of naïve pluripotency with little bias in differentiation. Genetic mapping identifies 6 major trans-acting loci co-regulating chromatin accessibility and gene expression in ESCs and EpiLCs, indicating a common regulatory system impacting cell state transition. These loci distally modulate occupancy of pluripotency factors, including TRIM28, P300, and POU5F1, at hundreds of regulatory elements. One trans-acting locus on Chr 12 primarily impacts chromatin accessibility in ESCs; while in EpiLCs the same locus subsequently influences gene expression, suggesting early chromatin priming. Consequently, the distal gene targets of this locus are enriched for neurogenesis genes and were more highly expressed when cells carried B6 haplotypes at this Chr 12 locus, supporting genetic regulation of biases in cell fate. Spontaneous formation of embryoid bodies validated this with B6 showing a propensity towards neuroectoderm differentiation and D2 towards definitive endoderm, confirming the fundamental importance of genetic variation influencing cell fate decisions.