Sexual differentiation of the developing brain organizes the neural architecture differently between males and females, and the main influence on this process is exposure to gonadal steroids during sensitive periods of prenatal and early postnatal development. Many molecular and cellular processes are influenced by steroid hormones in the developing brain, including gene expression, cell birth and death, neurite outgrowth and synaptogenesis, and synaptic activity. Perturbations in these processes can alter neuronal excitability and circuit activity, leading to increased seizure susceptibility and the promotion of pathological processes that constitute epileptogenesis. In this review, we will provide a general overview of sex differences in the early developing brain that may be relevant for altered seizure susceptibility in early life, focusing on limbic areas of the brain. Sex differences that have the potential to alter the progress of epileptogenesis are evident at molecular and cellular levels in the developing brain, and include differences in neuronal excitability, response to environmental insult, and epigenetic control of gene expression. Knowing how these processes differ between the sexes can help us understand fundamental mechanisms underlying gender differences in seizure susceptibility and epileptogenesis.