(1) Background: Hypertensive disorders of pregnancy (HDP) include gestational hypertension (GH), chronic hypertension (CH), preeclampsia (PE), and preeclampsia superimposed on chronic hypertension (CH with PE). HDP is associated with several short and long-term perinatal and neonatal complications, such as newborn growth restriction and death. This study aimed to establish the association between HDP, newborn growth abnormalities, and neonatal outcome. (2) Methods: This is a single-center retrospective cohort study of 63651 singleton deliveries. (3) Results: Univariate analysis showed a significantly increased risk of intrauterine and neonatal death associated with maternal hypertension and growth disorders. There were differences between growth charts used, with the highest risk of stillbirth for SGA defined by the Intergrowth chart (OR 17.2) and neonatal death for newborn growth restriction (NGR) based on Intergrowth (OR 19.1). Multivariate analysis showed that NGR is a stronger risk factor of neonatal death than SGA only. (4) Conclusions: HDP is significantly associated with growth abnormalities and is an independent risk factor of adverse outcomes. The presence of newborn growth restriction is strongly associated with the risk of neonatal death. The choice of growth chart has a substantial effect on the percentage of diagnosis of SGA and NGR.