Several non‐hydrolytic sol–gel syntheses involving different precursors, oxygen donors, and conditions have been screened aiming to selectively produce mesoporous t‐ZrO2 or m‐ZrO2 with significant specific surface areas. The in situ water formation was systematically investigated by Karl Fisher titration of the syneresis liquids. XRD and nitrogen physisorption were employed to characterize the structure and texture of the ZrO2 samples. Significant amounts of water were found in several cases, notably in the reactions of Zr(OnPr)4 with ketones (acetone, 2‐pentanone, acetophenone), and of ZrCl4 with alcohols (benzyl alcohol, ethanol) or acetone. Conversely, the reactions of Zr(OnPr)4 with acetic anhydride or benzyl alcohol at moderate temperature (200 °C) and of ZrCl4 with diisopropyl ether appear strictly non‐hydrolytic. Although reaction time and reaction temperature were also important parameters, the presence of water played a crucial role on the structure of the final zirconia: t‐ZrO2 is favored in strictly non‐hydrolytic routes, while m‐ZrO2 is favored in the presence of significant amounts of water. 1H and 13C NMR analysis of the syneresis liquids allowed us to identify the main reactions responsible for the formation of water and of the oxide network. The morphology of the most interesting ZrO2 samples was further investigated by electron microscopy (SEM, TEM).