A key open question in the study of layered superconducting nickelate films is the role that hydrogen incorporation into the lattice plays in the appearance of the superconducting state. Due to the challenges of stabilizing highly crystalline square planar nickelate films, films are prepared by the deposition of a more stable parent compound which is then transformed into the target phase via a topotactic reaction with a strongly reducing agent such as CaH2. Recent studies, both experimental and theoretical, have introduced the possibility that the incorporation of hydrogen from the reducing agent into the nickelate lattice may be critical for the superconductivity. In this work, we use secondary ion mass spectrometry to examine superconducting La1−xXxNiO2 / SrTiO3 (X = Ca and Sr) and Nd6Ni5O12 / NdGaO3 films, along with non-superconducting NdNiO2 / SrTiO3 and (Nd,Sr)NiO2 / SrTiO3. We find no evidence for extensive hydrogen incorporation across a broad range of samples, including both superconducting and non-superconducting films. Theoretical calculations indicate that hydrogen incorporation is broadly energetically unfavorable in these systems, supporting our conclusion that extensive hydrogen incorporation is not generally required to achieve a superconducting state in layered square-planar nickelates.