Data‐intensive discovery of water‐splitting catalysts can accelerate the development of sustainable energy technologies, such as the photocatalytic and/or electrocatalytic production of renewable hydrogen fuel. Through computational screening, 13 materials were recently predicted as potential water‐splitting photocatalysts: Cu3NbS4, CuYS2, SrCu2O2, CuGaO2, Na3BiO4, Sr2PbO4, LaCuOS, LaCuOSe, Na2TeO4, La4O4Se3, Cu2WS4, BaCu2O2, and CuAlO2. Herein, these materials are synthesized, their bandgaps and band alignments are experimentally determined, and their photoelectrocatalytic hydrogen evolution properties are assessed. Using cyclic voltammetry and chopped illumination experiments, 9 of the 13 materials are experimentally found to have bandgaps and band alignments that straddle the potentials required for the oxygen evolution reaction (OER) and hydrogen evolution reaction (HER), as computationally predicted. During photocatalytic testing, 12 of the materials yield a measurable photocurrent. However, only three are found to be active for the HER, with Cu3NbS4, CuYS2, and Cu2WS4 producing H2 in amounts comparable to bare TiO2; a benchmark photocatalyst. This study provides experimental validation of computational bandgap and band alignment predictions while also successfully identifying active photocatalysts.