One consistent challenge of both computational and empirical catalyst screening is ensuring that the variables chosen for the screen are driving the performance analyzed. Here, we compare photocatalytic hydrogen evolution from in situ formed Au and Au/Cu nanoparticles to nanoparticles of the same composition synthesized prior to being used as catalysts, as well as compare them to in situ formed Au and Au/Cu nanoparticles in the presence of exogeneous ligand. For all experiments, we observed that ligand-terminated nanoparticles performed better than un-stabilized in situ formed nanoparticles. We tested the generality of this result by studying Co, Ni, and Pd in the same system and also observed that the introduction of nanoparticle ligand leads to enhanced catalytic activity. Taken together, these results suggest 1) nanoparticle ligands can be beneficial, and even necessary, to produce catalysts with sustained activity 2) For computational prediction of these catalysts, factors relating to particle formation and stability need to be considered when both generating predictions as well as interpreting experimental results based on those predictions.