Photoresponsive molecules that incorporate peptides capable of material-specific recognition provide a basis for biomolecule-mediated control of the nucleation, growth, organization, and activation of hybrid inorganic/organic nanostructures. These hybrid molecules interact with the inorganic surface through multiple noncovalent interactions which allow reconfiguration in response to optical stimuli. Here, we quantify the binding of azobenzene-peptide conjugates that exhibit optically triggered cis-trans isomerization on Ag surfaces and compare to their behavior on Au. These results demonstrate differences in binding and switching behavior between the Au and Ag surfaces. These molecules can also produce and stabilize Au and Ag nanoparticles in aqueous media where the biointerface can be reproducibly and reversibly switched by optically triggered azobenzene isomerization. Comparisons of switching rates and reversibility on the nanoparticles reveal differences that depend upon whether the azobenzene is attached at the peptide N- or C-terminus, its isomerization state, and the nanoparticle composition. Our integrated experimental and computational investigation shows that the number of ligand anchor sites strongly influences the nanoparticle size. As predicted by our molecular simulations, weaker contact between the hybrid biomolecules and the Ag surface, with fewer anchor residues compared with Au, gives rise to differences in switching kinetics on Ag versus Au. Our findings provide a pathway toward achieving new remotely actuatable nanomaterials for multiple applications from a single system, which remains difficult to achieve using conventional approaches.