We contrast the switching of photoluminescence (PL) of PbS quantum dots (QDs) cross-linked with photochromic diarylethene molecules with different end groups, 4,4′-(1-cyclopentene-1,2-diyl)bis[5-methyl-2-thiophenecarboxylic acid] (1C) and 4,4′-(1-cyclopentene-1,2-diyl)bis[5-methyl-2-thiophenethiocarboxylic acid] (2T). Our results show that the QDs cross-linked with the carboxylic acid end group molecules (1C) exhibit a greater amount of switching in photoluminescence intensity compared to QDs cross-linked with the thiocarboxylic acid end group (2T). We also demonstrate that regardless of the molecule used, greater switching amounts are observed for smaller quantum dots. Varying these parameters allows for the fabrication of photoswitches with tunable PL change. We relate these observations to the differences in the HOMO energy levels between the QDs and the photochromic molecules. Our findings demonstrate how the size of the QDs and the energy levels of the linker ligands influences the charge tunneling rate and thus the PL switching performance in tunneling-based photoswitches.