T4 DNA ligase is a widely used ligase in many applications; yet in single nucleotide polymorphism analysis, it has been found generally lacking owing to its tendency to ligate mismatches quite efficiently. To address this lack of selectivity, we explored the effect of temperature on the selectivity of the ligase in discriminating single base pair mismatches at the 3′‐terminus of the ligating strand using short ligation probes (9‐mers). Remarkably, we observe outstanding selectivities when the assay temperature is increased to 7 °C to 13 °C above the dissociation temperature of the matched probe:target duplexes using commercially available enzyme at low concentration. Higher enzyme concentration shifts the temperature range to 13 °C to 19 °C above the probe:target dissociation temperatures. Finally, substituting the 5′‐phosphate terminus with an abasic nucleotide decreases the optimal temperature range to 7 °C to 10 °C above the matched probe:target duplex. We compare the temperature dependence of the T4 DNA ligase catalyzed ligation and a nonenzymatic ligation system to contrast the origin of their modes of selectivity. For the latter, temperatures above the probe:target duplex dissociation lead to lower ligation conversions even for the perfect matched system. This difference between the two ligation systems reveals the uniqueness of the T4 DNA ligase's ability to maintain excellent ligation yields for the matched system at elevated temperatures. Although our observations are consistent with previous mechanistic work on T4 DNA ligase, by mapping out the temperature dependence for different ligase concentrations and probe modifications, we identify simple strategies for introducing greater selectivity into SNP discrimination based on ligation yields.