Rényi Mutual information (RMI), computed from second Rényi entropies, can identify classical phase transitions from their finite-size scaling at the critical points. We apply this technique to examine the presence or absence of finite temperature phase transitions in various two-dimensional models on a square lattice, which are extensions of the conventional Ising model by adding a quenched disorder. When the quenched disorder causes the nearest neighbor bonds to be both ferromagnetic and antiferromagnetic, (a) a spin glass phase exists only at zero temperature, and (b) a ferromagnetic phase exists at a finite temperature when the antiferromagnetic bond distributions are sufficiently dilute. Furthermore, finite temperature paramagnetic-ferromagnetic transitions can also occur when the disordered bonds involve only ferromagnetic couplings of random strengths. In our numerical simulations, the "zero temperature only" phase transitions are identified when there is no consistent finite-size scaling of the RMI curves, while for finite temperature critical points, the curves can identify the critical temperature Tc by their crossings at Tc and 2 Tc. arXiv:1711.02352v2 [cond-mat.dis-nn]