We extend the program initiated in [T. Werlang et al., Phys. Rev. Lett. 105, 095702 (2010)] in several directions. Firstly, we investigate how useful quantum correlations, such as entanglement and quantum discord, are in the detection of critical points of quantum phase transitions when the system is at finite temperatures. For that purpose we study several thermalized spin models in the thermodynamic limit, namely, the XXZ model, the XY model, and the Ising model, all of which with an external magnetic field. We compare the ability of quantum discord, entanglement, and some thermodynamic quantities to spotlight the quantum critical points for several different temperatures. Secondly, for some models we go beyond nearest-neighbors and also study the behavior of entanglement and quantum discord for second nearest-neighbors around the critical point at finite temperature. Finally, we furnish a more quantitative description of how good all these quantities are in spotlighting critical points of quantum phase transitions at finite T , bridging the gap between experimental data and those theoretical descriptions solely based on the unattainable absolute zero assumption.