Ultrasound-based thermometry requires a temperature-sensitive acoustic parameter that can be used to estimate the temperature by tracking changes in that parameter during heating. The objective of this study is to investigate the temperature dependence of acoustic harmonics generated by nonlinear ultrasound wave propagation in water at various pulse transmit frequencies from 1 to 20 MHz. Simulations were conducted using an expanded form of the Khokhlov-Zabolotskaya-Kuznetsov nonlinear acoustic wave propagation model in which temperature dependence of the medium parameters was included. Measurements were performed using single-element transducers at two different transmit frequencies of 3.3 and 13 MHz which are within the range of frequencies simulated. The acoustic pressure signals were measured by a calibrated needle hydrophone along the axes of the transducers. The water temperature was uniformly increased from 26 °C to 46 °C in increments of 5 °C. The results show that the temperature dependence of the harmonic generation is different at various frequencies which is due to the interplay between the mechanisms of absorption, nonlinearity, and focusing gain. At the transmit frequencies of 1 and 3.3 MHz, the harmonic amplitudes decrease with increasing the temperature, while the opposite temperature dependence is observed at 13 and 20 MHz.