This study explores the effects of trees on the acoustic and thermal environment in addition to people’s responses to trees in different contexts. Through field measurements conducted during the summer of 2023 at the campus of the Southwest University of Science and Technology in Mianyang, residents’ neutral points were locally found to be 52.2 dBA (acoustic) and 23.8 °C (thermal). Further, at their maximum, the trees were able to reduce heat stress by 4 °C (indicated by the physiologically equivalent temperature—PET) and the noise level by 10 dBA (indicated by the A-weighted sound pressure—LAeq); this was achieved by trees with a crown diameter of 20 m. Subjective acoustic and thermal responses varied depending on the context. Acoustically, their neutral LAeq values toward the sounds of traffic, teaching, sports, and daily life were 46.9, 52.5, 51.0, and 52.7 dBA, respectively. Thermally, pedestrians’ neutral PET values were 24.2, 26.1, 22.3, and 25.1 °C, respectively, under the same conditions. These phenomena might be a consequence of the effects of sound frequencies. Future urban forestry research should focus on planting for environmental quality improvement.