Winter presents an immense challenge for survival, yet temperate ectotherms have remarkable adaptations to physiologically compensate for these challenges. Such mechanisms are especially relevant under recent climate change where responses to warmer winters might negatively affect populations. While there is growing evidence of thermal physiological adaptations and population divergence in response to contemporary warming from the growing season, the impact of warming on overwintering ectotherms is less clear. To address this knowledge gap, we use a common garden experiment with urban and rural populations of the acorn ant, Temnothorax curvispinosus, to explore divergence in thermal physiological traits assessed following winter acclimation. Specifically, we use the thermal gradient of the urban heat island to assess population divergence in cold tolerance (chill coma recovery), metabolic rate, thermal sensitivity of metabolic rate, heat tolerance and colony demographics. Our results show there was no evidence of evolutionary divergence in low-temperature performance (chill coma recovery, metabolic rate at either of two test temperatures (4 and 10 °C) or acute thermal sensitivity of metabolic rate) among urban and rural colonies which differs from previous tests of warm-season acclimated ants. In contrast, we found winter-acclimated urban ants exhibited higher heat tolerance than rural ants with a magnitude of difference similar to growing season tests. These findings indicate that acclimation under overwintering conditions might dampen the expression of urban-rural population divergence in some thermal physiological traits and broadly suggest the potential importance of retaining at least some components of low-temperature physiology when evolving to urban heat islands and contemporary warming.