Direct electricity is widely used for heating purposes in Norway, leading to significant strain on the electricity grid during the heating season. Conversion to 4th generation district heating (4GDH) is an effective method for reducing the need for large investments in the electricity grid, while simultaneously improving the energy efficiency of district heating systems. This article evaluates the possibility of reducing the supply temperature in existing Norwegian apartment blocks by improving the thermal envelope and reducing the temperature levels for the heating system. The analysis is based on simulations in IDA ICE (IDA Indoor Climate and Energy) focusing on whether the reduced supply temperature guarantees thermal comfort in the building, considering the coldest room with a heating setpoint of 22 °C. Based on a recommended minimum acceptable indoor temperature of 19 °C from the Norwegian building regulations (TEK), it should be possible to lower the radiator supply temperature from 80 to 60 °C for apartment blocks newer than 1971. For older buildings, an “intermediate” renovation is necessary to maintain temperatures above 19 °C, however, a “standard” renovation is recommended to ensure thermal comfort and improve the energy efficiency of the building stock.