Electricity prices have increased significantly in Europe and other regions due to the recent energy crisis. Latent heat thermal energy storage (LHTES) implemented in residential heating systems has attracted attention for its role in peak/load shifting to reduce heating costs. A new layout with LHTES integrated with a heat pump (HP) is proposed here to store low grade heat during off-peak demand periods, later used as heat source for the heat pump during peak demand periods. This novel layout is assessed for its heat capacity variation and levelized cost of energy (LCOE). The results show that increased amount of power input is required when a storage component is integrated into the heating system, while it can be compensated by shifting to off-peak electricity usage.