With the recent dramatic growth of the building sector’s energy consumption to provide thermal comfort to consumers, the constraints of climate change and the scarcity of energy supplies have necessitated a wiser and more effective reduction in the amount consumed. As a result, phase change materials (PCMs) have attracted much interest as latent heat thermal storage systems in recent decades. This paper aims to explain the possibility of using PCMs in buildings by establishing an overall conceptual framework for the processes of selecting and integrating PCMs in building sector applications. Moreover, it leads to a comprehensive matrix that identifies the best and most common type of material for each building’s component, as well as its temperature and thickness properties, its thermal impact, and the most popular integration techniques. The findings show paraffin as the major used type in all building components, while salt hydrate is employed in facades. The most prevalent incorporating technique is macro-encapsulation, which prevails in most building components with its direct effect on cooling and heating applications.