The construction sector can be identified as one of the highest energy-consuming industries in the world. The energy usage of the construction, operation, and maintenance stages is significant due to the complex nature of the industry. However, energy is one of the most undervalued resources in terms of efficiency and conservation in the construction stage. Higher energy usage and energy wastage in construction sites can be identified as significant matters, and various energy efficiency measures have massive potential for saving energy during the construction stage. Accordingly, this paper aims to investigate the sustainable use of energy practices on construction sites in Sri Lanka. A comprehensive literature review was conducted to identify principles and practices of sustainable use of energy, energy-using activities, processes, and the most applicable energy efficiency measures. The research aim was achieved through a qualitative research approach, and four case studies on building construction projects were conducted within the Colombo district. The case boundary of the study is defined as high-rise building sites. Semi-structured interviews, site observation, and document reviews were carried out as data collection techniques within each case. The collected data were analysed using manual content analysis. Key findings revealed how to use energy sustainably, what are the current energy sources and alternative sources available, construction activities and equipment used in the construction process, and reduce energy wastage by using energy efficiency measures. Rework, and workers’ behaviour highly affects the energy wastage on the site. Lack of planning, lack of information, limited space, and poor responses from the construction organisation were identified as the most relevant barriers that influence sustainable energy use on construction sites. The proposed recommendations for improving the sustainable use of energy should be adopted at the project level. Measures exceeding the scope of site management, industry-level support, and policy intervention are required.