Safe and effective construction management requires tools for reducing delays, eliminating reworks, and avoiding accidents. Unfortunately, challenges still exist in current construction practices for enabling real-time interactions among project participants, field discoveries, and massive data. Extended reality (i.e., XR) could help to establish immersive and interactive virtual environments that enable real-time information exchange among humans, cyber processes, and physical environments during construction. However, limited studies have synthesized potentials, challenges, and scenarios of XR for ensuring construction safety and efficiency. This study provides a critical review that synthesizes XR in construction management. First, the authors used the PRISMA method to screen studies related to XR in construction management. Seventy-nine studies were selected and comprehensively analyzed. The authors conducted a bibliometric analysis to comprehend the spatiotemporal distributions of the selected studies. Then, the selected studies were classified into three categories: (1) progress control, (2) quality control, and (3) safety management. The authors also synthesized information for XR applications in various construction management scenarios and summarized the challenges related to XR applications. Finally, this review shed light on future research directions of XR for safe and effective construction management.