The significant ill-performances, challenges, and increasing competition within the construction sector are generating tremendous changes. One such revolution is the transition towards offsite construction (OSC). Although a plethora of studies has expounded the virtues and benefits of the approach, a holistic review and conceptual framework of the drivers of OSC is not well-established. This research draws on a multistage methodological framework of a systematic literature review, plenary discussions, and the total interpretive structural modelling (TISM) approach to build a holistic conceptual framework for the drivers of OSC. A review of 32 empirical studies distributed across four continents resulted in the extraction of 86 drivers. The 86 drivers were grouped into time, cost, quality, productivity, innovative competitiveness, market, sustainability, and policy clusters of drivers drawing on previous classifications in empirical studies. The TISM modeling revealed three hierarchical levels of the drivers, comprising dependent, linkage, and independent drivers. Based on an MICMAC analysis, “innovative competitiveness” and “sustainability” have the highest driving powers and lowest dependences, suggesting their prime significance in the adoption of OSC. Thus, this research provides a broader perspective of the drivers and may help OSC practitioners and policymakers to gain a better understanding of the ecosystem of the drivers.