PurposeAs an advanced calculation methodology, reliability-based multidisciplinary design optimization (RBMDO) has been widely acknowledged for the design problems of modern complex engineering systems, not only because of the accurate evaluation of the impact of uncertain factors but also the relatively good balance between economy and safety of performance. However, with the increasing complexity of engineering technology, the proposed RBMDO method gradually cannot effectively solve the higher nonlinear coupled multidisciplinary uncertainty design optimization problems, which limits the engineering application of RBMDO. Many valuable works have been done in the RBMDO field in recent decades to tackle the above challenges. This study is to review these studies systematically, highlight the research opportunities and challenges, and attempt to guide future research efforts.Design/methodology/approachThis study presents a comprehensive review of the RBMDO theory, mainly including the reliability analysis methods of different uncertainties and the decoupling strategies of RBMDO.FindingsFirst, the multidisciplinary design optimization (MDO) preliminaries are given. The basic MDO concepts and the corresponding mathematical formulas are illustrated. Then, the procedures of three RBMDO methods with different reliability analysis strategies are introduced in detail. These RBMDO methods were proposed for the design optimization problems under different uncertainty types. Furtherly, an optimization problem for a certain operating condition of a turbine runner blade is introduced to illustrate the engineering application of the above method. Finally, three aspects of future challenges for RBMDO, namely, time-varying uncertainty analysis; high-precision surrogate models, and verification, validation and accreditation (VVA) for the model, are discussed followed by the conclusion.Originality/valueThe scope of this study is to introduce the RBMDO theory systematically. Three commonly used RBMDO-SORA methods are reviewed comprehensively, including the methods' general procedures and mathematical models.