The thin-film organic solar cells (OSCs) are currently one of the most promising photovoltaic technologies to effectively harvest the solar energy due to their attractive features of mechanical flexibility, light weight, low-cost manufacturing, and solution-processed large-scale fabrication, etc. However, the relative insufficient light absorption, short exciton diffusion distance, and low carrier mobility of the OSCs determine the power conversion efficiency (PCE) of the devices are relatively lower than their inorganic photovoltaic counterparts. To conquer the challenges, the two-dimensional (2D) nanomaterials, which have excellent photoelectric properties, tunable energy band structure, and solvent compatibility etc., exhibit the great potential to enhance the performance of the OSCs. In this review, we summarize the most recent successful applications of the 2D materials, including graphene, black phosphorus, transition metal dichalcogenides, and g-C3N4, etc., adapted in the charge transporting layer, the active layer, and the electrode of the OSCs, respectively, for boosting the PCE and stability of the devices. The strengths and weaknesses of the 2D materials in the application of OSCs are also reviewed in details. Additionally, the challenges, commercialization potentials, and prospects for the further development of 2D materials-based OSCs are outlined in the end.