Concrete is the most commonly used construction material nowadays. With emerging cutting-edge technologies such as nanomaterials (graphene, carbon nanotubes, etc.), advanced sensing (fiber optics, computer tomography, etc.), and artificial intelligence, concrete can now achieve self-sensing, self-healing, and ultrahigh performance. The concept and functions of smart concrete have thus been partially realized. However, due to the wider application location (coastal areas, cold regions, offshore, and deep ocean scenarios) and changing climate (temperature increase, more CO2 emissions, higher moisture, etc.), durability monitoring (pH, ion penetration, carbonation, corrosion, etc.) becomes an essential component for smart concrete. Fiber optic sensors (FOS) have been widely explored in recent years for concrete durability monitoring due to their advantages of high sensitivity, immunity to harsh environments, small size, and superior sensitivity. The purpose of this review is to summarize FOS development and its application in concrete durability monitoring in recent years. The objectives of this study are to (1) introduce the working principle of FOS, including fiber Bragg grating (FBG), long-period fiber grating (LPFG), surface plasmon resonance (SPR), fluorescence-based sensors, and distributed fiber optic sensors (DFOS); (2) compare the sensitivity, resolution, and application scenarios of each sensor; and (3) discuss the advantages and disadvantages of FOS in concrete durability monitoring. This review is expected to promote technical development and provide potential research paths in the future for FOS in durability monitoring in smart concrete.