Railway infrastructures have played a critical role to ensure the continuity of goods and passenger transportation in China. Under extreme loading and environmental conditions, railway structures are vulnerable to deterioration and failure, leading to the interruption of the whole transportation system. Several techniques have been used for the health monitoring of railway structures. Optical fiber sensors are the widely recognized technique due to their inherent advantages such as high sensitivity, anti-electromagnetic interference, light weight, tiny size, corrosion resistance, and easy integration and network configuration. This paper provides a state-of-the-art of optical fiber sensing technologies and their practical application in railway infrastructures. In addition, the strain transfer analysis of optical fiber sensors is described for parameter reflection. A smart concept for artificial intelligence contribution is also declared. Finally, existing and future prospects on smart concept-based optical fiber sensors for railway infrastructure are discussed. The study can provide useful guidance to understand the problems in artificial intelligence which contributed to the Structural Health Monitoring system of railway structures.