Photodetectors are essential optoelectronic devices that play a critical role in modern technology by converting optical signals into electrical signals, which are one of the most important sensors of the informational devices in current “Internet of Things” era. Two-dimensional (2D) material-based photodetectors have excellent performance, simple design and effortless fabrication processes, as well as enormous potential for fabricating highly integrated and efficient optoelectronic devices, which has attracted extensive research attention in recent years. The introduction of spontaneous polarization ferroelectric materials further enhances the performance of 2D photodetectors, moreover, companying with the reduction of power consumption. This article reviews the recent advances of materials, devices in ferroelectric-modulated photodetectors. This review starts with the introduce of the basic terms and concepts of the photodetector and various ferroelectric materials applied in 2D photodetectors, then presents a variety of typical device structures, fundamental mechanisms and potential applications under ferroelectric polarization modulation. Finally, we summarize the leading challenges currently confronting ferroelectric-modulated photodetectors and outline their future perspectives.