Adaptive filtering has the advantages of real-time processing, small computational complexity, and good adaptability and robustness. It has been widely used in communication, navigation, signal processing, optical fiber sensing, and other fields. In this paper, by adding an interferometer with the same parameters as the signal interferometer as the reference channel, the sensing signal of the interferometric fiber-optic hydrophone is denoised by two adaptive filtering schemes based on the least mean square (LMS) algorithm and the normalized least mean square (NLMS) algorithm respectively. The results show that the LMS algorithm is superior to the NLMS algorithm in reducing total harmonic distortion, improving the signal-to-noise ratio and filtering effect.