The characteristics of optical fiber MEMS pressure sensors are easily affected by temperature, so effective temperature compensation can improve the accuracy of the sensor. In this paper, the temperature characteristics of optical fiber MEMS pressure sensors are studied, and a temperature compensation method by converting the wavelength is proposed. The influence of target temperature and data point selection on the compensation effect is studied, and the effectiveness of the method is verified by the temperature compensation of sensors before and after aging. When the converted target temperature is 25 °C, the pressure measurement accuracy of the sensor is improved from 1.98% F.S. to 0.38% F.S. within the range of 5–45 and 0–4 MPa. The method proposed in this paper can not only improve the accuracy but also make the regular calibration more operable.