The modulation transfer function (MTF) serves as a crucial technical index for assessing the imaging quality of remote sensing cameras, which is integral throughout their entire operational cycle. Currently, the MTF evaluation of remote sensing cameras primarily relies on the slanted-edge method. The factors influencing the slanted-edge method’s effectiveness are broadly classified into two categories: algorithmic factors and image factors. This paper innovatively comprehensively analyzes the influencing factors of the slanted-edge method and proposes an improved slanted-edge method to calculate the MTF testing method of remote sensing cameras, which is applied to the MTF testing of remote sensing cameras. Since the traditional algorithm can only be applied in the small angle situation, this paper proposes a new method of slanted-edge method test calculation based on the optimal oversampling rate (OSR) adaptive model of the slanted edge and uses simulation experiments to verify the reliability of the algorithm model through the deviation of the slanted-edge angle calculation and MTF measurement, and the results show that the algorithm improves the accuracy of the MTF measurement compared with the ISO-cos and OMINI-sine methods. Then, the effects of the slanted-edge angle, image region of interest (ROI), as well as image contrast and signal-to-noise ratio (SNR) on the accuracy of the MTF calculation by the slanted-edge method were quantitatively analyzed as the constraints of the slanted-edge method test. Based on the laboratory target experiment, the algorithm flow and various influencing factors obtained in the simulation stage are verified, and the experimental results are more consistent with the various test results obtained in the simulation stage. Consequently, the slanted-edge method introduced in this paper is applicable for future remote sensing camera MTF testing. This approach offers a valuable reference for on-orbit focusing, satellite operational condition monitoring, lifespan estimation, and image restoration.