An optimized scheme can improve the navigation accuracy of RINS without changing the inertial devices. In the multi-position stop scheme, the IMU remains stationary for most of the time, which makes motor control easier. However, the installation errors and the scale factor errors of FOG can cause platform misalignment after a certain angle of rotation around the horizontal axis, resulting in a velocity error. Continuous rotation can suppress time-varying errors better, which is of particular importance for FOG, but it can also increase the sawtooth error of the navigation output, and the error in the direction of rotation cannot be offset. To integrate the advantages of both rotation schemes, we propose an improved rotational modulation scheme for tri-axis RINS. In this scheme, the inner gimbal rotates in a two-position and four-order manner, while the middle and outer gimbals rotate continuously in the order of forward-reverse-reverse-forward. Simulation and navigation test results demonstrate that this improved rotational modulation scheme can effectively improve navigation accuracy by 50% and 25% compared with continuous rotation around the azimuth axis and a 16-position scheme with the same inertial devices, which is of great importance for RINS with FOG.