It has been identified that the inertial system is not a completely observable system in the absence of maneuvers. Although the velocity errors and the accelerometer bias in the vertical direction can be solely observable, other error states, including the attitude errors, the accelerometer biases in the east and north directions, and the gyro biases, are just jointly observable states with velocity measurements, which degrades the estimation accuracy of these error states. This paper proposes an innovative method to improve the system observability for a Micro-Electro-Mechanical-System (MEMS)-based Inertial Navigation System (INS) in the absence of maneuvers by rotary motions of the Inertial Measurement Unit (IMU). Three IMU rotation schemes, namely IMU continuous rotation about the X, Y and Z axes are employed. The observability is analyzed for the rotating system with a control-theoretic approach, and tests are also conducted based on a turntable to verify the improvements on the system observability by IMU rotations. Both theoretical analysis and the results indicate that the system observability is improved by proposed IMU rotations, the roll and pitch errors, the accelerometer biases in the east and north directions, the gyro biases become observable states in the absence of vehicle maneuvers. Although the azimuth error is still unobservable, the enhanced estimability of the gyro bias in the vertical direction can effectively mitigate the azimuth error accumulation.