The attitude dynamics and orbit dynamics of large rigid space structures are coupled with each other under gravity gradient, which may affect the stability of the large rigid space structures. In this paper, the gravity gradient stability of a large rigid space structure is studied under both small and large disturbances. Based on the rigid body dynamics and orbit dynamics, an accurate dynamic model without any linearization of the large rigid space structure is established via the natural coordinate formulation (NCF), which is able to describe the large overall motions of the structures. By using the generalized-α algorithm, the gravity gradient stability of the large rigid space structure is simulated and analyzed via various examples, including the influence of large disturbance angles, the positions at the stabilization and unstabilization regions. Finally, the relationship between spinning stability and gravity gradient stability is also investigated via a large spinning space structure.