Virtual fitting technology is widely used in many fields, such as e-commerce, garment computer-aided design, and film and game production. Cloth modeling and simulation play an important role in virtual fitting. The realism and simulation speed directly affect the user experience and visual appearance. This paper first reviews the history of cloth modeling and simulation methods. Then, it focuses on four perspectives: yarn-structure modeling of the cloth modeling level; multi-resolution grid simulation; the relation between human posture and cloth deformation; and collision problems of the cloth simulation level. Yarn-structure modeling considers a unit cell that incorporates the physical characteristics of the fabric and the fabric structure. A multi-resolution grid can integrate techniques from different research fields and may achieve a breakthrough in cloth modeling. Generative adversarial networks (GANs) have potential for dealing with the relation between human posture and cloth deformation by comparing several typical algorithms with GANs. Solving the collision and friction problem depends on choosing the right envelope box for refining the human body surface. Finally, the paper concludes with an analysis of future research trends that could improve the fidelity and speed of a simulation. The paper may serve as a reference for research into cloth modeling and simulation for virtual fitting.