Due to the excellent designability of carbon fiber components, the grinding wheel matrix made of carbon fiber-reinforced polymer (CFRP) would show quasi-isotropic, orthotropic, or more complex forms, through changing the layer angle, stack method, and other approaches to modify the layup structures. At present, the researches on CFRP grinding wheel matrixes mainly focused on the performance advantages compared with grinding wheels formed by traditional materials. The structural studies were relatively lacking. In this paper, the theoretical formulas were developed to analyze the stress state and strain relation of different layup structural matrixes, and the formulas were verified by finite element models. The choice of layup structures resulted in different stress distributions and deformation degrees, which was related to the ratio ([Formula: see text]) of tangential modulus to radial modulus of whole matrix. Two typical layup structures, quasi-isotropic laminated layup structure ([Formula: see text] = 1) and orthotropic winding layup structure ([Formula: see text] = 16), were proposed for detailed exploration. An ideal model of the composite matrix consisted of multi-layup structures was established, which was improved on the single laminated layup structure. The stress in the inner ring had been effectively reduced, the phenomenon of stress corrugated concentration was alleviated, and the deformation was decreased slightly.