The objective of this research was to predict the fatigue behavior of polyetherimide-based composites loaded with short carbon fibers 200 μm long under cyclic loads. The weight fraction of the filler was 10, 20, and 30 wt.%, while the maximum stress in a cycle was 55, 65, and 75 MPa. A modified fatigue model based on the obtained experimental results and Basquin equation was developed. The novelty of the results is related to developing a model on the structure–property relationship, which accounts for both the maximum stress in a cycle and the carbon fiber content in the composites. In addition, an “algorithm” for designing such composites according to the fatigue life criterion was proposed. The approach to determine relationships between the composition, structure, and properties of PCMs described in this study can be applied to further expand the model and to improve its versatility in the use of other thermoplastic matrices and fillers. The results of this study can be applied for the design of composites for structural applications with designated fatigue properties.