The paper presents a theoretical and experimental study of the influence of damage accumulation in composite material on the elastic fourth-rank tensor and on the strength under quasi-static, cyclic and dynamic loads. Layered polymer composites (glass or carbon fiber-reinforced plastic) are considered. This work aims to develop a mathematical model that accounts for the impact of damage in the composite material on the fourth-rank tensor of elastic properties. The constitutive relations for an orthotropic composite material are proposed, taking into account the accumulation of damage during tensile or shear loading. A numerical simulation using the finite element method is done for a periodicity cell for composite variants (unidirectional, layered, etc.) to determine the effective elastic properties. Quasi-static loading experiments were conducted on composite samples (carbon plastic) to validate the model and the degradation of elastic properties was determined by measuring the longitudinal sound speed. The full-scale experiments confirmed that damage accumulation in carbon fiber-reinforced plastic leads to the degradation of its effective elastic properties. In this connection, a technique was developed to take into account irreversible damage in an orthotropic composite material through the components of the ductility tensor, which may be helpful for the design and analysis of composite structures. The findings of the study could help with the creation of new materials with enhanced mechanical characteristics, as well as with raising the quality of already-existing materials. The developed mathematical model of orthotropic composite material can be used to enhance the structural strength properties and boost the application safety in a variety of industry.