Despite the superior properties of ceramic matrix composites (CMCs), their fabrication process generates inevitable defects with high density that significantly influence material integrity and residual useful life. Recent efforts have focused on CMC property prediction and investigation of their different inelastic mechanisms, but very limited work exists on understanding the influence of defects on inelastic responses of CMCs. Here, we introduce a three-dimensional micromechanics computational framework that includes experimentally informed material microstructure and architectural variabilities to investigate CMC response in the presence of manufacturing-induced defects. A developed microstructure generation algorithm is used to generate the representative volume elements in the micromechanics models from complex material morphology information obtained from extensive characterization studies of C/SiNC and SiC/SiNC CMCs. A fracture mechanics-informed matrix damage model is reformulated, in which the model considers the growth of porosity and microcracks in the as-received material. A progressive fiber damage model as well as Orthotropic viscoplasticity creep formulation are also utilized for the study. This methodology is implemented within the micromechanics framework to investigate the complex temperature- and time-dependent load transfer and damage mechanisms of CMCs under operation loading conditions. The developed framework explores the influence of as-received defects on the damage and creep behavior in service conditions. It also provides new insights into the effect of size, shape, distribution, and location of these defects on material response. The framework is then calibrated with unidirectional CMC minicomposite results available in the literature.