Shear wave elastography (SWE) is a potential tool to non-invasively assess cardiac muscle stiffness. This study focused on the effect of the orthotropic material properties and mechanical loading on the performance of cardiac SWE, as it is known that these factors contribute to complex 3D anisotropic shear wave propagation. To investigate the specific impact of these complexities, we constructed a finite element model with an orthotropic material law subjected to different uniaxial stretches to simulate SWE in the stressed cardiac wall. Group and phase speed were analyzed in function of tissue thickness and virtual probe rotation angle. Tissue stretching increased the group and phase speed of the simulated shear wave, especially in the direction of the muscle fiber. As the model provided access to the true fiber orientation and material properties, we assessed the accuracy of two fiber orientation extraction methods based on SWE. We found a higher accuracy (but lower robustness) when extracting fiber orientations based on the location of maximal shear wave speed instead of the angle of the major axis of the ellipsoidal group speed surface. Both methods had a comparable performance for the center region of the cardiac wall, and performed less well towards the edges. Lastly, we also assessed the (theoretical) impact of pathology on shear wave physics and characterization in the model. It was found that SWE was able to detect changes in fiber orientation and material characteristics, potentially associated with cardiac pathologies such as myocardial fibrosis. Furthermore, the model showed clearly altered shear wave patterns for the fibrotic myocardium compared to the healthy myocardium, which forms an initial but promising outcome of this modeling study.