The paper deals with numerical analysis of the effect of stress state and loading direction with respect to the rolling direction on damage and fracture behavior of anisotropic metals. The continuum damage model has been enhanced to take into account the influence of production-induced anisotropies and loading direction on damage criteria and on evolution equations of damage strains. Constitutive parameters are determined using experimental results taken from tests with uni- and biaxially loaded specimens. The focus of the paper is on three-dimensional micro-mechanical numerical analyses of micro-defect-containing representative volume elements covering a wide range of stress states. These calculations lead to more insight in the different damage and failure processes on the micro-scale and their influence on the macroscopic damage laws. With the obtained numerical results it is possible to detect general trends, to propose governing equations for the damage criteria, to develop evolution equations for the damage strains, and to identify constitutive parameters of the anisotropic material model. It is shown that the anisotropic behavior and the loading direction with respect to the principal axes of anisotropy affect the evolution of damage mechanisms on the micro-level as well as the corresponding damage strains.