In practical mechanical components, the characteristic of geometric discontinuous generates non‐uniform energy field near the notch, which affects the local damage evolution process of the notched specimens. Therefore, it is particularly crucial to formulate a parameter that can characterize such inhomogeneous state distribution. First, a strain energy density gradient factor is introduced to describe the complexity of strain energy density distribution near the notch. Meanwhile, a size effect factor is given considering the strain energy gradient factor and notch geometry parameter. Then, taking into account the impact of phase difference, a direct damage parameter considering non‐proportionality of different multiaxial load levels is developed. Furtherly, the modified strain energy density parameter is determined. Finally, the comparison between the proposed model and the other three models emphasizes the advantages of the model.