Many domain adaptation (DA) approaches have been developed to address the challenge of domain divergence in cross-domain fault diagnosis. However, most of them only attempt to align statistical distribution while neglecting geometric alignment between source and target data. Furthermore, the use of some unreliable pseudo-labels may cause geometrical and statistical distributions mismatching and interfere with the DA model generating correct pseudo-labels during the iterative learning. In this paper, we propose a new model called discriminative subspace embedded dynamic geometrical and statistical alignment based on pseudo-label correction (DSDGSA-PC) for bearing fault diagnosis. Firstly, discriminative subspace alignment is proposed to mitigate feature redundancy and divergence by generating aligned subspaces for two domains, while preserving class discriminative information and global structures of data. Then, DSDGSA-PC leverages the representer theorem and the principle of structural risk minimization (SRM) to learn a domain-invariant classifier in the subspace, while minimizing statistical and geometrical shift by jointly optimizing dynamic graph embedding and dynamic weighted distribution alignment strategies. Finally, a novel pseudo-label correction mechanism is integrated into DSDGSA-PC to evaluate the credibility of pseudo-labels and rectify the unreliable ones during the iterations. The experimental results illustrate that DSDGSA-PC has higher transfer performance compared to several advanced methods on 24 transfer tasks.