Remanence is an important parameter of magnetic property for Nd-Fe-B magnets, and high remanent magnetization is a prerequisite for high-performance magnets. In this paper, the surface morphology perpendicular to the texture orientation direction and parallel to the texture orientation direction is analyzed by Nd-Fe-B permanent magnets with different compositions. For the first time, the relationship between the remanence of a magnet and the degree of texture orientation is explained in depth using the fractal dimension. The fractal dimension of surface morphology combined with the remanence equation yields the degree of texture orientation of the magnet, which is in agreement with the trend of the squareness factor of the demagnetization curves. Among the three samples, the Nd-Fe-B sample has the highest degree of texture orientation, the Pr-Nd-Fe-B sample has the lowest degree of texture orientation, and the Nd-Ce-Fe-B sample is in between the first two. The multiples of uniform (pole) density obtained by EBSD further prove the correctness of the degree of texture orientation calculated by the fractal dimension. The combination of EBSD morphology and fractal dimension to obtain novel insights into the correlation between remanence and the degree of texture orientation will contribute to the development of high-performance Nd-Fe-B with high remanence.