The low-rank models have gained remarkable performance in the field of remote sensing image denoising. Nonetheless, the existing low-rank-based methods view residues as noise and simply discard them. This causes denoised results to lose many important details, especially the edges. In this paper, we propose a new denoising method named EPLRR-RSID, which focuses on edge preservation to improve the image quality of the details. Specifically, we considered the low-rank residues as a combination of useful edges and noisy components. In order to better learn the edge information from the low-rank representation (LRR), we designed multi-level knowledge to further distinguish the edge part and the noise part from the residues. Furthermore, a manifold learning framework was introduced in our proposed model to better obtain the edge information, as it can find the structural similarity of the edge part while suppressing the influence of the non-structural noise part. In this way, not only the low-rank part is better learned, but also the edge part is precisely preserved. Extensive experiments on synthetic and several real remote sensing datasets showed that EPLRR-RSID has superior advantages over the compared state-of-the-art (SOTA) approaches, with the mean edge protect index (MEPI) values reaching at least 0.9 and the best values in the no-reference index BRISQUE, which represents that our method improved the image quality by edge preserving.