Calculation and characterization of the whole process of internal microscopic damage to surface damage in red-bed soft rock is a theoretical research difficulty and an urgent need for engineering safety protection. However, the current study cannot accurately and directly correlate internal and external damage. Therefore, in this paper, a coupled tensor–DEM–FEM model is proposed to deal with surface damage by indoor triaxial test digital image processing (DIC), internal damage by FJM acoustic emission study, and internal and external damage by moment tensor correlation. The study demonstrates that the whole process damage process of the red-bed soft rock peak front can be divided into six distinct phases, with early damage beginning with the elastic phase; the local strain divergence value begins to spiral out of control during the period of crack acceleration development; the overall acoustic emission intensity distribution is in the range of [−8.5, −6.3] in two dimensions and in the range of [−11, −9] in three dimensions; the R were between −40 and 40, which corresponded to the results of the indoor tests. A model has been developed that allows a direct reflection of the whole damage process. The method can be used to better understand the disaster mechanism and guide engineering practice.