In this study, the response mechanism between macro- and microscales of deep hard-rock diorite is investigated under loading and unloading conditions. Moreover, the statistical theory is combined with particle flow code simulations to establish a correlation between unloading rates observed in laboratory experiments and numerical simulations. Subsequent numerical tests under varying confining pressures are conducted to examine the macroscopic mechanical properties and the evolution of particle velocity, displacement, contact force chain failures, and microcracks in both axial and radial directions of the numerical rock samples during the loading and unloading phases. The findings indicate that the confining pressure strength curve displays an instantaneous fluctuation response during unloading, which intensifies with higher initial confining pressures. This suggests that rock sample damage progresses in multiple stages of expansion and penetration. The study also reveals that with increased initial confining pressure, there is a decrease in particle velocity along the unloading direction and an increase in particle displacement and the number of contact force chain failures, indicating more severe radial expansion of the rock sample. Furthermore, microcracks predominantly accumulate near the unloading surface, and their total number escalates with rising confining pressure, suggesting that higher confining pressures promote the development and expansion of internal microcracks.