In this research work, a symmetrical four-capacitance loaded complementary circular split ring resonator is proposed, which uses an ultra-thin Zinc Selenide (ZnSe) substrate to realize a low-profile triple-band metamaterial (MTM) perfect absorber for application in the terahertz (THz) frequency range. The electromagnetic properties of the proposed structure were calculated and investigated using the Finite Integration Technique (FIT). The proposed structure exhibited three highly absorptive (nearly perfect) peaks at the resonance frequencies of 15.68 THz, 37.48 THz, and 39.55 THz. Furthermore, the absorber was found to be insensitive to the polarization and incident wave angles, due to its symmetrical design. The effects of the conductor type, substrate thickness, unit cell dimension, resonator gap, and substrate type on the reflection and absorption spectra were investigated. To validate the numerical results, the proposed design was analyzed using High-Frequency Simulation Software (HFSS) and Advanced Design System (ADS). The surface current, electric field, and magnetic field distributions at the three-resonance frequency were analyzed. It was concluded that the overall performance of the proposed MTM structure was superior compared to those reported in the literature. The proposed design could be a good candidate for application in stealth technology, imaging, and thermal energy harvesting.