This research aims to prepare different antioxidant intercalated layered double hydroxides (LDHs) and compare the thermal oxidation and ultraviolet (UV) aging resistances of different modified asphalts. The ion exchange technique was used to intercalate three different antioxidants: 3-(3,5-di-tert-butyl-4-carboxyphenyl) propionic acid, antioxidant 1222, and sodium dibutyl dithiocarbamate (rubber accelerator TP) into the interlayer of LDHs. The morphology, structures, UV blocking, and free radical scavenging properties of different antioxidant intercalated LDHs were characterized, respectively. The effects of the anti-aging agents on the physical properties (penetration, softening point, ductility, and viscosity); rheological behaviors (complex modulus and phase angle); and functional groups (C=O and S=O) of asphalt both before and after thermal oxidation aging and UV aging were systematically investigated. The results of the crystal structure and functional group analysis show that the three different antioxidants can be successfully inserted into the interlayer of LDHs without destroying their layered structures. Antioxidant intercalated LDHs exhibit a remarkable capacity for absorbing UV rays, coupled with a moderate ability to reflect UV light. Moreover, the inclusion of antioxidants into the interlayers of LDHs confers upon them the ability to scavenge free radicals. After 2 h of reaction, the free radical scavenging rates of LDHs-3, LDHs-1222, and LDHs-TP were 57.7%, 35.6%, and 17.1%, respectively. With an increase in the content of the antioxidant intercalated LDHs, the performance of the modified asphalt varies, and 4% is the optimal content of the anti-aging agents. Asphalts with the three antioxidant intercalated LDHs all had favorable storage stability, and their physical and rheological properties were improved after aging compared to LDHs-modified asphalt. The LDHs-3-modified asphalt showed the best anti-ultraviolet aging effect, while LDHs-1222-modified asphalt showed the best anti-thermal oxidation aging effect. This research lays the foundation for developing aging-resistant asphalt and improving the durability of asphalt pavement.