The use of polymer-modified binders in asphalt concrete makes it possible to increase the efficiency and durability of highways. However, at present, there is an important and unresolved problem in this area, making it impossible to fully exploit the potential of modified binders. This is a tendency of aging processes that leads to the premature destruction of the pavement. In many literary sources, it is reported that reasons are related to the peculiarity of the chemical composition and occur at the submicron level. Therefore, the influence of single-walled carbon nanotubes has been studied for a better understanding of aging processes. The aging processes of the RTFOT (rolling thin film oven test) and PAV (pressure aging vessel) modified with SBS (styrene–butadiene–styrene) polymer, single-walled carbon nanotubes, and waste industrial oil were simulated in a laboratory furnace. Microstructural features were studied using the method of infrared spectral analysis. The dependences of viscoelastic properties on the component composition of binders were investigated. The optimal content of single-walled carbon nanotubes (0.001%), SBS (styrene–butadiene–styrene) polymer (3.5%), and waste industrial oil (4%) in the binder composition was established, which synergistically improved the performance of the modified binder from PG (52-22) (performance grade) to PG (64-34). It was established that single-walled carbon nanotubes provide improvement in the durability parameter ∆Tc binder by 150%, improved relaxation properties at low temperatures, and resistance to fatigue damage.