Recycling of the waste rubber tire crumbs (WRTCs) for the concretes production generated renewed interest worldwide. The insertion of such waste as a substitute for the natural aggregates in the concretes is an emergent trend for sustainable development towards building materials. Meanwhile, the enhanced resistance of the concrete structures against aggressive environments is important for durability, cost-saving, and sustainability. In this view, this research evaluated the performance of several modified rubberized concretes by exposing them to aggressive environments i.e., acid, and sulphate attacks, elevated temperatures. These concrete (12 batches) were made by replacing the cement and natural aggregate with an appropriate amount of the granulated blast furnace slag (GBFS) and WRTCs, respectively. The proposed mix designs’ performance was evaluated by several measures, including the residual compressive strength (CS), weight loss, ultrasonic pulse velocity (UPV), microstructures, etc. Besides, by using the available experimental test database, an optimized artificial neural network (ANN) combined with the particle swarm optimization (PSO) was developed to estimate the residual CS of modified rubberized concrete after immersion one year in MgSO4 and H2SO4 solutions. The results indicated that modified rubberized concrete prepared by 5 to 20% WRTCs as a substitute to natural aggregate, provided lower CS and weight lose expose to sulphate and acid attacks compared to control specimen prepared by ordinary Portland cement (OPC). Although the CS were slightly declined at the elevated temperature, these proposed mix designs have a high potential for a wide variety of concrete industrial applications, especially in acid and sulphate risk.