With the speedy development of cellular users, conventional mobile network communications could not satisfy the requirements of rising traffic. The design of the user association approach should have the ability to balance the energy saving and traffic hotspot providence from the traffic cell sleeping system. Nevertheless, with the gradually rising denser deployment of small cells (SCs), the HetNets face novel challenges. This work aims to introduce a cell zooming (CZ) scheme that admits the EE traffic offloading. Thereby, the given model includes two phases, (i) energy efficient offloading: In this phase, appropriate traffic flow is predicted for the hybrid deep learning model that includes deep Q network (DQN) and reinforcement learning (RL). This prediction is related to the offload traffic from macrocell to small cell based on constraints like QoS and Energy, respectively. (ii) Cell zooming: After the prediction, adaptive CZ is preceded by an improved CZ factor with optimal threshold selection. For optimization, a new scaled bald eagle search optimization (SBESO) is used. The betterment of SBESO is established on throughput, SINR, and so forth.