Structural damage inspection is a key structural engineering technique that strives for ensuring structural safety. In this regard, one of the major intelligent approaches is the inverse analysis of structural damage using evolutionary computation. By considering the recent advances in this field, an efficient hybrid objective function that combines the global modal kinetic and modal strain energies is introduced. The newly developed objective function aims to extract maximum dynamic information from the structure and overcome noisy conditions. Moreover, the original methods are usually vulnerable to the associated high multimodality and uncertainty of the inverse problem. Therefore, the oppositional learning (OL) for population initialization and convergence acceleration is first adopted. Thereafter, the unified particle swarm algorithm (UPSO) mechanism is combined with another newly developed algorithm, the gradient-based optimizer (GBO). The new algorithm, called the oppositional unified particle swarm gradient-based optimizer (OL-UPSGBO), with the convergence acceleration feature of (OL), enhances balanced exploration-exploitation of UPSO, and the local escaping operator of GBO is designed to specifically deal with the complex inverse analysis of structural damage problems. To authenticate the performance of the OL-UPSGBO, the complex benchmark set of CEC 2017 is adopted to compare the OL-UPSGBO with several original metaheuristics. Furthermore, the developed approach for structural damage identification is tested using several damage scenarios in a multi-story frame structure. Results show that the developed approach shows superior performance and robust behavior when tackling the inverse analysis of structural damage.