In today's global climate crisis, energy-efficient building design is crucial for achieving energy efficiency, environmental sustainability, and resident well-being. However, traditional architectural design is difficult to solve complex multi-objective and multivariate optimization problems. To overcome these challenges, this study proposes a solution: a strategy that combines decomposed multi-objective and agent assisted modeling. The proposed method decomposes complex architectural design problems into multiple manageable sub problems, with each sub problem optimized for a specific design objective. This method effectively simplifies the problem structure, allowing each subproblem to explore its solution space more focused and in-depth. Meanwhile, by combining proxy assisted modeling and utilizing proxy models to approximate actual physical processes or performance evaluations, the computational cost is reduced and the optimization process is accelerated. This study indicates that the improved multi-objective backbone particle swarm optimization algorithm relies on adaptive perturbation factors, with an average measured super volume of 29311 for one bedroom buildings and 49504 for three bedroom buildings. For the same building type, the average volume measurements of the multi-objective particle swarm optimization algorithm assisted by the decomposed surrogate model are 21153 and 40230, respectively. The proposed method effectively addresses complex multi-objective optimization problems in the field of building energy efficiency design, simplifies the problem structure, reduces computational costs through surrogate models, accelerates the optimization process, improves energy efficiency, and can support building construction to better cope with the challenges of climate change.