The rapid growth of renewable energy and electric vehicles (EVs) presents new development opportunities for power systems and energy storage devices. This paper presents a novel integrated Green Building Energy System (GBES) by integrating photovoltaic-energy storage electric vehicle charging station (PV-ES EVCS) and adjacent buildings into a unified system. In this system, the building load is treated as an uncontrollable load and primarily utilized to facilitate the consumption of surplus photovoltaic (PV) power generated by EVCS. First, a strategy for determining the maximum value of the energy storage system (ESS) capacity is presented. Subsequently, to coordinate the charging and discharging plans of ESS, and EVs, a bi-objective optimization model was established focusing on GBES power purchase costs and the load peak-valley difference. The proposed GBES efficiently utilizes the integrated energy system comprising charging stations and adjacent buildings, maximizing the use of photovoltaic energy and external power grids during low-cost periods. In experiments, we compare the proposed optimized charging strategy with the unordered charging case, the simulation results demonstrate that the proposed method for coordinating ESS and EVs charging can respectively reduce the cost of purchased power by 33.2% and the peak-to-valley difference in load by 47.6%.