Nowadays, the buildings have an important role on high demand of electricity energy. Therefore, the energy management of the buildings may have significant influence on reducing the electricity consumption. Moreover, Electric Vehicles (EVs) have been considering as a power storage devices in Smart Buildings (SBs) aiming to reduce the cost and consuming energy. Here, an energy management framework is proposed in which by considering the flexibility of the contracted power of each apartment, an optimal charging-discharging scheduled for EVs and Battery Energy Storage System (BESS) is defined over long time period to minimize the electricity cost of the building. The proposed model is design by a Mixed Binary Linear rogramming formulation (MBLP) that the charging and discharging of EVs as well as BESS in each period is treated as binary decision variables. In order to validate the model, a case study involving three scenarios are considered. The obtained results indicate a 15% reduction in total electricity consumption cost and consumption energy by the grid over a one year. Finally, the impact of capacity and charge/discharge rate of BESS on the power cost is analyzed and the optimal size of the BESS for assumed SB in the case study is also reported.