Environmental concerns and growing energy costs raise the importance of sustainable development and energy conservation. The building sector accounts for a significant portion of total energy consumption. Passive cooling techniques provide a promising and cost-efficient solution to reducing the energy demand of buildings. Based on a typical residential case in Hong Kong, this study aims to analyze the integration of various passive cooling techniques on annual and hourly building energy demand with whole building simulation. The results indicate that infiltration and insulation improvement are effective in regard to energy conservation in buildings, while the effectiveness of variations in building orientation, increasing natural ventilation rate, and phase change materials (PCM) are less significant. The findings will be helpful in the passive house standard development in Hong Kong and contribute to the further optimization work to realize both energy efficiency and favorably built environments in residential buildings.