Smart building is the result of the penetration of information technology and control technology into traditional buildings, and is the future development direction of buildings. User-centric building smart design can achieve a sustainable life, and smart technology integration based on smart design can support sustainable development and improve user satisfaction, happiness, and overall quality of life. In intelligent design, researchers focus on the “people-oriented” approach, designed to bring users the ultimate interactive experience. Based on the interactive experience principle of smart design in the smart building system, this article classifies and summarizes intelligent design from the “five senses” interaction, including visual interaction, voice interaction, tactile interaction, cognitive interaction, and emotional interaction. We analyze the application of smart design in architecture and discuss how to embody the principles of user-centered interactive experience design in the process of smart design. This article provides a comprehensive and systematic literature review, clarifies the importance of the “people-oriented” approach in the smart design of buildings, and summarizes how to improve the sustainability of intelligent buildings from the perspective of a “people-oriented” approach. This paper proposes future research suggestions and directions and promotes the sustainable development of the smart building.