In this paper we propose a near real-time face detection system for smart home. The system is embedded in an interconnected home environment and enables intelligent servicing by automatic identification of users. The design attempts for the first time to realize face locating system on the FPGA platform using the method combined initiative infrared source with image difference. Through image difference process, the system obtains a difference image without background interference which takes the face as the main body. It can obtain the person face boundary by projecting the difference image in the horizontal and vertical direction.