Face recognition play a vital role in variety of applications from biometrics, surveillance, security, identification to the authentication. In this paper we design and implement a smart security system for restricted area where access is limited to people whose faces are available in the training database. First we are going to detect the face by detecting the human motion. Then face recognition is performed to determine the authority of the person to enter the sensitive area. At the same time, we track the coordinate of detected motion. Failing to recognize the face finally passes the estimated coordinate to anesthetic gun for targeting the intruder automatically. Experimental results demonstrate the effectiveness of proposed security system in order to restrict the unauthorized access and enhanced reliability by use of face recognition.