Video surveillance is currently one of the most active research topics in the computer vision community. During motion, the surveillance system can detect moving objects and identify them as humans, animals, vehicles. This strong interest is driven by a wide spectrum of promising applications in surveillance system such as Military security, Public and commercial security, etc. The model includes detection, feature extraction and recognition of people from image sequences involving humans. In proposed system frame differencing and Neural Network is used for moving object detection and recognition of human motion respectively. Experimental results show that human motion can be correctly classified. General TermsMotion detection and recognition