Abstract. In the light of the hysteresis of video surveillance call video in public places, as well as the current video surveillance function of a single, in order to improve the real-time performance of monitoring, a detection method of human abnormal behavior based on optical flow method is proposed. The foreground regions of the video sequence is obtained by Vibe algorithm and update the background model adaptively; Regional markers for the future by the nearest neighbor method, accurately extract moving regions; Optical flow of moving region is calculated by Lucas-Kanada method; Weighted energy histogram is used to describe the abnormal changes of human behavior. The video sequences of different scenarios are simulated; the experimental results verify the effectiveness of the proposed method.