In this paper, median filter algorithm and motion vector compensation algorithm is researched. We design and implement the algorithms on the FPGA board in detail. According to the tests and experiments, we verify the practicability of the algorithms on FPGA and video surveillance system. The algorithms will effectively increase the efficiency of late video signal processing and help the application of video enhance.