On the price of complexity, the new video compression standard H.264 is more effective than MPEG-4 in compression. Aimed at the motion estimation problem in search rate, a directional search pattern and an improved cross diamond search algorithm which adopts many technologies including prediction of initial search point, suitable search pattern choosing and auxiliary search points are proposed in this paper. Simulation results demonstrate that the improved cross diamond algorithm can effectively enhance search rate under similar PSNR