The classical SURF algorithm has many disadvantages, such as high dimension of feature descriptor, large amount of computation, and low matching accuracy when the angle of rotation and angle of view is too large. To solve the above problems, an improved algorithm is proposed. Firstly, image preprocessing is carried out by image binarization, feature points are extracted by Hessian matrix, and then feature description is carried out by using circular neighborhood of feature points. Har wavelet response is used to establish descriptors for each feature point, and the normalized gray-level difference and second-order gradient in the neighborhood are calculated simultaneously to form a new feature descriptor. Finally, the RANSAC algorithm is used to eliminate the mismatch points. The algorithm does not Compared with the classical SURF algorithm, it has the advantage of speed, and makes full use of the gray level information and the detail information, so it has higher accuracy. Experimental results show that the algorithm has good robustness and stability to image blur, illumination difference, angle rotation, field of view transformation and so on. The algorithm is applied to remote sensing image stitching to obtain the stitched image with no obvious geometric shift and good edge connection. This algorithm is a kind of image registration algorithm with short time and high precision, which can meet the registration requirements of remote sensing image stitching.