Due to the limitations of infrared instrument sampling window size and shooting distance, collection of largescale target often need multiple filming and multiple infrared image stitching. Since infrared image blur itself, the image stitching process exists the difficulty of feature points extraction and matching points confirmation. Faced with this problem we proposed an image stitching algorithm based on immune memory clonal selection. We improved Susan algorithm to extract feature points, and got matching points by the proposed algorithm. Simulation results show that the algorithm can obtain a high rate of matching points, so as to achieve a good performance.