Tracking of basketball is studied. Firstly, the basketball object template and adaptive object model are established by using the basic characteristic of segmented basketball in the former frame. Then an improved block -matching algorithm is proposed for tracking the basketball. Finally, the edge of basketball is revised, and the mechanism for tracking validity is established.