Object tracking is an important task within the field of computer vision. There are two key steps in video analysis: detection of interesting moving objects and tracking of such objects from frame to frame. Mean shift object tracking algorithm is a feature based algorithm.In this paper color information of object are extracted as well as texture information is also extracted by using local binary pattern technique to represent the object. In joint color-texture histogram region of interest is extracted and then edges and corners are extracted from the region of interest. Color histogram is insensitive to nondeformation and partial occlusion but it does not perform well when in case of color aberration. To overcome this drawback Local Binary Pattern method is used. This feature makes this algorithm more efficient in comparison of color histogram algorithm.