Object tracking using vision technology is one of the important and complex functions in computer vision. It should become more challenge in case of there are partial occlusions and significant clutter. A mean shift procedure embedded approach for vehicle and pedestrian tracking under real road scenes is presents. A combined hue and saturation of HSI color model and local orientation information are extracted and constructed to represent the target features since it is more robust to illumination than only RGB color space. The mean shift procedure is employed to fast searching the mode of the potential object in a neighborhood of current video sequence. Meanwhile, a global motion compensation is considered for improve the robust and real-time of the tracking procedure. Some examples are investigated and used to evaluate the proposed approach. Experimental results demonstrate that the proposed approach is robust and validate in complicated real scenes.