In recent years, object detection and tracking has been a dynamic research area. Rapid development of the multimedia and the associated technologies urge the processing of a huge database of video clips. The processing efficiency lies on the search methodologies utilised in the video processing system. Usage of unsuitable search methodologies may make the processing system ineffective. Hence, effective object detection and tracking system is an essential criterion for searching relevant videos from a huge collection of videos. This paper proposes a unique object detection and tracking system where video segmentation, feature extraction, object detection and tracking are combined perfectly using various features. Initially, the database video clips are segmented into different shots before performing the feature extraction process. The proposed system consists of two stages, namely, feature extraction and tracking of object in the video clips. In the feature extraction stage, firstly, colour feature is extracted based on colour quantisation. Next, edge density feature is extracted for the objects present in the query video. Then, the texture feature is extracted based on LGXP technique. Finally, based on these feature extracted, the object will be detected and the detected objects will be tracked by utilising both forward and backward tracking technique. The proposed methodology proved to be more effective and accurate in object detection and tracking.