This work proposes a sparse based representation for tracking multi object for the longer sequence of video frame. Object of interest are first identified and then represented with set of low dimensional feature covariance matrix. These feature of different object are kept in a dictionary. In order to classify the object, sparse based Orthogonal matching pursuit(OMP) algorithm is used. Furthermore, towards reducing the computational overhead, proposed model is implemented on a graphical processing unit enhanced with the multi threaded resource for parallelization of the task. Experimental results shows that proposed method out perform as compared with the state of art in identifying the objects.