How to achieve competitive accuracy and less computation time simultaneously for background estimation is still an intractable task. In this paper, an effective background subtraction approach for video sequences is proposed based on a sub-superpixel model. In our algorithm, the superpixels of the first frame are constructed using a simple linear iterative clustering method. After transforming the frame from a colour format to gray level, the initial superpixels are divided into K smaller units, i.e. sub-superpixels, via the k -means clustering algorithm. The background model is then initialized by representing each sub-superpixel as a multidimensional feature vector. For the subsequent frames, moving objects are detected by the sub-superpixel representation and a weighting measure. In order to deal with ghost artifacts, a background model updating strategy is devised, based on the number of pixels represented by each cluster center. As each superpixel is refined via the sub-superpixel representation, the proposed method is more efficient and achieves a competitive accuracy for background subtraction. Experimental results demonstrate the effectiveness of the proposed method.