Abstract. By construction, a video is a series of ordered frames, whose order is dened at the time of the acquisition process. Background subtraction methods then take this input video and produce a series of segmentation maps expressed in terms of foreground objects and scene background. To our knowledge, this natural ordering of frames has never been questioned or challenged. In this paper, we propose to challenge, in a prospective view, the natural ordering of video frames in the context of background subtraction, and examine alternative time orderings. The idea consists in changing the order before background subtraction is applied, by means of shuing strategies, and re-ordering the segmentation maps afterwards. For this purpose, we propose several shuing strategies and show that, for some background subtraction methods, results are preserved or even improved. The practical advantage of time shuing is that it can been applied to any existing background subtraction seamlessly.