A new background subtraction method was proposed for detecting baggage left in a crowded public space with high accuracy and high stability. Those properties came from the combination of an inter-frame subtraction method with a mode image one. The background was rapidly updated by the former and was also slowly changed by the latter. The combination of them enabled us to extract moving object with high accuracy. A newly added switching process eliminated pixels extracted as the moving object from the calculation for the mode values as the background. Thus, the background was kept while the object was extracting. The switching process was reset, when the difference between the observation and the background fell below a threshold. The proposed method was successfully applied to detecting a left bag.