In order to efficiently enhance the dark nighttime videos, the high-quality daytime information of the same scene is often introduced to help the enhancement. However, due to camera motion, the introduced daytime may not have exactly the same scene of the nighttime videos. Thus, the final fused moving objects may not produce reasonable results. In this paper, we make the following two contributions: 1. we propose a global motion estimation-based scheme to address the problem of scene differences between daytime and nighttime videos. 2. Based on this, we further propose an improved framework for nighttime video enhancement which can efficiently recover the unreasonable enhancement results due to scene differences. Experimental results show the effectiveness of the proposed algorithm. C 2011 Society of Photo-Optical Instrumentation Engineers (SPIE).