Image sequence prediction is widely used in image compression and transmission schemes such as differential pulse code modulation. In traditional predictive coding, linear predictors are usually adopted for simplicity. The nonlinear Volterra predictor can be employed as an alternative to linear predictors to compensate for the nonstationary and non-Gaussian nature of image sequences. Although the Volterra predictor avoids the smoothing effects introduced by linear predictors, it generally amplifies noise contamination present in the images. In this letter, we propose a nonlinear polynomial weighted median (PWM) predictor for image sequence. The proposed PWM predictor is more robust to noise, while still retaining the information of higher order statistics of pixel values. Experimental results illustrate that the PWM predictor yields good results in both high and low motion video. It is especially suitable for high motion sequence in noisy case. The proposed scheme can be incorporated in new predictive coding systems.