Due to the poor performance of the traditional interpolation algorithms in terms of the video image scaling effect and the low algorithm complexity required by existing hardware implementations, a scaling algorithm based on wavelet reconstruction and polyphase filtering implementation is proposed. The method first extracts the pre-generated weight coefficients according to the scaling requirements that including scaled image quality, size, and processing speed. Furthermore, the filter coefficients are interpolated with the source image pixel points mapped by the target image through a polyphase filter. Moreover, the resulting interpolated image is selectively decomposed and reconstructed by Haar wavelet transform to generate super-resolution images. The experimental results show that the algorithm improves the scaling quality of the images both subjectively and objectively, while enhancing the processing speed of the images and achieving non-integer scaling.