Wind velocity is of great importance for weather monitoring, aviation hazard alerting, wind energy exploring, and etc. Doppler radar is widely used to measure wind under rainy condition by sensing the raindrops entrained by the background wind. However, the Doppler velocity, which is a reflection of the raindrops' velocity in radial direction, is not coincident with the background wind because of the strong inertia of raindrops. Efforts should be made to distinguish the difference between the raindrops' velocity and the background wind velocity. In this paper, we try to establish a relationship between the background wind velocity and the raindrops' velocity by introducing a definition of the raindrops' characteristic size, which is related to the velocity characterized by the strongest Doppler spectral component. It is found that the fusion of differential reflectivity and the depolarization ratio can serve as a good proxy for the estimation of the characteristic size. Simulation results for S/C/X band radars and radar measurements verify the good performance of the proposed retrieval model for the characteristic size, which lays a solid foundation for the retrieval of the background wind velocity.