Large-eddy simulation (LES) and Detached-eddy simulation (DES) were applied to a simple cavity model to calculate the wind buffeting noise respectively. The results were verified by wind tunnel experiments. The results show that LES is more suitable for wind buffeting noise calculation. LES method was employed to calculate automobile side-window buffeting noise. The correctness of results was validated by a road test. In this paper, the acoustically calculated sound pressure level (SPL) spectral curve is used as the initial signal of the acoustic post-processing. Four psychoacoustic objective parameters namely: loudness, sharpness, roughness and fluctuation were obtained by using Matlab R2016a to compile the calculation process. Sound quality evaluation (SQE) of the vehicle is performed via most frequently used SPL and four calculated vehicle comfort index. It can be concluded that with the increase of driving velocity, SPL and loudness show an increasing trend, while roughness, sharpness and fluctuation present a decreasing trend. It can be also summarised that with the increase of window opening degree, SPL and loudness show an increasing trend, sharpness presents a decreasing trend, and roughness and fluctuation display the trend of ups and downs. The main original contribution of this paper is the accurate calculation of wind buffeting noise and the summary of the changing rule of SPL, loudness, roughness, sharpness and fluctuation with the variation of velocity and window opening degree.