Quasi-intermittent vibration assisted swing (QVASC) method was aimed to improve the cutting machinability of difficult-to-machine materials. Inherited the intermittent cutting characteristics of the elliptical vibration cutting (EVC) technology, this method reduces the impact of residual height on the machined surface quality. But there is still a lack of in-depth research on cutting force modeling of QVASC. Based on the conventional cutting force model, a cutting force prediction model in QVASC processing, which considers the time-variable characteristics of QVASC, adopts the non-equidistant shear zone model and regards the workpiece material properties, tool geometry, and cutting conditions as the input data are proposed in this paper. Using the micro-element method, the proposed model decomposed the cutting edge to calculate the cutting force and the cutting force value by superimposing them. It finally predicts the chip flow angle. Experimental results show that when the cutting velocity increases, the average cutting force and the Z -direction increases by 20%, the average cutting force and the Y direction decreases by 17%. The average cutting force along X direction remains unchanged; the depth of cutting became larger. Besides, the average cutting force X decreased by 18%, Y decreased 21%, and Z increased by 13%. As the feed rate increases, the X direction is increased by 26%, and the Z direction is reduced by 22%, while the cutting force in the Y direction is unchanged. After comparing and verifying the measured value and the predicted value, the minimum error of the prediction model reaches 4.01%, which validates the force model of QVACS.