Separation of microparticle in viscoelastic fluid is highly required in the field of biology and clinical medicine. For instance, the separation of the target cell from blood is an important prerequisite step for the drug screening and design. The microfluidic device is an efficient way to achieve the separation of the microparticle in the viscoelastic fluid. However, the existing microfluidic methods often have some limitations, including the requirement of the long channel length, the labeling process, and the low throughput. In this work, based on the elasticinertial effect in the viscoelastic fluid, a new separation method is proposed where a gradually contracted microchannel is designed to efficiently adjust the forces exerted on the particle, eventually achieving the high-efficiency separation of different sized particles in a short channel length and at a high throughput. In addition, the separation of WBCs and RBCs is also validated in the present device. The effect of the flow rate, the fluid property, and the channel geometry on the particle separation is systematically investigated by the experiment. With the advantage of small footprint, simple structure, high throughput, and high efficiency, the present microfluidic device could be utilized in the biological and clinical fields, such as the cell analysis and disease diagnosis.