Herein, we firstly demonstrate the design and the proof-of-concept use of a capillary-driven surface-enhanced Raman scattering (SERS)-based microfluidic chip for abrin detection. The micropillar array substrate was etched and coated with a gold film by microelectromechanical systems (MEMS) process to integrate into a lateral flow test strip. The detection of abrin solutions of various concentrations was performed by the as-prepared microfluidic chip. It was shown that the correlation between the abrin concentration and SERS signal was found to be linear within the range of 0.1 ng/mL to 1 μg/mL with a limit of detection of 0.1 ng/mL. Our microfluidic chip design enhanced the operability of SERS-based immunodiagnostic techniques, significantly reducing the complication and cost of preparation as compared to previous SERS-based works. Meanwhile, this design proved the superiority to conventional lateral flow test strips in respect of both sensitivity and quantitation and showed great potential in the diagnosis and treatment for abrin poisoning as well as on-site screening of abrin-spiked materials.