This review introduces a micro-integrated device of microfluidics and fiber-optic sensors for on-site detection, which can detect certain or several specific components or their amounts in different samples within a relatively short time. Fiber-optics with micron core diameters can be easily coated and functionalized, thus allowing sensors to be integrated with microfluidics to separate, enrich, and measure samples in a micro-device. Compared to traditional laboratory equipment, this integrated device exhibits natural advantages in size, speed, cost, portability, and operability, making it more suitable for on-site detection. In this review, the various optical detection methods used in this integrated device are introduced, including Raman, ultraviolet–visible, fluorescence, and surface plasmon resonance detections. It also provides a detailed overview of the on-site detection applications of this integrated device for biological analysis, food safety, and environmental monitoring. Lastly, this review addresses the prospects for the future development of microfluidics integrated with fiber-optic sensors.