Rock fragmentation is an important evaluation indicator for field blasting operations. This paper applies a deep learning-based method, the Segment Anything Model (SAM), to automatically segment rock fragments. To review the SAM’s segmentation performance, 83 images of rock fragment collected from the mine site were used as the test dataset. Pixel-level accuracy (PA), intersection over union (IOU), and dice coefficient (Dice) were employed to evaluate the model pixel-level segmentation performance. The results showed that the SAM exhibited excellent segmentation performance on the test data (PA = 94.5%, IOU = 94.4%, Dice = 95.4%). The coefficient of determination (R2) values for the 50% and 80% passing sizes (X50 and X80) were 0.970 and 0.991, respectively, which demonstrated that the SAM could achieve high precision measurement of rock fragmentation. Additionally, the effectiveness of the SAM was further evaluated by comparing it to commercial software, and the generalizability of the SAM was verified on two other datasets. The findings revealed that the SAM not only outperformed the Split-Desktop V 4.0 on the test dataset but also achieved comparable accuracy to previous studies on the two other datasets. The SAM could be regarded as a useful tool to provide fast and accurate feedback for field blasting.