Sarcopenia is characterized by a degeneration of muscle mass and strength that incurs impaired mobility, posing grievous impacts on the quality of life and well-being of older adults worldwide. In 2018, a new international consensus was formulated to incorporate ultrasound imaging of the rectus femoris (RF) muscle for early sarcopenia assessment. Nonetheless, current clinical RF muscle identification and delineation procedures are manual, subjective, inaccurate, and challenging. Thus, developing an effective AI-empowered RF segmentation model to streamline downstream sarcopenia assessment is highly desirable. Yet, this area of research readily goes unnoticed compared to other disciplines, and relevant research is desperately wanted, especially in comparison among traditional, classic, and cutting-edge segmentation networks. This study evaluated an emerging Automatic Segment Anything Model (AutoSAM) compared to the U-Net and nnU-Net models for RF segmentation on ultrasound images. We prospectively analyzed ultrasound images of 257 older adults (aged > 65) in a community setting from Hong Kong’s District Elderly Community Centers. Three models were developed on a training set (n = 219) and independently evaluated on a testing set (n = 38) in aspects of DICE, Intersection-over-Union, Hausdorff Distance (HD), accuracy, precision, recall, as well as stability. The results indicated that the AutoSAM achieved the best segmentation agreement in all the evaluating metrics, consistently outperforming the U-Net and nnU-Net models. The results offered an effective state-of-the-art RF muscle segmentation tool for sarcopenia assessment in the future.