Accurate diagnosis of acute appendicitis from abdominal ultrasound is a challenging task, since traditional sonographic diagnostic criteria for appendicitis, such as diameter, compressibility, and wall thickness, rely on complete identification or visualization of the appendix and the diagnosis is frequently operator subjective. In this paper, we propose a robust automatic segmentation method for inflamed appendix identification to mitigate abovementioned difficulties. We use outlier rejection fuzzy c-means clustering (FCM) algorithm within a double-layered learning structure to extract the target inflamed appendix area. The proposed method extracts the target appendix in 98 cases out of 100 test images, which is far better than traditional FCM, standard outlier FCM, and double-layered learning with FCM in correct extraction rate. Furthermore, we investigate the outlier rejection effect and double layered learning effect by comparing our proposed method with standard double-layered FCM and the standard outlier-rejection FCM. In this comparison, the proposed method exhibits robust segmentation results in accuracy, precision, and recall by 2.5~5.6% over two standard methods in quality with human pathologists’ marking as the ground truth.