Lime is a commercially important fruit in Thailand whose sale price depends on the fruit’s size; hence, farmers must grade limes by size before distribution. However, as lime grading machines are very expensive and each province has different size grading limits, grading is often performed manually, which is time-consuming and error-prone. Agricultural production systems for automatic selection and grading use image processing techniques for extracting key features. Therefore, this study proposes techniques to extract features of limes and to develop analytical methods for grading them. This method can reduce time and cost, and increase accuracy and flexibility for selecting different lime sizes according to each province’s size criteria. To verify our method, we classified limes according to criteria from four Thailand provinces as sample data in an experiment. The focal image feature was the radius or diameter of the lime and the grading conditions were defined by the maximum comparison ratio of the fruit’s radius in pixels to the measured radius of the actual lime in centimeters. The average grading accuracy was 99.59%, which outperformed that of mechanical grading. The processing time was 1.70 seconds per individual fruit.