Image processing is one of the important and extensively used techniques for determining physical and chemical characteristics of fruits. These characteristics are used for defining the shelf-life, packaging systems, mode of transportation and storage technique. In this method, green, yellow, and ripened banana with black spots are used for identification and classification of different ripening stages of banana. Automatic threshold separation and Aphelion 3.2 version software have been used for capturing images and analyzing structures. Hue, Saturation, and Intensity were the color coordinates used for extracting information in an image size of 451 × 256 pixels. Simplified histogram analysis on different color band was carried out. Result shows green band histogram can be used for classification of various ripening stages. In blue and red band histogram, it's difficult to differentiate stages.