The quality of fruit is a very important measure in determining the market value of the fruit. Good fruit quality provides great potential benefits for antioxidant properties of abundant bioactive compounds such as flavonoids, anthocyanins, polyphenols, and ascorbic acid. Therefore, giving enough attention to fruit quality and its changes is important for assuring high quality of fruits. Hyperspectral imaging (HSI) technique has showed great potential for evaluating quality attributes of fruit due to its nature of simple, continuous noninvasiveness and economy. However, for inherent peculiarity of fruit, some problems arose in the practice of estimating fruit quality by HSI, including focusing, determination of scanning parameters, image processing, data mining, and data analysis. The purpose of this paper is to review the use of HSI in the estimation of physical-chemical attributes, detection of common defects and contaminants, and evaluation of maturity stage of fruit. Remaining problems are also identified, along with suggested solutions and possible future trends in the field.