A Multicenter Clinical Study of the Automated Fundus Screening Algorithm

Abstract

Purpose To evaluate the effectiveness of automated fundus screening software in detecting eye diseases by comparing the reported results against those given by human experts. Results There were 1585 subjects who completed the procedure and yielded qualified images. The prevalence of referable diabetic retinopathy (RDR), glaucoma suspect (GCS), and referable macular diseases (RMD) were 20.4%, 23.2%, and 49.0%, respectively. The overall sensitivity values for RDR, GCS, and RMD diagnosis are 0.948 (95% confidence interval [CI], 0.918–0.967), 0.891 (95% CI, 0.855–0.919), and 0.901 (95% CI–0.878, 0.920), respectively. The overall specificity values for RDR, GCS, and RMD diagnosis are 0.954 (95% CI, 0.915–0.965), 0.993 (95% CI–0.986, 0.996), and 0.955 (95% CI–0.939, 0.968), respectively. Methods We prospectively enrolled 1743 subjects at seven hospitals throughout China. At each hospital, an operator records the subjects' information, takes fundus images, and submits the images to the Image Reading Center of Zhongshan Ophthalmic Center, Sun Yat-Sen University (IRC). The IRC grades the images according to the study protocol. Meanwhile, these images will also be automatically screened by the artificial intelligence algorithm. Then, the analysis results of automated screening algorithm are compared against the grading results of IRC. The end point goals are lower bounds of 95% CI of sensitivity values that are greater than 0.85 for all three target diseases, and lower bounds of 95% CI of specificity values that are greater than 0.90 for RDR and 0.85 for GCS and RMD. Conclusions Automated fundus screening software demonstrated a high sensitivity and specificity in detecting RDR, GCS, and RMD from color fundus imaged captured using various cameras. Translational Relevance These findings suggest that automated software can improve the screening effectiveness for eye diseases, especially in a primary care context, where experienced ophthalmologists are scarce.

Artificial intelligence promotes the diagnosis and screening of diabetic retinopathy

“…In China, training and validation data for AI algorithms are vast due to a rather centralized healthcare system and the largest population of DR ( 93 ). Hundreds of new start-up companies working on AI applications to healthcare in China have emerged to improve business, and several DR AI-based screening tools have acquired the certificate of medical device Class III approved by NMPA as pioneers, e.g., Silicon Intelligence, Airdoc, Vistel, and especially Intelligent Healthcare of Baidu that developed the first granted algorithm working robustly with various fundus camera models and achieving high accuracies for detecting multiple ophthalmic diseases ( 94 , 95 ). Undoubtedly, the real-world deployment of these new systems in multiple settings will be full of challenges not only in AI diagnostic technologies but also in the marketing pattern and policy-making.…”

Factors affecting HPV infection in U.S. and Beijing females: A modeling study

“…Exploring HPV-infection associated factors is important for HPV prevention and management. This especially so moving to an era of precision medicine, with artificial intelligence and machine learning finding increasing applications in health care ( 14 – 16 ). Accordingly, prediction models based upon risk factors and/or other parameters, which can serve as a convenient tool for individualized risk estimation as well as risk prevention, have attracted increasing attention ( 17 ).…”

A 178-clinical-center experiment of integrating AI solutions for lung pathology diagnosis

“…One of the problems of such studies is that algorithms are often tested on the internal datasets sampled from the same source as training images, which makes the results subjected to dataset bias, potential data contamination, and low data representativeness. To mitigate these issues, large-scale multicenter studies have been conducted allowing the researchers to better estimate the prospects of AI for, for example, eye disease diagnosis 11 , 12 . Such studies are, however, expensive and lengthy.…”