Evaluation of the competence of an artificial intelligence-assisted colonoscopy system in clinical practice: A post hoc analysis

Abstract

BackgroundArtificial intelligence-assisted colonoscopy (AIAC) has been proposed and validated in recent years, but the effectiveness of clinic application remains unclear since it was only validated in some clinical trials rather than normal conditions. In addition, previous clinical trials were mostly concerned with colorectal polyp identification, while fewer studies are focusing on adenoma identification and polyps size measurement. In this study, we validated the effectiveness of AIAC in the clinical environment and further investigated its capacity for adenoma identification and polyps size measurement.MethodsThe information of 174 continued patients who went for coloscopy in Chongqing Rongchang District People’s hospital with detected colon polyps was retrospectively collected, and their coloscopy images were divided into three validation datasets, polyps dataset, polyps/adenomas dataset (all containing narrow band image, NBI images), and polyp size measurement dataset (images with biopsy forceps and polyps) to assess the competence of the artificial intelligence system, and compare its diagnostic ability with endoscopists with different experiences.ResultsA total of 174 patients were included, and the sensitivity of the colorectal polyp recognition model was 99.40%, the accuracy of the colorectal adenoma diagnostic model was 93.06%, which was higher than that of endoscopists, and the mean absolute error of the polyp size measurement model was 0.62 mm and the mean relative error was 10.89%, which was lower than that of endoscopists.ConclusionArtificial intelligence-assisted model demonstrated higher competence compared with endoscopists and stable diagnosis ability in clinical use.