Background Diabetic retinopathy screening in England involves labour-intensive manual grading of retinal images. Automated retinal image analysis systems (ARIASs) may offer an alternative to manual grading. Objectives To determine the screening performance and cost-effectiveness of ARIASs to replace level 1 human graders or pre-screen with ARIASs in the NHS diabetic eye screening programme (DESP). To examine technical issues associated with implementation. Design Observational retrospective measurement comparison study with a real-time evaluation of technical issues and a decision-analytic model to evaluate cost-effectiveness. Setting A NHS DESP. Participants Consecutive diabetic patients who attended a routine annual NHS DESP visit. Interventions Retinal images were manually graded and processed by three ARIASs: iGradingM (version 1.1; originally Medalytix Group Ltd, Manchester, UK, but purchased by Digital Healthcare, Cambridge, UK, at the initiation of the study, purchased in turn by EMIS Health, Leeds, UK, after conclusion of the study), Retmarker (version 0.8.2, Retmarker Ltd, Coimbra, Portugal) and EyeArt (Eyenuk Inc., Woodland Hills, CA, USA). The final manual grade was used as the reference standard. Arbitration on a subset of discrepancies between manual grading and the use of an ARIAS by a reading centre masked to all grading was used to create a reference standard manual grade modified by arbitration. Main outcome measures Screening performance (sensitivity, specificity, false-positive rate and likelihood ratios) and diagnostic accuracy [95% confidence intervals (CIs)] of ARIASs. A secondary analysis explored the influence of camera type and patients’ ethnicity, age and sex on screening performance. Economic analysis estimated the cost per appropriate screening outcome identified. Results A total of 20,258 patients with 102,856 images were entered into the study. The sensitivity point estimates of the ARIASs were as follows: EyeArt 94.7% (95% CI 94.2% to 95.2%) for any retinopathy, 93.8% (95% CI 92.9% to 94.6%) for referable retinopathy and 99.6% (95% CI 97.0% to 99.9%) for proliferative retinopathy; and Retmarker 73.0% (95% CI 72.0% to 74.0%) for any retinopathy, 85.0% (95% CI 83.6% to 86.2%) for referable retinopathy and 97.9% (95% CI 94.9 to 99.1%) for proliferative retinopathy. iGradingM classified all images as either ‘disease’ or ‘ungradable’, limiting further iGradingM analysis. The sensitivity and false-positive rates for EyeArt were not affected by ethnicity, sex or camera type but sensitivity declined marginally with increasing patient age. The screening performance of Retmarker appeared to vary with patient’s age, ethnicity and camera type. Both EyeArt and Retmarker were cost saving relative to manual grading either as a replacement for level 1 human grading or used prior to level 1 human grading, although the latter was less cost-effective. A threshold analysis testing the highest ARIAS cost per patient before which ARIASs became more expensive per appropriate outcome than human grading, when used to replace level 1 grader, was Retmarker £3.82 and EyeArt £2.71 per patient. Limitations The non-randomised study design limited the health economic analysis but the same retinal images were processed by all ARIASs in this measurement comparison study. Conclusions Retmarker and EyeArt achieved acceptable sensitivity for referable retinopathy and false-positive rates (compared with human graders as reference standard) and appear to be cost-effective alternatives to a purely manual grading approach. Future work is required to develop technical specifications to optimise deployment and address potential governance issues. Funding The National Institute for Health Research (NIHR) Health Technology Assessment programme, a Fight for Sight Grant (Hirsch grant award) and the Department of Health’s NIHR Biomedical Research Centre for Ophthalmology at Moorfields Eye Hospital and the University College London Institute of Ophthalmology.
Retmarker and EyeArt systems achieved acceptable sensitivity for referable retinopathy when compared with that of human graders and had sufficient specificity to make them cost-effective alternatives to manual grading alone. ARIAS have the potential to reduce costs in developed-world health care economies and to aid delivery of DR screening in developing or remote health care settings.
Background/aimsHuman grading of digital images from diabetic retinopathy (DR) screening programmes represents a significant challenge, due to the increasing prevalence of diabetes. We evaluate the performance of an automated artificial intelligence (AI) algorithm to triage retinal images from the English Diabetic Eye Screening Programme (DESP) into test-positive/technical failure versus test-negative, using human grading following a standard national protocol as the reference standard.MethodsRetinal images from 30 405 consecutive screening episodes from three English DESPs were manually graded following a standard national protocol and by an automated process with machine learning enabled software, EyeArt v2.1. Screening performance (sensitivity, specificity) and diagnostic accuracy (95% CIs) were determined using human grades as the reference standard.ResultsSensitivity (95% CIs) of EyeArt was 95.7% (94.8% to 96.5%) for referable retinopathy (human graded ungradable, referable maculopathy, moderate-to-severe non-proliferative or proliferative). This comprises sensitivities of 98.3% (97.3% to 98.9%) for mild-to-moderate non-proliferative retinopathy with referable maculopathy, 100% (98.7%,100%) for moderate-to-severe non-proliferative retinopathy and 100% (97.9%,100%) for proliferative disease. EyeArt agreed with the human grade of no retinopathy (specificity) in 68% (67% to 69%), with a specificity of 54.0% (53.4% to 54.5%) when combined with non-referable retinopathy.ConclusionThe algorithm demonstrated safe levels of sensitivity for high-risk retinopathy in a real-world screening service, with specificity that could halve the workload for human graders. AI machine learning and deep learning algorithms such as this can provide clinically equivalent, rapid detection of retinopathy, particularly in settings where a trained workforce is unavailable or where large-scale and rapid results are needed.
This study explored the views of Minnesota renters and apartment owners or managers about environmental tobacco smoke (ETS) transfer between units in multifamily buildings and about smoke-free housing. A convenience sample of 49 decision makers who manage 27,116 rental units in Minnesota were aware of some ETS transfer in their buildings, but most felt it was rarely or never a significant factor in tenants' decisions to rent or to move. Most of those who had never designated a building smoke free had little or no interest in doing so, due to concerns that it would increase vacancy rates, constitute discrimination, or engender costs for enforcement. Owners who had already designated smoke-free buildings, however, had seen mostly neutral or positive effects on vacancies, turnover, and time required to manage the buildings, and planned to continue offering them. A total of 48% of households in a random sample of 405 reported that at times ETS enters their apartment from elsewhere; 10% said this occurs often or most of the time. Of those experiencing ETS transfer, 37% said it bothered them a lot or so much that they were thinking of moving. Only a small fraction of renters currently live in smoke-free buildings, but nearly half would be extremely or very interested in doing so. Interest is high across ethnicities, income levels, rent levels, and age groups and regardless of whether the household has children. 54% of respondents would be very likely to choose a smoke-free building, all other things being equal, and 34% would be willing to pay more to live in one.
Aims To investigate diabetic retinopathy screening attendance and trends in certified vision impairment caused by diabetic eye disease. Methods This was a retrospective study of attendance in three urban UK diabetic eye screening programmes in England. A survival analysis was performed to investigate time from diagnosis to first screen by age and sex. Logistic regression analysis of factors influencing screening attendance during a 15‐month reporting period was conducted, as well as analysis of new vision impairment certifications (Certificate of Vision Impairment) in England and Wales from 2009 to 2019. Results Of those newly registered in the Routine Digital Screening pathway (n = 97 048), 80% attended screening within the first 12 months and 88% by 36 months. Time from registration to first eye screening was longer for people aged 18–34 years, and 20% were unscreened after 3 years. Delay in first screen was associated with increased risk of referable retinopathy. Although 95% of participants (n = 291 296) attended during the 15‐month reporting period, uptake varied considerably. Younger age, social deprivation, ethnicity and duration of diabetes were independent predictors of non‐attendance and referable retinopathy. Although the last 10 years has seen an overall reduction in vision impairment certification attributable to diabetic eye disease, the incidence of vision impairment in those aged <35 years was unchanged. Conclusions Whilst the majority of participants are screened in a timely manner, there is considerable variation in uptake. Young adults, have sub‐optimal attendance, and levels of vision impairment in this population have not changed over the last 10 years. There is an urgent need to explore barriers to/enablers of attendance in this group to inform policy initiatives and tailored interventions to address this issue.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.