Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices
- PMID: 31304320
- PMCID: PMC6550188
- DOI: 10.1038/s41746-018-0040-6
Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices
Abstract
Artificial Intelligence (AI) has long promised to increase healthcare affordability, quality and accessibility but FDA, until recently, had never authorized an autonomous AI diagnostic system. This pivotal trial of an AI system to detect diabetic retinopathy (DR) in people with diabetes enrolled 900 subjects, with no history of DR at primary care clinics, by comparing to Wisconsin Fundus Photograph Reading Center (FPRC) widefield stereoscopic photography and macular Optical Coherence Tomography (OCT), by FPRC certified photographers, and FPRC grading of Early Treatment Diabetic Retinopathy Study Severity Scale (ETDRS) and Diabetic Macular Edema (DME). More than mild DR (mtmDR) was defined as ETDRS level 35 or higher, and/or DME, in at least one eye. AI system operators underwent a standardized training protocol before study start. Median age was 59 years (range, 22-84 years); among participants, 47.5% of participants were male; 16.1% were Hispanic, 83.3% not Hispanic; 28.6% African American and 63.4% were not; 198 (23.8%) had mtmDR. The AI system exceeded all pre-specified superiority endpoints at sensitivity of 87.2% (95% CI, 81.8-91.2%) (>85%), specificity of 90.7% (95% CI, 88.3-92.7%) (>82.5%), and imageability rate of 96.1% (95% CI, 94.6-97.3%), demonstrating AI's ability to bring specialty-level diagnostics to primary care settings. Based on these results, FDA authorized the system for use by health care providers to detect more than mild DR and diabetic macular edema, making it, the first FDA authorized autonomous AI diagnostic system in any field of medicine, with the potential to help prevent vision loss in thousands of people with diabetes annually. ClinicalTrials.gov NCT02963441.
Keywords: Biomedical engineering; Eye manifestations.
Conflict of interest statement
Competing interestsM.D.A. is shareholder, director, and employee of IDx, LLC, and has relevant patents and patent applications assigned to the University of Iowa; P.T.L. received fees from IDx, LLC for statistical consultancy; N.S. and M.B. declare no competing interests. J.C.F. is shareholder of IDx, LLC. Disclosure forms provided by the authors are available with the full text of this article. Patents (all issued) that may be affected by this study are: applied for by the University of Iowa, inventor M.D.A., 7,474,775, Automatic Detection of Red Lesions in Digital Color Fundus Photographs; 7,712,898, Methods and Systems for Optic Nerve Head Segmentation; 8,340,437, Methods and Systems for Determining Optimal Features for Classifying Patterns or Objects in Images; 9,924,867, Automated Determination of Arteriovenous Ratio in Images of Blood Vessels; applied by IDx, inventor M.D.A., 9,155,465, Snapshot Spectral Domain Optical Coherence Tomographer; 9,782,065, Parallel optical coherence tomography apparatuses, systems and related methods; 9,814,386, Systems and methods for alignment of the eye for ocular imaging.
Figures
Similar articles
-
Artificial Intelligence Detection of Diabetic Retinopathy: Subgroup Comparison of the EyeArt System with Ophthalmologists' Dilated Examinations.Ophthalmol Sci. 2022 Sep 30;3(1):100228. doi: 10.1016/j.xops.2022.100228. eCollection 2023 Mar. Ophthalmol Sci. 2022. PMID: 36345378 Free PMC article.
-
Pivotal Evaluation of an Artificial Intelligence System for Autonomous Detection of Referrable and Vision-Threatening Diabetic Retinopathy.JAMA Netw Open. 2021 Nov 1;4(11):e2134254. doi: 10.1001/jamanetworkopen.2021.34254. JAMA Netw Open. 2021. PMID: 34779843 Free PMC article. Clinical Trial.
-
Evaluation of an Artificial Intelligence System for the Detection of Diabetic Retinopathy in Chinese Community Healthcare Centers.Front Med (Lausanne). 2022 Apr 11;9:883462. doi: 10.3389/fmed.2022.883462. eCollection 2022. Front Med (Lausanne). 2022. PMID: 35479949 Free PMC article.
-
Optical coherence tomography (OCT) for detection of macular oedema in patients with diabetic retinopathy.Cochrane Database Syst Rev. 2011 Jul 6;(7):CD008081. doi: 10.1002/14651858.CD008081.pub2. Cochrane Database Syst Rev. 2011. Update in: Cochrane Database Syst Rev. 2015 Jan 07;1:CD008081. doi: 10.1002/14651858.CD008081.pub3 PMID: 21735421 Updated. Review.
-
Determinants for scalable adoption of autonomous AI in the detection of diabetic eye disease in diverse practice types: key best practices learned through collection of real-world data.Front Digit Health. 2023 May 18;5:1004130. doi: 10.3389/fdgth.2023.1004130. eCollection 2023. Front Digit Health. 2023. PMID: 37274764 Free PMC article. Review.
Cited by
-
Artificial intelligence for retinopathy of prematurity.Curr Opin Ophthalmol. 2020 Sep;31(5):312-317. doi: 10.1097/ICU.0000000000000680. Curr Opin Ophthalmol. 2020. PMID: 32694266 Free PMC article. Review.
-
Evaluating the Viability of a Smartphone-Based Annotation Tool for Faster and Accurate Image Labelling for Artificial Intelligence in Diabetic Retinopathy.Clin Ophthalmol. 2021 Mar 8;15:1023-1039. doi: 10.2147/OPTH.S289425. eCollection 2021. Clin Ophthalmol. 2021. PMID: 33727785 Free PMC article.
-
Deep Learning System Boosts Radiologist Detection of Intracranial Hemorrhage.Cureus. 2022 Oct 13;14(10):e30264. doi: 10.7759/cureus.30264. eCollection 2022 Oct. Cureus. 2022. PMID: 36381767 Free PMC article.
-
Heart, Eye, and Artificial Intelligence: A Review.Cardiol Res. 2021 Jun;12(3):132-139. doi: 10.14740/cr1179. Epub 2021 May 14. Cardiol Res. 2021. PMID: 34046105 Free PMC article. Review.
-
Performance of the AIDRScreening system in detecting diabetic retinopathy in the fundus photographs of Chinese patients: a prospective, multicenter, clinical study.Ann Transl Med. 2022 Oct;10(20):1088. doi: 10.21037/atm-22-350. Ann Transl Med. 2022. PMID: 36388839 Free PMC article.
References
-
- Centers for Disease Control and Prevention. Diabetes Report Card 2012. Atlanta, GA: U.S. Department of Health and Human Services; 2012.
-
- National Health Service Diabetic Retinopathy Programme Annual Report, April 2007-March 2008 (2008).
Associated data
LinkOut - more resources
Full Text Sources
Other Literature Sources