Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices
- PMID: 31304320
- PMCID: PMC6550188
- DOI: 10.1038/s41746-018-0040-6
Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices
Abstract
Artificial Intelligence (AI) has long promised to increase healthcare affordability, quality and accessibility but FDA, until recently, had never authorized an autonomous AI diagnostic system. This pivotal trial of an AI system to detect diabetic retinopathy (DR) in people with diabetes enrolled 900 subjects, with no history of DR at primary care clinics, by comparing to Wisconsin Fundus Photograph Reading Center (FPRC) widefield stereoscopic photography and macular Optical Coherence Tomography (OCT), by FPRC certified photographers, and FPRC grading of Early Treatment Diabetic Retinopathy Study Severity Scale (ETDRS) and Diabetic Macular Edema (DME). More than mild DR (mtmDR) was defined as ETDRS level 35 or higher, and/or DME, in at least one eye. AI system operators underwent a standardized training protocol before study start. Median age was 59 years (range, 22-84 years); among participants, 47.5% of participants were male; 16.1% were Hispanic, 83.3% not Hispanic; 28.6% African American and 63.4% were not; 198 (23.8%) had mtmDR. The AI system exceeded all pre-specified superiority endpoints at sensitivity of 87.2% (95% CI, 81.8-91.2%) (>85%), specificity of 90.7% (95% CI, 88.3-92.7%) (>82.5%), and imageability rate of 96.1% (95% CI, 94.6-97.3%), demonstrating AI's ability to bring specialty-level diagnostics to primary care settings. Based on these results, FDA authorized the system for use by health care providers to detect more than mild DR and diabetic macular edema, making it, the first FDA authorized autonomous AI diagnostic system in any field of medicine, with the potential to help prevent vision loss in thousands of people with diabetes annually. ClinicalTrials.gov NCT02963441.
Keywords: Biomedical engineering; Eye manifestations.
Conflict of interest statement
Competing interestsM.D.A. is shareholder, director, and employee of IDx, LLC, and has relevant patents and patent applications assigned to the University of Iowa; P.T.L. received fees from IDx, LLC for statistical consultancy; N.S. and M.B. declare no competing interests. J.C.F. is shareholder of IDx, LLC. Disclosure forms provided by the authors are available with the full text of this article. Patents (all issued) that may be affected by this study are: applied for by the University of Iowa, inventor M.D.A., 7,474,775, Automatic Detection of Red Lesions in Digital Color Fundus Photographs; 7,712,898, Methods and Systems for Optic Nerve Head Segmentation; 8,340,437, Methods and Systems for Determining Optimal Features for Classifying Patterns or Objects in Images; 9,924,867, Automated Determination of Arteriovenous Ratio in Images of Blood Vessels; applied by IDx, inventor M.D.A., 9,155,465, Snapshot Spectral Domain Optical Coherence Tomographer; 9,782,065, Parallel optical coherence tomography apparatuses, systems and related methods; 9,814,386, Systems and methods for alignment of the eye for ocular imaging.
Figures
Similar articles
-
Artificial Intelligence Detection of Diabetic Retinopathy: Subgroup Comparison of the EyeArt System with Ophthalmologists' Dilated Examinations.Ophthalmol Sci. 2022 Sep 30;3(1):100228. doi: 10.1016/j.xops.2022.100228. eCollection 2023 Mar. Ophthalmol Sci. 2022. PMID: 36345378 Free PMC article.
-
Pivotal Evaluation of an Artificial Intelligence System for Autonomous Detection of Referrable and Vision-Threatening Diabetic Retinopathy.JAMA Netw Open. 2021 Nov 1;4(11):e2134254. doi: 10.1001/jamanetworkopen.2021.34254. JAMA Netw Open. 2021. PMID: 34779843 Free PMC article. Clinical Trial.
-
Evaluation of an Artificial Intelligence System for the Detection of Diabetic Retinopathy in Chinese Community Healthcare Centers.Front Med (Lausanne). 2022 Apr 11;9:883462. doi: 10.3389/fmed.2022.883462. eCollection 2022. Front Med (Lausanne). 2022. PMID: 35479949 Free PMC article.
-
Optical coherence tomography (OCT) for detection of macular oedema in patients with diabetic retinopathy.Cochrane Database Syst Rev. 2011 Jul 6;(7):CD008081. doi: 10.1002/14651858.CD008081.pub2. Cochrane Database Syst Rev. 2011. Update in: Cochrane Database Syst Rev. 2015 Jan 07;1:CD008081. doi: 10.1002/14651858.CD008081.pub3 PMID: 21735421 Updated. Review.
-
Determinants for scalable adoption of autonomous AI in the detection of diabetic eye disease in diverse practice types: key best practices learned through collection of real-world data.Front Digit Health. 2023 May 18;5:1004130. doi: 10.3389/fdgth.2023.1004130. eCollection 2023. Front Digit Health. 2023. PMID: 37274764 Free PMC article. Review.
Cited by
-
Application of artificial intelligence in laryngeal lesions: a systematic review and meta-analysis.Eur Arch Otorhinolaryngol. 2024 Nov 22. doi: 10.1007/s00405-024-09075-0. Online ahead of print. Eur Arch Otorhinolaryngol. 2024. PMID: 39576322 Review.
-
A data-driven framework for identifying patient subgroups on which an AI/machine learning model may underperform.NPJ Digit Med. 2024 Nov 21;7(1):334. doi: 10.1038/s41746-024-01275-6. NPJ Digit Med. 2024. PMID: 39572755 Free PMC article.
-
ViT-HHO: Optimized vision transformer for diabetic retinopathy detection using Harris Hawk optimization.MethodsX. 2024 Oct 23;13:103018. doi: 10.1016/j.mex.2024.103018. eCollection 2024 Dec. MethodsX. 2024. PMID: 39526031 Free PMC article.
-
Multi-modal representation learning in retinal imaging using self-supervised learning for enhanced clinical predictions.Sci Rep. 2024 Nov 5;14(1):26802. doi: 10.1038/s41598-024-78515-y. Sci Rep. 2024. PMID: 39500979 Free PMC article.
-
Use of Artificial Intelligence-Based Detection of Diabetic Retinopathy in the US.JAMA Ophthalmol. 2024 Dec 1;142(12):1171-1173. doi: 10.1001/jamaophthalmol.2024.4493. JAMA Ophthalmol. 2024. PMID: 39480408
References
-
- Centers for Disease Control and Prevention. Diabetes Report Card 2012. Atlanta, GA: U.S. Department of Health and Human Services; 2012.
-
- National Health Service Diabetic Retinopathy Programme Annual Report, April 2007-March 2008 (2008).
Associated data
LinkOut - more resources
Full Text Sources
Other Literature Sources