advertisement
Editors Selection IGR 21-3
Artificial Intelligence: AI in Predicting progression to surgery
Comment by Andrea Servillo & Alessandro Rabiolo & Giovanni Montesano on:
109778 Predicting Glaucoma Progression to Surgery with Artificial Intelligence Survival Models, Tao S; Ravindranath R; Wang SY, Ophthalmology science, 2023; 3: 100336
In this retrospective observational monocentric study, Tao and colleagues compared four survival-based artificial intelligence (AI) models using electronic health records to predict glaucoma progression to surgery in 4512 patients: linear regression-based (Cox regression), tree-based (random survival forest and gradient-boosting survival), and deep learning-based (DeepSurv) models. There were no statistically significant differences among these models, with a slightly better performance of DeepSurv and tree-based models.
The authors are the first to apply AI to survival models for glaucoma patients, distinguishing their approach from previous studies which used classifiers for binary outcomes, overlooking the longitudinal nature of the outcomes.1 They emphasize that Cox regression, widely employed for survival analysis, makes assumptions (independence of survival times, absence of correlation between features, and constant hazard ratio) that are often not satisfied for large retrospective datasets. The authors suggest that DeepSurv and tree-based models may overcome these assumptions. Despite being theoretically true, the absence of statistically and, more importantly, clinically significant differences indicates that more complicated models may not provide any meaningful benefit to simpler models, such as Cox regression, even when their assumptions are not strictly met. Moreover, there are many variations of standard statistical models for survival analyses that can overcome many of the assumptions of naïve Cox models. These may be simpler, more interpretable and, therefore, preferrable to complex AI methods. This is not to say that AI might not find more impactful applications in this space. For example, AI could deal with the complexity of unstructured data (images and clinical notes), which would be difficult to integrate in a standard regression model.
The absence of statistically and, more importantly, clinically significant differences indicates that more complicated models may not provide any meaningful benefit to simpler models, such as Cox regression, even when their assumptions are not strictly metA few things should be borne in mind when evaluating results of AI models. Models trained on data from a single center, such as in this work, often lack generalizability and might perform far worse when applied to different clinical cohorts.2,3 Moreover, DeepSurv, like other AI models, is computationally demanding and requires careful training, which can be very resource and time intensive. Finally, researchers can often achieve only a limited understanding of the underlying decision process of these algorithms, which poses challenges in the interpretation of the results.4,5
In conclusion, the authors proposed a set of promising AI-survival models for predicting glaucoma progression. However, given the results of their investigation, the use of these complex models does not seem entirely justified.
References
- Baxter SL, Marks C, Kuo TT, Ohno-Machado L, Weinreb RN. Machine Learning- Based Predictive Modeling of Surgical Intervention in Glaucoma Using Systemic Data From Electronic Health Records. Am J Ophthalmol. 2019;208:30-40.
- Texier B, et al. Computed tomography synthesis from magnetic resonance imaging using cycle Generative Adversarial Networks with multicenter learning. Phys Imaging Radiat Oncol. 2023;28.
- Noury E, et al. Deep Learning for Glaucoma Detection and Identification of Novel Diagnostic Areas in Diverse Real-World Datasets. Transl Vis Sci Technol.2022;11.
- Chang J, et al. Explaining the Rationale of Deep Learning Glaucoma Decisions with Adversarial Examples. Ophthalmology. 2021;128:78-88.
- Phene S, et al. Deep Learning and Glaucoma Specialists: The Relative Importance of Optic Disc Features to Predict Glaucoma Referral in Fundus Photographs. Ophthalmology. 2019;126:1627-1639.
Comments
The comment section on the IGR website is restricted to WGA#One members only. Please log-in through your WGA#One account to continue.Log-in through WGA#One