Massimiliano Grassi1, David A Loewenstein2, Daniela Caldirola1, Koen Schruers3, Ranjan Duara4, Giampaolo Perna1. 1. Department of Clinical Neurosciences,Hermanas Hospitalarias, Villa San Benedetto Menni Hospital, FoRiPsi,Albese con Cassano,Como,Italy. 2. Department of Psychiatry and Behavioral Sciences,Miller School of Medicine, University of Miami,Miami,Florida,USA. 3. Research Institute of Mental Health and Neuroscience and Department of Psychiatry and Neuropsychology,Faculty of Health, Medicine and Life Sciences, University of Maastricht,Maastricht,the Netherlands. 4. Wien Center for Alzheimer's Disease and Memory Disorders,Mount Sinai Medical Center,Miami Beach,Florida,USA.
Abstract
ABSTRACTBackground:In a previous study, we developed a highly performant and clinically-translatable machine learning algorithm for a prediction of three-year conversion to Alzheimer's disease (AD) in subjects with Mild Cognitive Impairment (MCI) and Pre-mild Cognitive Impairment. Further tests are necessary to demonstrate its accuracy when applied to subjects not used in the original training process. In this study, we aimed to provide preliminary evidence of this via a transfer learning approach. METHODS: We initially employed the same baseline information (i.e. clinical and neuropsychological test scores, cardiovascular risk indexes, and a visual rating scale for brain atrophy) and the same machine learning technique (support vector machine with radial-basis function kernel) used in our previous study to retrain the algorithm to discriminate between participants with AD (n = 75) and normal cognition (n = 197). Then, the algorithm was applied to perform the original task of predicting the three-year conversion to AD in the sample of 61 MCI subjects that we used in the previous study. RESULTS: Even after the retraining, the algorithm demonstrated a significant predictive performance in the MCI sample (AUC = 0.821, 95% CI bootstrap = 0.705-0.912, best balanced accuracy = 0.779, sensitivity = 0.852, specificity = 0.706). CONCLUSIONS: These results provide a first indirect evidence that our original algorithm can also perform relevant generalized predictions when applied to new MCI individuals. This motivates future efforts to bring the algorithm to sufficient levels of optimization and trustworthiness that will allow its application in both clinical and research settings.
ABSTRACTBackground:In a previous study, we developed a highly performant and clinically-translatable machine learning algorithm for a prediction of three-year conversion to Alzheimer's disease (AD) in subjects with Mild Cognitive Impairment (MCI) and Pre-mild Cognitive Impairment. Further tests are necessary to demonstrate its accuracy when applied to subjects not used in the original training process. In this study, we aimed to provide preliminary evidence of this via a transfer learning approach. METHODS: We initially employed the same baseline information (i.e. clinical and neuropsychological test scores, cardiovascular risk indexes, and a visual rating scale for brain atrophy) and the same machine learning technique (support vector machine with radial-basis function kernel) used in our previous study to retrain the algorithm to discriminate between participants with AD (n = 75) and normal cognition (n = 197). Then, the algorithm was applied to perform the original task of predicting the three-year conversion to AD in the sample of 61 MCI subjects that we used in the previous study. RESULTS: Even after the retraining, the algorithm demonstrated a significant predictive performance in the MCI sample (AUC = 0.821, 95% CI bootstrap = 0.705-0.912, best balanced accuracy = 0.779, sensitivity = 0.852, specificity = 0.706). CONCLUSIONS: These results provide a first indirect evidence that our original algorithm can also perform relevant generalized predictions when applied to new MCI individuals. This motivates future efforts to bring the algorithm to sufficient levels of optimization and trustworthiness that will allow its application in both clinical and research settings.
Authors: D G Clark; P Kapur; D S Geldmacher; J C Brockington; L Harrell; T P DeRamus; P D Blanton; K Lokken; A P Nicholas; D C Marson Journal: Cortex Date: 2014-01-16 Impact factor: 4.027
Authors: Kwangsik Nho; Li Shen; Sungeun Kim; Shannon L Risacher; John D West; Tatiana Foroud; Clifford R Jack; Michael W Weiner; Andrew J Saykin Journal: AMIA Annu Symp Proc Date: 2010-11-13
Authors: P Scheltens; D Leys; F Barkhof; D Huglo; H C Weinstein; P Vermersch; M Kuiper; M Steinling; E C Wolters; J Valk Journal: J Neurol Neurosurg Psychiatry Date: 1992-10 Impact factor: 10.154
Authors: R Duara; D A Loewenstein; E Potter; J Appel; M T Greig; R Urs; Q Shen; A Raj; B Small; W Barker; E Schofield; Y Wu; H Potter Journal: Neurology Date: 2008-12-09 Impact factor: 9.910
Authors: Jonathan Young; Marc Modat; Manuel J Cardoso; Alex Mendelson; Dave Cash; Sebastien Ourselin Journal: Neuroimage Clin Date: 2013-05-19 Impact factor: 4.881
Authors: Claudia Plant; Stefan J Teipel; Annahita Oswald; Christian Böhm; Thomas Meindl; Janaina Mourao-Miranda; Arun W Bokde; Harald Hampel; Michael Ewers Journal: Neuroimage Date: 2009-12-02 Impact factor: 6.556
Authors: Dilip V Jeste; Sarah A Graham; Ellen E Lee; Ho-Cheol Kim; Tanya T Nguyen; Colin A Depp Journal: Int Psychogeriatr Date: 2020-06-25 Impact factor: 3.878
Authors: Sarah A Graham; Ellen E Lee; Dilip V Jeste; Ryan Van Patten; Elizabeth W Twamley; Camille Nebeker; Yasunori Yamada; Ho-Cheol Kim; Colin A Depp Journal: Psychiatry Res Date: 2019-12-09 Impact factor: 3.222
Authors: Oana G Rus-Oswald; Jan Benner; Julia Reinhardt; Céline Bürki; Markus Christiner; Elke Hofmann; Peter Schneider; Christoph Stippich; Reto W Kressig; Maria Blatow Journal: Front Aging Neurosci Date: 2022-03-25 Impact factor: 5.750