Karsten Gielis1, Marie-Elena Vanden Abeele2, Katrien Verbert3, Jos Tournoy4,5, Maarten De Vos6, Vero Vanden Abeele1. 1. e-Media Research Lab, KU Leuven, Leuven, Belgium. 2. Memory Clinic, Jessa Hospital, Hasselt, Belgium. 3. Department of Computer Science, KU Leuven, Leuven, Belgium. 4. Department of Geriatric Medicine, University Hospital Leuven, Leuven, Belgium. 5. Department of Public Healthcare and Primary Care, Gerontology and Geriatrics, KU Leuven, Leuven, Belgium. 6. Department of Electrical Engineering, KU Leuven, Leuven, Belgium.
Abstract
BACKGROUND: Mild cognitive impairment (MCI) is a condition that entails a slight yet noticeable decline in cognition that exceeds normal age-related changes. Older adults living with MCI have a higher chance of progressing to dementia, which warrants regular cognitive follow-up at memory clinics. However, due to time and resource constraints, this follow-up is conducted at separate moments in time with large intervals in between. Casual games, embedded into the daily life of older adults, may prove to be a less resource-intensive medium that yields continuous and rich data on a patient's cognition. OBJECTIVE: To explore whether digital biomarkers of cognitive performance, found in the casual card game Klondike Solitaire, can be used to train machine-learning models to discern games played by older adults living with MCI from their healthy counterparts. METHODS: Digital biomarkers of cognitive performance were captured from 23 healthy older adults and 23 older adults living with MCI, each playing 3 games of Solitaire with 3 different deck shuffles. These 3 deck shuffles were identical for each participant. Using a supervised stratified, 5-fold, cross-validated, machine-learning procedure, 19 different models were trained and optimized for F1 score. RESULTS: The 3 best performing models, an Extra Trees model, a Gradient Boosting model, and a Nu-Support Vector Model, had a cross-validated F1 training score on the validation set of ≥0.792. The F1 score and AUC of the test set were, respectively, >0.811 and >0.877 for each of these models. These results indicate psychometric properties comparative to common cognitive screening tests. CONCLUSION: The results suggest that commercial card games, not developed to address specific mental processes, may be used for measuring cognition. The digital biomarkers derived from Klondike Solitaire show promise and may prove useful to fill the current blind spot between consultations.
BACKGROUND: Mild cognitive impairment (MCI) is a condition that entails a slight yet noticeable decline in cognition that exceeds normal age-related changes. Older adults living with MCI have a higher chance of progressing to dementia, which warrants regular cognitive follow-up at memory clinics. However, due to time and resource constraints, this follow-up is conducted at separate moments in time with large intervals in between. Casual games, embedded into the daily life of older adults, may prove to be a less resource-intensive medium that yields continuous and rich data on a patient's cognition. OBJECTIVE: To explore whether digital biomarkers of cognitive performance, found in the casual card game Klondike Solitaire, can be used to train machine-learning models to discern games played by older adults living with MCI from their healthy counterparts. METHODS: Digital biomarkers of cognitive performance were captured from 23 healthy older adults and 23 older adults living with MCI, each playing 3 games of Solitaire with 3 different deck shuffles. These 3 deck shuffles were identical for each participant. Using a supervised stratified, 5-fold, cross-validated, machine-learning procedure, 19 different models were trained and optimized for F1 score. RESULTS: The 3 best performing models, an Extra Trees model, a Gradient Boosting model, and a Nu-Support Vector Model, had a cross-validated F1 training score on the validation set of ≥0.792. The F1 score and AUC of the test set were, respectively, >0.811 and >0.877 for each of these models. These results indicate psychometric properties comparative to common cognitive screening tests. CONCLUSION: The results suggest that commercial card games, not developed to address specific mental processes, may be used for measuring cognition. The digital biomarkers derived from Klondike Solitaire show promise and may prove useful to fill the current blind spot between consultations.
Authors: Ronald C Petersen; Oscar Lopez; Melissa J Armstrong; Thomas S D Getchius; Mary Ganguli; David Gloss; Gary S Gronseth; Daniel Marson; Tamara Pringsheim; Gregory S Day; Mark Sager; James Stevens; Alexander Rae-Grant Journal: Neurology Date: 2017-12-27 Impact factor: 9.910
Authors: Tiago C C Pinto; Leonardo Machado; Tatiana M Bulgacov; Antônio L Rodrigues-Júnior; Maria L G Costa; Rosana C C Ximenes; Everton B Sougey Journal: Int Psychogeriatr Date: 2018-11-14 Impact factor: 3.878