Wei Xu1, Jiuyi Huang2, Qingsong Yu1, Hongfan Yu1, Yang Pu1, Qiuling Shi3. 1. School of Public Health and Management, Chongqing Medical University, Chongqing, 400016, China. 2. Community Prevention Research Unit, Shanghai Institute of Cerebrovascular Disease Prevention, Shanghai, 201203, China. 3. School of Public Health and Management, Chongqing Medical University, Chongqing, 400016, China. qshi@cqmu.edu.cn.
Abstract
AIMS: The methodological quality of development, validation, and modification of those models have not been evaluated via a thoroughly literature review. This study aims to describe the overall status and evaluate the methodological quality of risk prediction models for stroke incidence in the general population. METHODS: We searched the database of EMBASE and MEDLINE by the combination of subject words and key words to collect the research on stroke risk prediction model in the general population. The retrieval time was from the establishment of the database to September 2019. It should be mentioned that risk of bias for each model was assessed, and data on population characteristics and model performance was also extracted. RESULTS: The search screened 11,386 peer-reviewed publications and 57 citation searching, of which 48 were included in the review, describing the development of 51 prediction models, 47 external validation models, and 12 modification models. Among 51 development models, the predicted outcome concentrated on fatal or non-fatal stroke (n = 37, 73%). Thirty-nine development models (76%) were without internal validation. C-statistic or AUC was adopted for discrimination in 80% models, and Hosmer-Lemeshow test (n = 25, 49%) was also performed for calibration. Twenty-six development models (53%) were externally validated, among which only 2 (8%) were validated by independent researchers. Risk prediction performance was improved when models were modified by adding novel risk factors, such as the internal carotid artery plaque and intima-media thickness. CONCLUSION: Models for predicting stroke occurrence need further external validation, recalibration, or modification in different populations, to help interpret those models in the practice of stroke prevention.
AIMS: The methodological quality of development, validation, and modification of those models have not been evaluated via a thoroughly literature review. This study aims to describe the overall status and evaluate the methodological quality of risk prediction models for stroke incidence in the general population. METHODS: We searched the database of EMBASE and MEDLINE by the combination of subject words and key words to collect the research on stroke risk prediction model in the general population. The retrieval time was from the establishment of the database to September 2019. It should be mentioned that risk of bias for each model was assessed, and data on population characteristics and model performance was also extracted. RESULTS: The search screened 11,386 peer-reviewed publications and 57 citation searching, of which 48 were included in the review, describing the development of 51 prediction models, 47 external validation models, and 12 modification models. Among 51 development models, the predicted outcome concentrated on fatal or non-fatal stroke (n = 37, 73%). Thirty-nine development models (76%) were without internal validation. C-statistic or AUC was adopted for discrimination in 80% models, and Hosmer-Lemeshow test (n = 25, 49%) was also performed for calibration. Twenty-six development models (53%) were externally validated, among which only 2 (8%) were validated by independent researchers. Risk prediction performance was improved when models were modified by adding novel risk factors, such as the internal carotid artery plaque and intima-media thickness. CONCLUSION: Models for predicting stroke occurrence need further external validation, recalibration, or modification in different populations, to help interpret those models in the practice of stroke prevention.
Authors: Alan S Go; Dariush Mozaffarian; Véronique L Roger; Emelia J Benjamin; Jarett D Berry; Michael J Blaha; Shifan Dai; Earl S Ford; Caroline S Fox; Sheila Franco; Heather J Fullerton; Cathleen Gillespie; Susan M Hailpern; John A Heit; Virginia J Howard; Mark D Huffman; Suzanne E Judd; Brett M Kissela; Steven J Kittner; Daniel T Lackland; Judith H Lichtman; Lynda D Lisabeth; Rachel H Mackey; David J Magid; Gregory M Marcus; Ariane Marelli; David B Matchar; Darren K McGuire; Emile R Mohler; Claudia S Moy; Michael E Mussolino; Robert W Neumar; Graham Nichol; Dilip K Pandey; Nina P Paynter; Matthew J Reeves; Paul D Sorlie; Joel Stein; Amytis Towfighi; Tanya N Turan; Salim S Virani; Nathan D Wong; Daniel Woo; Melanie B Turner Journal: Circulation Date: 2013-12-18 Impact factor: 29.690
Authors: Jaume Marrugat; Isaac Subirana; Rafel Ramos; Joan Vila; Alejandro Marín-Ibañez; María Jesús Guembe; Fernando Rigo; María José Tormo Díaz; Conchi Moreno-Iribas; Joan Josep Cabré; Antonio Segura; José Miguel Baena-Díez; Agustín Gómez de la Cámara; José Lapetra; María Grau; Miquel Quesada; María José Medrano; Paulino González Diego; Guiem Frontera; Diana Gavrila; Eva Ardanaz Aicua; Josep Basora; José María García; Manuel García-Lareo; José Antonio Gutierrez; Eduardo Mayoral; Joan Sala; Ralph D'Agostino; Roberto Elosua Journal: Prev Med Date: 2014-01-09 Impact factor: 4.018
Authors: Olaniyi James Ekundayo; Stefanie D Vassar; Linda S Williams; Dawn M Bravata; Eric M Cheng Journal: Stroke Date: 2011-05-05 Impact factor: 7.914
Authors: Anders Borglykke; Anne H Andreasen; Kari Kuulasmaa; Susana Sans; Pierre Ducimetière; Diego Vanuzzo; Marco M Ferrario; Luigi Palmieri; Juha Karvanen; Hugh Tunstall-Pedoe; Torben Jørgensen Journal: Heart Date: 2010-10-14 Impact factor: 5.994