OBJECTIVES: The objectives of this study is to review the set of criteria of the Institute of Medicine (IOM) for priority-setting in research with addition of new criteria if necessary, and to develop and evaluate the reliability and validity of the final priority score. METHODS: Based on the evaluation of 199 research topics, forty-five experts identified additional criteria for priority-setting, rated their relevance, and ranked and weighted them in a three-round modified Delphi technique. A final priority score was developed and evaluated. Internal consistency, test-retest and inter-rater reliability were assessed. Correlation with experts' overall qualitative topic ratings were assessed as an approximation to validity. RESULTS: All seven original IOM criteria were considered relevant and two new criteria were added ("potential for translation into practice", and "need for knowledge"). Final ranks and relative weights differed from those of the original IOM criteria: "research impact on health outcomes" was considered the most important criterion (4.23), as opposed to "burden of disease" (3.92). Cronbach's alpha (0.75) and test-retest stability (interclass correlation coefficient = 0.66) for the final set of criteria were acceptable. The area under the receiver operating characteristic curve for overall assessment of priority was 0.66. CONCLUSIONS: A reliable instrument for prioritizing topics in clinical and health services research has been developed. Further evaluation of its validity and impact on selecting research topics is required.
OBJECTIVES: The objectives of this study is to review the set of criteria of the Institute of Medicine (IOM) for priority-setting in research with addition of new criteria if necessary, and to develop and evaluate the reliability and validity of the final priority score. METHODS: Based on the evaluation of 199 research topics, forty-five experts identified additional criteria for priority-setting, rated their relevance, and ranked and weighted them in a three-round modified Delphi technique. A final priority score was developed and evaluated. Internal consistency, test-retest and inter-rater reliability were assessed. Correlation with experts' overall qualitative topic ratings were assessed as an approximation to validity. RESULTS: All seven original IOM criteria were considered relevant and two new criteria were added ("potential for translation into practice", and "need for knowledge"). Final ranks and relative weights differed from those of the original IOM criteria: "research impact on health outcomes" was considered the most important criterion (4.23), as opposed to "burden of disease" (3.92). Cronbach's alpha (0.75) and test-retest stability (interclass correlation coefficient = 0.66) for the final set of criteria were acceptable. The area under the receiver operating characteristic curve for overall assessment of priority was 0.66. CONCLUSIONS: A reliable instrument for prioritizing topics in clinical and health services research has been developed. Further evaluation of its validity and impact on selecting research topics is required.
Authors: Yanina Balabanova; Andreas Gilsdorf; Silke Buda; Reinhard Burger; Tim Eckmanns; Barbara Gärtner; Uwe Gross; Walter Haas; Osamah Hamouda; Johannes Hübner; Thomas Jänisch; Manfred Kist; Michael H Kramer; Thomas Ledig; Martin Mielke; Matthias Pulz; Klaus Stark; Norbert Suttorp; Uta Ulbrich; Ole Wichmann; Gérard Krause Journal: PLoS One Date: 2011-10-04 Impact factor: 3.240
Authors: D Plass; M-J J Mangen; A Kraemer; P Pinheiro; A Gilsdorf; G Krause; C L Gibbons; A VAN Lier; S A McDONALD; R J Brooke; P Kramarz; A Cassini; M E E Kretzschmar Journal: Epidemiol Infect Date: 2014-01-02 Impact factor: 4.434
Authors: Michael J Garner; Carolee Carson; Erika J Lingohr; Aamir Fazil; Victoria L Edge; Jan Trumble Waddell Journal: PLoS One Date: 2015-04-23 Impact factor: 3.240
Authors: Nicole M Rankin; Deborah McGregor; Phyllis N Butow; Kate White; Jane L Phillips; Jane M Young; Sallie A Pearson; Sarah York; Tim Shaw Journal: BMC Med Res Methodol Date: 2016-08-26 Impact factor: 4.615
Authors: Juan Camilo Fuentes; Lorena Andrea Cañón; Ángela Viviana Pérez; Carlos E Pinzón; Angélica María Pérez; Paola Astrid Avellaneda; Álvaro Enrique Morales; Y Jorge Enrique Fernández Journal: Rev Panam Salud Publica Date: 2017-11-30