Rory D Watts1, Ian W Li2. 1. School of Population and Global Health, The University of Western Australia, Crawley, Australia. Electronic address: rory.watts@uwa.edu.au. 2. School of Population and Global Health, The University of Western Australia, Crawley, Australia.
Abstract
OBJECTIVE: It is useful for reviewers of economic evaluations to assess quality in a manner that is consistent and comprehensive. Checklists can allow this, but there are concerns about their reliability and how they are used in practice. We aimed to describe how checklists have been used in systematic reviews of health economic evaluations. METHODS: Meta-review with snowball sampling. We compiled a list of checklists for health economic evaluations and searched for the checklists' use in systematic reviews from January 2010 to February 2018. We extracted data regarding checklists used, stated checklist function, subject area, number of reviewers, and issues expressed about checklists. RESULTS: We found 346 systematic reviews since 2010 that used checklists to assess economic evaluations. The most common checklist in use was developed in 1996 by Drummond and Jefferson, and the most common stated use of a checklist was quality assessment. Checklists and their use varied within subject areas; 223 reviews had more than one reviewer who used the checklist. CONCLUSIONS: Use of checklists is inconsistent. Eighteen individual checklists have been used since 2010, many of which have been used in ways different from those originally intended, often without justification. Different systematic reviews in the same subject areas would benefit from using one checklist exclusively, using checklists as intended, and having 2 reviewers complete the checklist. This would increase the likelihood that results are transparent and comparable over time.
OBJECTIVE: It is useful for reviewers of economic evaluations to assess quality in a manner that is consistent and comprehensive. Checklists can allow this, but there are concerns about their reliability and how they are used in practice. We aimed to describe how checklists have been used in systematic reviews of health economic evaluations. METHODS: Meta-review with snowball sampling. We compiled a list of checklists for health economic evaluations and searched for the checklists' use in systematic reviews from January 2010 to February 2018. We extracted data regarding checklists used, stated checklist function, subject area, number of reviewers, and issues expressed about checklists. RESULTS: We found 346 systematic reviews since 2010 that used checklists to assess economic evaluations. The most common checklist in use was developed in 1996 by Drummond and Jefferson, and the most common stated use of a checklist was quality assessment. Checklists and their use varied within subject areas; 223 reviews had more than one reviewer who used the checklist. CONCLUSIONS: Use of checklists is inconsistent. Eighteen individual checklists have been used since 2010, many of which have been used in ways different from those originally intended, often without justification. Different systematic reviews in the same subject areas would benefit from using one checklist exclusively, using checklists as intended, and having 2 reviewers complete the checklist. This would increase the likelihood that results are transparent and comparable over time.
Authors: Karl Johnson; Katherine W Saylor; Isabella Guynn; Karen Hicklin; Jonathan S Berg; Kristen Hassmiller Lich Journal: Genet Med Date: 2021-12-07 Impact factor: 8.822
Authors: Lina Gega; Dina Jankovic; Pedro Saramago; David Marshall; Sarah Dawson; Sally Brabyn; Georgios F Nikolaidis; Hollie Melton; Rachel Churchill; Laura Bojke Journal: Health Technol Assess Date: 2022-01 Impact factor: 4.014
Authors: Huong Ngoc Quynh Tran; Emma McMahon; Marj Moodie; Jaithri Ananthapavan Journal: Int J Environ Res Public Health Date: 2021-02-02 Impact factor: 3.390