Kenneth R Conner1,2, Benjamin P Chapman2,3, Annette L Beautrais4, David A Brent5, Jeffrey A Bridge6, Yeates Conwell2, Tyler Falter1, Amanda Holbrook1, Barbara Schneider7. 1. Department of Emergency Medicine, University of Rochester Medical Center, Rochester, NY, USA. 2. Department of Psychiatry, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA. 3. Department of Public Health Sciences, University of Rochester School of Medicine and Dentistry, Rochester, NY, USA. 4. School of Health Sciences, University of Canterbury, Christchurch, New Zealand. 5. Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA. 6. Department of Pediatrics, The Ohio State University, Columbus, OH, USA. 7. Department of Psychiatry, Psychosomatics, and Psychotherapy, Centre of Psychiatry, Johann Wolfgang Goethe-University, Frankfurt/Main, Germany.
Abstract
OBJECTIVE: Case-control psychological autopsy studies are the research standard for the postmortem, quantitative study of ongoing or recent risk factors for suicide. We aimed to develop a reliable checklist of methodological quality of these studies. METHOD: We adapted items from a validated checklist to address general methodological elements and created novel items to address the unique aspects of psychological autopsy research to generate a 16-item checklist assessing reporting, external validity, internal validity, and power. We used percent agreement and kappa to evaluate inter-rater reliability of the items and overall checklist based on independent ratings of 26 case-control psychological autopsy studies conducted internationally. We also summed the items to generate overall quality ratings, assessing internal consistency with coefficient alpha (α). RESULTS: Inter-rater reliability for the overall checklist was high (percent agreement, 86.5%) and that based conservatively on kappa was substantial (κ .71) whereas internal consistency was low (α = 0.56). The inter-rater reliability of the individual items showed acceptable to high agreement. CONCLUSION: A novel checklist provides a reliable means to assess the methodological quality of specific elements of quantitative case-control psychological autopsy studies, providing detailed guidance in planning such studies. Lower internal consistency may limit its utility as a summary measure of study quality.
OBJECTIVE: Case-control psychological autopsy studies are the research standard for the postmortem, quantitative study of ongoing or recent risk factors for suicide. We aimed to develop a reliable checklist of methodological quality of these studies. METHOD: We adapted items from a validated checklist to address general methodological elements and created novel items to address the unique aspects of psychological autopsy research to generate a 16-item checklist assessing reporting, external validity, internal validity, and power. We used percent agreement and kappa to evaluate inter-rater reliability of the items and overall checklist based on independent ratings of 26 case-control psychological autopsy studies conducted internationally. We also summed the items to generate overall quality ratings, assessing internal consistency with coefficient alpha (α). RESULTS: Inter-rater reliability for the overall checklist was high (percent agreement, 86.5%) and that based conservatively on kappa was substantial (κ .71) whereas internal consistency was low (α = 0.56). The inter-rater reliability of the individual items showed acceptable to high agreement. CONCLUSION: A novel checklist provides a reliable means to assess the methodological quality of specific elements of quantitative case-control psychological autopsy studies, providing detailed guidance in planning such studies. Lower internal consistency may limit its utility as a summary measure of study quality.
Authors: Kenneth R Conner; Annette L Beautrais; David A Brent; Yeates Conwell; Michael R Phillips; Barbara Schneider Journal: Suicide Life Threat Behav Date: 2012-01-30
Authors: Margda Waern; Bo S Runeson; Peter Allebeck; Jan Beskow; Eva Rubenowitz; Ingmar Skoog; Katarina Wilhelmsson Journal: Am J Psychiatry Date: 2002-03 Impact factor: 18.112