K C Lee1, R Lew, M A Weinstock. 1. Dermatoepidemiology Unit, VA Medical Center, Providence, RI, U.S.A; Department of Dermatology, Brown University, Providence, RI, U.S.A.
Abstract
BACKGROUND: Actinic keratoses (AKs) often serve as a primary endpoint for clinical studies. However, reliability of counting these lesions is poor, even among expert dermatologists. OBJECTIVES: To investigate the reliability of counting AKs before and after a yearly consensus meeting, held annually for 4 years. METHODS: As part of the Veterans Affairs (VA) Keratinocyte Carcinoma Chemoprevention Trial, board-certified dermatologists convened annually for 4 years to individually count the number of actinic keratoses on three to five test subjects. The dermatologists then met as a group for a consensus discussion on what constituted an AK lesion on each subject. Afterwards, each dermatologist repeated the independent counting exercise on three to five new subjects. The intraclass correlation coefficient (ICC) was used to analyze the reliability of counting AKs among the dermatologists. RESULTS: Eight dermatologists participated in this exercise for 4 consecutive years. Pre-consensus discussion ICCs over 4 years were 0.18, 0.34, 0.38, 0.75, respectively, showing sustained improvement with each consensus discussion. The greatest improvement in reliability of AK counts was shown during the first year of consensus discussions, when the ICC improved from 0.18 to 0.67. There was no improvement by the fourth year of consensus discussion, with pre- and post-consensus ICCs of 0.75 and 0.75, respectively. CONCLUSIONS: Annual consensus discussions can lead to improvement in reliability of AK counts. This improvement was sustained over 4 years. By the fourth year, the discussion meeting had no effect on improvement in reliability. A consensus meeting discussion may be helpful for improving reliability in other trials. Published 2013. This article is a U.S. Government work and is in the public domain in the USA.
BACKGROUND: Actinic keratoses (AKs) often serve as a primary endpoint for clinical studies. However, reliability of counting these lesions is poor, even among expert dermatologists. OBJECTIVES: To investigate the reliability of counting AKs before and after a yearly consensus meeting, held annually for 4 years. METHODS: As part of the Veterans Affairs (VA) Keratinocyte Carcinoma Chemoprevention Trial, board-certified dermatologists convened annually for 4 years to individually count the number of actinic keratoses on three to five test subjects. The dermatologists then met as a group for a consensus discussion on what constituted an AK lesion on each subject. Afterwards, each dermatologist repeated the independent counting exercise on three to five new subjects. The intraclass correlation coefficient (ICC) was used to analyze the reliability of counting AKs among the dermatologists. RESULTS: Eight dermatologists participated in this exercise for 4 consecutive years. Pre-consensus discussion ICCs over 4 years were 0.18, 0.34, 0.38, 0.75, respectively, showing sustained improvement with each consensus discussion. The greatest improvement in reliability of AK counts was shown during the first year of consensus discussions, when the ICC improved from 0.18 to 0.67. There was no improvement by the fourth year of consensus discussion, with pre- and post-consensus ICCs of 0.75 and 0.75, respectively. CONCLUSIONS: Annual consensus discussions can lead to improvement in reliability of AK counts. This improvement was sustained over 4 years. By the fourth year, the discussion meeting had no effect on improvement in reliability. A consensus meeting discussion may be helpful for improving reliability in other trials. Published 2013. This article is a U.S. Government work and is in the public domain in the USA.
Authors: Martin A Weinstock; Soe Soe Thwin; Julia A Siegel; Kimberly Marcolivio; Alexander D Means; Nicholas F Leader; Fiona M Shaw; Daniel Hogan; David Eilers; Susan M Swetter; Suephy C Chen; Sharon E Jacob; Erin M Warshaw; George P Stricklin; Robert P Dellavalle; Navjeet Sidhu-Malik; Nellie Konnikov; Victoria P Werth; Jonette E Keri; Leslie Robinson-Bostom; Robert J Ringer; Robert A Lew; Ryan Ferguson; John J DiGiovanna; Grant D Huang Journal: JAMA Dermatol Date: 2018-02-01 Impact factor: 10.282
Authors: Howa Yeung; Marissa L Baranowski; Robert A Swerlick; Suephy C Chen; Jennifer Hemingway; Danny R Hughes; Richard Duszak Journal: JAMA Dermatol Date: 2018-11-01 Impact factor: 10.282
Authors: Samuel C Hames; Sudipta Sinnya; Jean-Marie Tan; Conrad Morze; Azadeh Sahebian; H Peter Soyer; Tarl W Prow Journal: PLoS One Date: 2015-01-23 Impact factor: 3.240
Authors: Zeeshaan-Ul Hasan; Ikhlaaq Ahmed; Rubeta N Matin; Victoria Homer; John T Lear; Ferina Ismail; Tristan Whitmarsh; Adele C Green; Jason Thomson; Alan Milligan; Sarah Hogan; Vanessa Van-de-Velde; Liza Mitchell-Worsford; Jonathan Kentley; Claire Gaunt; Yolande Jefferson-Hulme; Sarah J Bowden; Piers Gaunt; Keith Wheatley; Charlotte M Proby; Catherine A Harwood Journal: Br J Dermatol Date: 2022-06-14 Impact factor: 11.113