C Fink1, C Alt1, L Uhlmann2, C Klose2, A Enk1, H A Haenssle1. 1. Department of Dermatology, University of Heidelberg, Heidelberg, Germany. 2. Institute of Medical Biometry and Informatics, University of Heidelberg, Heidelberg, Germany.
Abstract
BACKGROUND: The Psoriasis Area and Severity Index (PASI) is the standard for psoriasis severity assessment. However, PASI measurement is complex and subjective, frequently leading to a high intra- and interobserver variability. To date, the precise extent of variability in PASI measurements and its underlying causes remain unknown. OBJECTIVE: To determine the inter- and intrarater variability of image-based PASI measurements by calculating Intra-Class-Correlation-Coefficients (ICCs) and to investigate the impact of the different PASI components and specific anatomic regions on the extent of variability. METHODS: First, the methodology of 'image-based' vs. commonly used 'live' PASI measurements was validated in a pilot study. Next, in an observational cohort study, PASI scores of 120 patients affected by plaque psoriasis were prospectively evaluated by three formally trained physicians by means of total body images (TBI). Each observer independently performed two rounds of image-based PASI calculations in all patients at two different time points. RESULTS: Overall, 720 image-based PASI scores were calculated with a mean PASI of 8.8 (range 0.7-34.8). An interrater variability with an ICC of 0.895 and mean absolute difference (MAD) of 3.3 PASI points were observed. Intrarater variability showed a mean ICC of 0.877 and a MAD of 2.2 points. When considering specific PASI components, the highest agreement was found for the assessment of the involved body surface area (BSA), while the lowest ICCs were calculated for severity scoring of 'scaling' and 'induration'. As BSA scores serve as a multiplier in the calculation of PASI, minor inaccuracies were capable of inducing a large share of variability. CONCLUSION: The overall inter- and intrarater reliability of image-based PASI measurements in this study was good. However, physicians were formally trained and experienced, which frequently is not the case in a real-life clinical setting. Therefore, new strategies for higher standardization and objectivity of PASI calculations are needed.
BACKGROUND: The Psoriasis Area and Severity Index (PASI) is the standard for psoriasis severity assessment. However, PASI measurement is complex and subjective, frequently leading to a high intra- and interobserver variability. To date, the precise extent of variability in PASI measurements and its underlying causes remain unknown. OBJECTIVE: To determine the inter- and intrarater variability of image-based PASI measurements by calculating Intra-Class-Correlation-Coefficients (ICCs) and to investigate the impact of the different PASI components and specific anatomic regions on the extent of variability. METHODS: First, the methodology of 'image-based' vs. commonly used 'live' PASI measurements was validated in a pilot study. Next, in an observational cohort study, PASI scores of 120 patients affected by plaque psoriasis were prospectively evaluated by three formally trained physicians by means of total body images (TBI). Each observer independently performed two rounds of image-based PASI calculations in all patients at two different time points. RESULTS: Overall, 720 image-based PASI scores were calculated with a mean PASI of 8.8 (range 0.7-34.8). An interrater variability with an ICC of 0.895 and mean absolute difference (MAD) of 3.3 PASI points were observed. Intrarater variability showed a mean ICC of 0.877 and a MAD of 2.2 points. When considering specific PASI components, the highest agreement was found for the assessment of the involved body surface area (BSA), while the lowest ICCs were calculated for severity scoring of 'scaling' and 'induration'. As BSA scores serve as a multiplier in the calculation of PASI, minor inaccuracies were capable of inducing a large share of variability. CONCLUSION: The overall inter- and intrarater reliability of image-based PASI measurements in this study was good. However, physicians were formally trained and experienced, which frequently is not the case in a real-life clinical setting. Therefore, new strategies for higher standardization and objectivity of PASI calculations are needed.
Authors: M J Schaap; N J Cardozo; A Patel; E M G J de Jong; B van Ginneken; M M B Seyger Journal: J Eur Acad Dermatol Venereol Date: 2021-10-18 Impact factor: 9.228
Authors: Fedor Shmarov; Graham R Smith; Sophie C Weatherhead; Nick J Reynolds; Paolo Zuliani Journal: PLoS Comput Biol Date: 2022-09-30 Impact factor: 4.779