BACKGROUND AND PURPOSE: Clinical studies currently in progress are using subjective methods to characterize plaque morphology from ultrasound images. However, there are few studies on the intraobserver and interobserver variability of these classifications. This study was designed to assess these variables. METHODS: Grading of plaque morphology from ultrasound images, stored both digitally and to hard copy, was performed by 2 classification schemes. Interobserver agreement was determined by 4 observers. Within-observer agreement was performed at intervals for up to 6 months. Accuracy of the 2 methods was determined by comparison with histology. RESULTS: Within- and between-observer agreement was moderate to good for full-color digital image analyses, with pooled kappa values of kappap=0.49+/-0.10 and kappap=0.62+/-0.07 for the 2-category method and kappap=0.53+/-0.06 and kappap=0.52+/-0.05 for the 4-category method, respectively. Hard copy data analyses gave lower kappa values. The more experienced observers produced higher within-observer agreements and higher correlation with histology. CONCLUSIONS: Reproducible grading of ultrasound images is not consistently achievable among experienced observers, and within-observer agreement may vary with time. The current subjective ultrasound characterization of carotid plaque morphology used in clinical trials may be associated with unacceptable levels of reproducibility in some centers. Variability between observers may be reduced by using the simpler 2-category grading of plaque morphology to interrogate full-color digitally stored images. Observer agreement should be audited regularly.
BACKGROUND AND PURPOSE: Clinical studies currently in progress are using subjective methods to characterize plaque morphology from ultrasound images. However, there are few studies on the intraobserver and interobserver variability of these classifications. This study was designed to assess these variables. METHODS: Grading of plaque morphology from ultrasound images, stored both digitally and to hard copy, was performed by 2 classification schemes. Interobserver agreement was determined by 4 observers. Within-observer agreement was performed at intervals for up to 6 months. Accuracy of the 2 methods was determined by comparison with histology. RESULTS: Within- and between-observer agreement was moderate to good for full-color digital image analyses, with pooled kappa values of kappap=0.49+/-0.10 and kappap=0.62+/-0.07 for the 2-category method and kappap=0.53+/-0.06 and kappap=0.52+/-0.05 for the 4-category method, respectively. Hard copy data analyses gave lower kappa values. The more experienced observers produced higher within-observer agreements and higher correlation with histology. CONCLUSIONS: Reproducible grading of ultrasound images is not consistently achievable among experienced observers, and within-observer agreement may vary with time. The current subjective ultrasound characterization of carotid plaque morphology used in clinical trials may be associated with unacceptable levels of reproducibility in some centers. Variability between observers may be reduced by using the simpler 2-category grading of plaque morphology to interrogate full-color digitally stored images. Observer agreement should be audited regularly.
Authors: M Reiter; R Horvat; S Puchner; W Rinner; P Polterauer; J Lammer; E Minar; R A Bucek Journal: AJNR Am J Neuroradiol Date: 2007-01 Impact factor: 3.825
Authors: D Stojanov; M Ilic; P Bosnjakovic; M Zivkovic; S Jolic; N Vukasinovic; A Ignjatovic; B Ilic; D Benedeto-Stojanov Journal: AJNR Am J Neuroradiol Date: 2011-12-22 Impact factor: 3.825
Authors: Mohamed Ouhlous; H Zwenneke Flach; Thomas T de Weert; Johanna M Hendriks; Marc R H M van Sambeek; Diederik W J Dippel; Peter M T Pattynama; Aad van der Lugt Journal: AJNR Am J Neuroradiol Date: 2005-05 Impact factor: 3.825
Authors: Luca Saba; Skandha S Sanagala; Suneet K Gupta; Vijaya K Koppula; Amer M Johri; Narendra N Khanna; Sophie Mavrogeni; John R Laird; Gyan Pareek; Martin Miner; Petros P Sfikakis; Athanasios Protogerou; Durga P Misra; Vikas Agarwal; Aditya M Sharma; Vijay Viswanathan; Vijay S Rathore; Monika Turk; Raghu Kolluri; Klaudija Viskovic; Elisa Cuadrado-Godia; George D Kitas; Neeraj Sharma; Andrew Nicolaides; Jasjit S Suri Journal: Ann Transl Med Date: 2021-07
Authors: Narendra N Khanna; Ankush D Jamthikar; Deep Gupta; Matteo Piga; Luca Saba; Carlo Carcassi; Argiris A Giannopoulos; Andrew Nicolaides; John R Laird; Harman S Suri; Sophie Mavrogeni; A D Protogerou; Petros Sfikakis; George D Kitas; Jasjit S Suri Journal: Curr Atheroscler Rep Date: 2019-01-25 Impact factor: 5.113