Okan Dilek1, Omer Kaya2, Hüseyin Akkaya3, Cem Ceylan1, Alper Kızıloglu4, Betul Sahin Eker5, Bozkurt Gulek1. 1. Department of Radiology, University of Health Sciences, Adana Teaching and Research Hospital, Adana, Turkey. 2. Department of Radiology, Cukurova University Faculty of Medicine, Adana, Trukey. 3. Department of Radiology, Siverek City of Hospital, Sanlıurfa, Turkey. 4. Department of Radiology, Develi City of Hospital, Kayseri, Turkey. 5. Department of Infectious Diseases and Clinical Microbiology, University of Health Sciences, Adana Teaching and Research Hospital, Adana, Turkey.
Abstract
PURPOSE: We aimed to evaluate the use of the COVID-19 reporting and data system (CO-RADS) among radiologists and the diagnostic performance of this system. METHODS: Four radiologists retrospectively evaluated the chest CT examinations of 178 patients. The study included 143 patients with positive reverse transcriptase-polymerase chain reaction (RT-PCR) test results and 35 patients whose RT-PCR tests were negative but whose clinical and/or radiological findings were consistent with COVID-19. Fleiss' kappa (κ) values were calculated, and individual observers' scores were compared. To investigate diagnostic efficiency, receiver operating characteristic (ROC) curves were calculated for each interpreter. RESULTS: The interpreters were in full agreement on 574 of 712 (80.6%) evaluations. The common Fleiss' κ value of all the radiologists combined was 0.712 (95% confidence interval [CI] 0.692-0.769). A reliable prediction on the basis of RT-PCR and clinical findings indicated the mean area under the curve (AUC) of Fleiss' κ value as 0.89 (95% CI 0.708-0.990). General interpreter agreement was found to range from moderate to good. CONCLUSION: The interpreter agreement for CO-RADS categories 1 and 5 was reasonably good. We conclude that this scoring system will make a valuable contribution to efforts in COVID-19 diagnosis. CO-RADS can also be of significant value for the diagnosis and treatment of the disease in cases with false-negative PCR results.
PURPOSE: We aimed to evaluate the use of the COVID-19 reporting and data system (CO-RADS) among radiologists and the diagnostic performance of this system. METHODS: Four radiologists retrospectively evaluated the chest CT examinations of 178 patients. The study included 143 patients with positive reverse transcriptase-polymerase chain reaction (RT-PCR) test results and 35 patients whose RT-PCR tests were negative but whose clinical and/or radiological findings were consistent with COVID-19. Fleiss' kappa (κ) values were calculated, and individual observers' scores were compared. To investigate diagnostic efficiency, receiver operating characteristic (ROC) curves were calculated for each interpreter. RESULTS: The interpreters were in full agreement on 574 of 712 (80.6%) evaluations. The common Fleiss' κ value of all the radiologists combined was 0.712 (95% confidence interval [CI] 0.692-0.769). A reliable prediction on the basis of RT-PCR and clinical findings indicated the mean area under the curve (AUC) of Fleiss' κ value as 0.89 (95% CI 0.708-0.990). General interpreter agreement was found to range from moderate to good. CONCLUSION: The interpreter agreement for CO-RADS categories 1 and 5 was reasonably good. We conclude that this scoring system will make a valuable contribution to efforts in COVID-19 diagnosis. CO-RADS can also be of significant value for the diagnosis and treatment of the disease in cases with false-negative PCR results.
Authors: Yeshaswini Nagaraj; Gonda de Jonge; Anna Andreychenko; Gabriele Presti; Matthias A Fink; Nikolay Pavlov; Carlo C Quattrocchi; Sergey Morozov; Raymond Veldhuis; Matthijs Oudkerk; Peter M A van Ooijen Journal: Eur Radiol Date: 2022-04-01 Impact factor: 7.034