Noha Ali1,2, Danuta M Sampson1,3, Alex Au Yong1, Rumaanah Jeewa1, Saumya Rajgopal1, Deepaysh D C S Dutt1, Sharaf Mohamed2, Shehata Mohamed2, Moreno Menghini4, Alex Hansen4, Fred K Chen1,5. 1. Centre for Ophthalmology and Visual Science (Incorporating Lions Eye Institute), The University of Western Australia, Perth, Western Australia, Australia. 2. Department of Ophthalmology, Faculty of Medicine, Assiut University, Assiut, Egypt. 3. Surrey Biophotonics, Centre for Vision, Speech and Signal Processing and School of Biosciences and Medicine, The University of Surrey, Guildford, UK. 4. Department of Ophthalmology, Sir Charles Gairdner Hospital, Perth, Western Australia, Australia. 5. Department of Ophthalmology, Royal Perth Hospital, Perth, Western Australia, Australia.
Abstract
IMPORTANCE: All automated image quality indicators for en face optical coherence tomography angiography (OCTA) images require gold standard validation for determining optimum thresholds. BACKGROUND: A manual grading system (gold standard) for OCTA images was validated and compared to two automated image quality indicators: signal strength index (SSI) and scan quality index (SQI) generated by different software versions of the Optovue OCTA device. DESIGN: Retrospective cross-sectional study. PARTICIPANTS: A total of 52 eyes of 52 healthy individual and 77 eyes of 51 patients with retinal vascular diseases. METHODS: A total of 129 OCTA images of the superficial vascular plexus were graded manually by three independent examiners. Each image was assigned grades 1 to 4 (1-2, unacceptable; 3-4, acceptable) masked to the software-generated quality indicators. MAIN OUTCOME MEASURES: Inter-grader agreement and comparison of the utility of SSI and SQI in discriminating between acceptable and unacceptable OCTA images. RESULTS: There was a substantial agreement between the three graders (κ = 0.63). Mean SSI and SQI was significantly different between acceptable and unacceptable images (P < .001). SQI outperformed SSI in separating acceptable from unacceptable images (areas under the receiver operating characteristic curve: 0.87 vs 0.80) and the optimum cut-off was ≥7 for SQI and ≥70 for SSI for acceptable images. Up to 30% of images with quality indicators reaching the optimum SQI and SSI cut-off thresholds still had unacceptable quality on manual grading. Unacceptable images were found in 33% and 66% of healthy and diseased eyes, respectively. CONCLUSIONS AND RELEVANCE: SQI is closely related to manual grading but we caution reliance on the optimized threshold to determine image quality. SQI is superior to SSI in discriminating between acceptable and unacceptable images.
IMPORTANCE: All automated image quality indicators for en face optical coherence tomography angiography (OCTA) images require gold standard validation for determining optimum thresholds. BACKGROUND: A manual grading system (gold standard) for OCTA images was validated and compared to two automated image quality indicators: signal strength index (SSI) and scan quality index (SQI) generated by different software versions of the Optovue OCTA device. DESIGN: Retrospective cross-sectional study. PARTICIPANTS: A total of 52 eyes of 52 healthy individual and 77 eyes of 51 patients with retinal vascular diseases. METHODS: A total of 129 OCTA images of the superficial vascular plexus were graded manually by three independent examiners. Each image was assigned grades 1 to 4 (1-2, unacceptable; 3-4, acceptable) masked to the software-generated quality indicators. MAIN OUTCOME MEASURES: Inter-grader agreement and comparison of the utility of SSI and SQI in discriminating between acceptable and unacceptable OCTA images. RESULTS: There was a substantial agreement between the three graders (κ = 0.63). Mean SSI and SQI was significantly different between acceptable and unacceptable images (P < .001). SQI outperformed SSI in separating acceptable from unacceptable images (areas under the receiver operating characteristic curve: 0.87 vs 0.80) and the optimum cut-off was ≥7 for SQI and ≥70 for SSI for acceptable images. Up to 30% of images with quality indicators reaching the optimum SQI and SSI cut-off thresholds still had unacceptable quality on manual grading. Unacceptable images were found in 33% and 66% of healthy and diseased eyes, respectively. CONCLUSIONS AND RELEVANCE: SQI is closely related to manual grading but we caution reliance on the optimized threshold to determine image quality. SQI is superior to SSI in discriminating between acceptable and unacceptable images.
Authors: Danuta M Sampson; Adam M Dubis; Fred K Chen; Robert J Zawadzki; David D Sampson Journal: Light Sci Appl Date: 2022-03-18 Impact factor: 17.782