Ji-Young Kim1,2, Dongkyu Oh1, Kiyoung Sung3, Hongyoon Choi4, Jin Chul Paeng1, Gi Jeong Cheon1,5,6, Keon Wook Kang1, Dong Young Lee3,7, Dong Soo Lee1,8. 1. Department of Nuclear Medicine, Seoul National University Hospital, Seoul, Republic of Korea. 2. Department of Nuclear Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea. 3. Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea. 4. Department of Nuclear Medicine, Seoul National University Hospital, Seoul, Republic of Korea. chy1000@snu.ac.kr. 5. Institute on Aging, Seoul National University, Seoul, Republic of Korea. 6. Radiation Medicine Institute, Seoul National University College of Medicine, Seoul, Republic of Korea. 7. Department of Psychiatry, Seoul National University College of Medicine, Seoul, Republic of Korea. 8. Department of Molecular Medicine and Biopharmaceutical Sciences, Graduate School of Convergence Science and Technology, Seoul National University, Seoul, Republic of Korea.
Abstract
PURPOSE: Amyloid PET which has been widely used for noninvasive assessment of cortical amyloid burden is visually interpreted in the clinical setting. As a fast and easy-to-use visual interpretation support system, we analyze whether the deep learning-based end-to-end estimation of amyloid burden improves inter-reader agreement as well as the confidence of the visual reading. METHODS: A total of 121 clinical routines [18F]Florbetaben PET images were collected for the randomized blind-reader study. The amyloid PET images were visually interpreted by three experts independently blind to other information. The readers qualitatively interpreted images without quantification at the first reading session. After more than 2-week interval, the readers additionally interpreted images with the quantification results provided by the deep learning system. The qualitative assessment was based on a 3-point BAPL score (1: no amyloid load, 2: minor amyloid load, and 3: significant amyloid load). The confidence score for each session was evaluated by a 3-point score (0: ambiguous, 1: probably, and 2: definite to decide). RESULTS: Inter-reader agreements for the visual reading based on a 3-point scale (BAPL score) calculated by Fleiss kappa coefficients were 0.46 and 0.76 for the visual reading without and with the deep learning system, respectively. For the two reading sessions, the confidence score of visual reading was improved at the visual reading session with the output (1.27 ± 0.078 for visual reading-only session vs. 1.66 ± 0.63 for a visual reading session with the deep learning system). CONCLUSION: Our results highlight the impact of deep learning-based one-step amyloid burden estimation system on inter-reader agreement and confidence of reading when applied to clinical routine amyloid PET reading.
PURPOSE: Amyloid PET which has been widely used for noninvasive assessment of cortical amyloid burden is visually interpreted in the clinical setting. As a fast and easy-to-use visual interpretation support system, we analyze whether the deep learning-based end-to-end estimation of amyloid burden improves inter-reader agreement as well as the confidence of the visual reading. METHODS: A total of 121 clinical routines [18F]Florbetaben PET images were collected for the randomized blind-reader study. The amyloid PET images were visually interpreted by three experts independently blind to other information. The readers qualitatively interpreted images without quantification at the first reading session. After more than 2-week interval, the readers additionally interpreted images with the quantification results provided by the deep learning system. The qualitative assessment was based on a 3-point BAPL score (1: no amyloid load, 2: minor amyloid load, and 3: significant amyloid load). The confidence score for each session was evaluated by a 3-point score (0: ambiguous, 1: probably, and 2: definite to decide). RESULTS: Inter-reader agreements for the visual reading based on a 3-point scale (BAPL score) calculated by Fleiss kappa coefficients were 0.46 and 0.76 for the visual reading without and with the deep learning system, respectively. For the two reading sessions, the confidence score of visual reading was improved at the visual reading session with the output (1.27 ± 0.078 for visual reading-only session vs. 1.66 ± 0.63 for a visual reading session with the deep learning system). CONCLUSION: Our results highlight the impact of deep learning-based one-step amyloid burden estimation system on inter-reader agreement and confidence of reading when applied to clinical routine amyloid PET reading.
Authors: B J Bacskai; S T Kajdasz; R H Christie; C Carter; D Games; P Seubert; D Schenk; B T Hyman Journal: Nat Med Date: 2001-03 Impact factor: 53.440
Authors: John C Morris; Catherine M Roe; Chengjie Xiong; Anne M Fagan; Alison M Goate; David M Holtzman; Mark A Mintun Journal: Ann Neurol Date: 2010-01 Impact factor: 10.422
Authors: Pierrick Bourgeat; Victor L Villemagne; Vincent Dore; Belinda Brown; S Lance Macaulay; Ralph Martins; Colin L Masters; David Ames; Kathryn Ellis; Christopher C Rowe; Olivier Salvado; Jurgen Fripp Journal: Neurobiol Aging Date: 2014-08-27 Impact factor: 4.673
Authors: Satoshi Minoshima; Alexander E Drzezga; Henryk Barthel; Nicolaas Bohnen; Mehdi Djekidel; David H Lewis; Chester A Mathis; Jonathan McConathy; Agneta Nordberg; Osama Sabri; John P Seibyl; Margaret K Stokes; Koen Van Laere Journal: J Nucl Med Date: 2016-08 Impact factor: 10.057
Authors: A P Nayate; J G Dubroff; J E Schmitt; I Nasrallah; R Kishore; D Mankoff; D A Pryma Journal: AJNR Am J Neuroradiol Date: 2015-03-12 Impact factor: 3.825
Authors: Luping Zhou; Olivier Salvado; Vincent Dore; Pierrick Bourgeat; Parnesh Raniga; S Lance Macaulay; David Ames; Colin L Masters; Kathryn A Ellis; Victor L Villemagne; Christopher C Rowe; Jurgen Fripp Journal: PLoS One Date: 2014-01-10 Impact factor: 3.240
Authors: James Zou; David Park; Aubrey Johnson; Xinyang Feng; Michelle Pardo; Jeanelle France; Zeljko Tomljanovic; Adam M Brickman; Devangere P Devanand; José A Luchsinger; William C Kreisl; Frank A Provenzano Journal: Alzheimers Dement (Amst) Date: 2021-12-31