Floris Chabrun 1,2 , Xavier Dieu 1,2 , Marc Ferre 2 , Olivier Gaillard 3 , Anthony Mery 1 , Juan Manuel Chao de la Barca 1,2 , Audrey Taisne 1 , Geoffrey Urbanski 2,4 , Pascal Reynier 1,2 , Delphine Mirebeau-Prunier 1,2 . Show Affiliations »
Abstract
BACKGROUND: Serum protein electrophoresis (SPE) is a common clinical laboratory test, mainly indicated for the diagnosis and follow-up of monoclonal gammopathies. A time-consuming and potentially subjective human expertise is required for SPE analysis to detect possible pitfalls and to provide a clinically relevant interpretation. METHODS: An expert-annotated SPE dataset of 159 969 entries was used to develop SPECTR (serum protein electrophoresis computer-assisted recognition), a deep learning-based artificial intelligence, which analyzes and interprets raw SPE curves produced by an analytical system into text comments that can be used by practitioners. It was designed following academic recommendations for SPE interpretation, using a transparent architecture avoiding the "black box" effect. SPECTR was validated on an external, independent cohort of 70 362 SPEs and challenged by a panel of 9 independent experts from other hospital centers. RESULTS: SPECTR was able to identify accurately both quantitative abnormalities (r ≥ 0.98 for fractions quantification) and qualitative abnormalities [receiver operating characteristic-area under curve (ROC-AUC) ≥ 0.90 for M-spikes, restricted heterogeneity of immunoglobulins, and beta-gamma bridging]. Furthermore, it showed highly accurate at both detecting (ROC-AUC ≥ 0.99) and quantifying (r = 0.99) M-spikes. It proved highly reproducible and resilient to minor variations and its agreement with human experts was higher (κ = 0.632) than experts between each other (κ = 0.624). CONCLUSIONS: SPECTR is an algorithm based on artificial intelligence suitable to high-throughput SPEs analyses and interpretation. It aims at improving SPE reproducibility and reliability. It is freely available in open access through an online tool providing fully editable validation assistance for SPE. © American Association for Clinical Chemistry 2021.
BACKGROUND: Serum protein electrophoresis (SPE) is a common clinical laboratory test, mainly indicated for the diagnosis and follow-up of monoclonal gammopathies. A time-consuming and potentially subjective human expertise is required for SPE analysis to detect possible pitfalls and to provide a clinically relevant interpretation. METHODS: An expert-annotated SPE dataset of 159 969 entries was used to develop SPECTR (serum protein electrophoresis computer-assisted recognition), a deep learning-based artificial intelligence, which analyzes and interprets raw SPE curves produced by an analytical system into text comments that can be used by practitioners. It was designed following academic recommendations for SPE interpretation, using a transparent architecture avoiding the "black box" effect. SPECTR was validated on an external, independent cohort of 70 362 SPEs and challenged by a panel of 9 independent experts from other hospital centers. RESULTS: SPECTR was able to identify accurately both quantitative abnormalities (r ≥ 0.98 for fractions quantification) and qualitative abnormalities [receiver operating characteristic-area under curve (ROC-AUC) ≥ 0.90 for M-spikes, restricted heterogeneity of immunoglobulins, and beta-gamma bridging]. Furthermore, it showed highly accurate at both detecting (ROC-AUC ≥ 0.99) and quantifying (r = 0.99) M-spikes. It proved highly reproducible and resilient to minor variations and its agreement with human experts was higher (κ = 0.632) than experts between each other (κ = 0.624). CONCLUSIONS: SPECTR is an algorithm based on artificial intelligence suitable to high-throughput SPEs analyses and interpretation. It aims at improving SPE reproducibility and reliability. It is freely available in open access through an online tool providing fully editable validation assistance for SPE. © American Association for Clinical Chemistry 2021.
Entities: Chemical
Keywords:
artificial intelligence; deep learning; monoclonal gammopathy; myeloma; neural network; serum protein electrophoresis
Mesh: See more »
Substances: See more »
Year: 2021
PMID: 34491313 DOI: 10.1093/clinchem/hvab133
Source DB: PubMed Journal: Clin Chem ISSN: 0009-9147 Impact factor: 12.167