Literature DB >> 35918465

MDFNet: application of multimodal fusion method based on skin image and clinical data to skin cancer classification.

Qian Chen1, Min Li2,3, Chen Chen2,4, Panyun Zhou1, Xiaoyi Lv5,6,7,8, Cheng Chen9.   

Abstract

PURPOSE: Skin cancer is one of the ten most common cancer types in the world. Early diagnosis and treatment can effectively reduce the mortality of patients. Therefore, it is of great significance to develop an intelligent diagnosis system for skin cancer. According to the survey, at present, most intelligent diagnosis systems of skin cancer only use skin image data, but the multi-modal cross-fusion analysis using image data and patient clinical data is limited. Therefore, to further explore the complementary relationship between image data and patient clinical data, we propose multimode data fusion diagnosis network (MDFNet), a framework for skin cancer based on data fusion strategy.
METHODS: MDFNet establishes an effective mapping among heterogeneous data features, effectively fuses clinical skin images and patient clinical data, and effectively solves the problems of feature paucity and insufficient feature richness that only use single-mode data.
RESULTS: The experimental results present that our proposed smart skin cancer diagnosis model has an accuracy of 80.42%, which is an improvement of about 9% compared with the model accuracy using only medical images, thus effectively confirming the unique fusion advantages exhibited by MDFNet.
CONCLUSIONS: This illustrates that MDFNet can not only be applied as an effective auxiliary diagnostic tool for skin cancer diagnosis, help physicians improve clinical decision-making ability and effectively improve the efficiency of clinical medicine diagnosis, but also its proposed data fusion method fully exerts the advantage of information convergence and has a certain reference value for the intelligent diagnosis of numerous clinical diseases.
© 2022. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.

Entities:  

Keywords:  Clinical data; Computer-aided diagnosis; Multimodal data fusion; Skin cancer

Year:  2022        PMID: 35918465     DOI: 10.1007/s00432-022-04180-1

Source DB:  PubMed          Journal:  J Cancer Res Clin Oncol        ISSN: 0171-5216            Impact factor:   4.322


  18 in total

1.  The impact of patient clinical information on automated skin cancer detection.

Authors:  Andre G C Pacheco; Renato A Krohling
Journal:  Comput Biol Med       Date:  2019-11-18       Impact factor: 4.589

2.  Long short-term memory.

Authors:  S Hochreiter; J Schmidhuber
Journal:  Neural Comput       Date:  1997-11-15       Impact factor: 2.026

Review 3.  Dermoscopy Image Analysis: Overview and Future Directions.

Authors:  M Emre Celebi; Noel Codella; Allan Halpern
Journal:  IEEE J Biomed Health Inform       Date:  2019-01-28       Impact factor: 5.772

4.  Multiple skin lesions diagnostics via integrated deep convolutional networks for segmentation and classification.

Authors:  Mohammed A Al-Masni; Dong-Hyun Kim; Tae-Seong Kim
Journal:  Comput Methods Programs Biomed       Date:  2020-01-23       Impact factor: 5.428

5.  Transfer learning using a multi-scale and multi-network ensemble for skin lesion classification.

Authors:  Amirreza Mahbod; Gerald Schaefer; Chunliang Wang; Georg Dorffner; Rupert Ecker; Isabella Ellinger
Journal:  Comput Methods Programs Biomed       Date:  2020-03-21       Impact factor: 5.428

6.  Risk factors for basal cell carcinoma in a Mediterranean population: role of recreational sun exposure early in life.

Authors:  R Corona; E Dogliotti; M D'Errico; F Sera; I Iavarone; G Baliva; L M Chinni; T Gobello; C Mazzanti; P Puddu; P Pasquini
Journal:  Arch Dermatol       Date:  2001-09

7.  The Impact of Smoking on Sentinel Node Metastasis of Primary Cutaneous Melanoma.

Authors:  Maris S Jones; Peter C Jones; Stacey L Stern; David Elashoff; Dave S B Hoon; John Thompson; Nicola Mozzillo; Omgo E Nieweg; Dirk Noyes; Harald J Hoekstra; Jonathan S Zager; Daniel F Roses; Alessandro Testori; Brendon J Coventry; Mark B Smithers; Robert Andtbacka; Doreen Agnese; Erwin Schultz; Eddy C Hsueh; Mark Kelley; Schlomo Schneebaum; Lisa Jacobs; Tawnya Bowles; Mohammed Kashani-Sabet; Douglas Johnson; Mark B Faries
Journal:  Ann Surg Oncol       Date:  2017-02-21       Impact factor: 5.344

8.  A deep feature fusion methodology for breast cancer diagnosis demonstrated on three imaging modality datasets.

Authors:  Natalia Antropova; Benjamin Q Huynh; Maryellen L Giger
Journal:  Med Phys       Date:  2017-08-12       Impact factor: 4.071

9.  The ABCD rule of dermatoscopy. High prospective value in the diagnosis of doubtful melanocytic skin lesions.

Authors:  F Nachbar; W Stolz; T Merkle; A B Cognetta; T Vogt; M Landthaler; P Bilek; O Braun-Falco; G Plewig
Journal:  J Am Acad Dermatol       Date:  1994-04       Impact factor: 11.527

10.  Tobacco smoking, snuff dipping and the risk of cutaneous squamous cell carcinoma: a nationwide cohort study in Sweden.

Authors:  A Odenbro; R Bellocco; P Boffetta; B Lindelöf; J Adami
Journal:  Br J Cancer       Date:  2005-04-11       Impact factor: 7.640

View more
  1 in total

1.  A deep learning based multimodal fusion model for skin lesion diagnosis using smartphone collected clinical images and metadata.

Authors:  Chubin Ou; Sitong Zhou; Ronghua Yang; Weili Jiang; Haoyang He; Wenjun Gan; Wentao Chen; Xinchi Qin; Wei Luo; Xiaobing Pi; Jiehua Li
Journal:  Front Surg       Date:  2022-10-04
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.