| Literature DB >> 35361176 |
Yoonjoo Kim1, YunKyong Hyon2, Sunju Lee2, Seong-Dae Woo1, Taeyoung Ha3, Chaeuk Chung4,5.
Abstract
Auscultation with stethoscope has been an essential tool for diagnosing the patients with respiratory disease. Although auscultation is non-invasive, rapid, and inexpensive, it has intrinsic limitations such as inter-listener variability and subjectivity, and the examination must be performed face-to-face. Conventional stethoscope could not record the respiratory sounds, so it was impossible to share the sounds. Recent innovative digital stethoscopes have overcome the limitations and enabled clinicians to store and share the sounds for education and discussion. In particular, the recordable stethoscope made it possible to analyze breathing sounds using artificial intelligence, especially based on neural network. Deep learning-based analysis with an automatic feature extractor and convoluted neural network classifier has been applied for the accurate analysis of respiratory sounds. In addition, the current advances in battery technology, embedded processors with low power consumption, and integrated sensors make possible the development of wearable and wireless stethoscopes, which can help to examine patients living in areas of a shortage of doctors or those who need isolation. There are still challenges to overcome, such as the analysis of complex and mixed respiratory sounds and noise filtering, but continuous research and technological development will facilitate the transition to a new era of a wearable and smart stethoscope.Entities:
Keywords: Artificial intelligence; Auscultation; Deep learning; Digital stethoscope; Neural network; Wearable or wireless device
Mesh:
Year: 2022 PMID: 35361176 PMCID: PMC8969404 DOI: 10.1186/s12890-022-01896-1
Source DB: PubMed Journal: BMC Pulm Med ISSN: 1471-2466 Impact factor: 3.317
Classification of abnormal lung sounds and related diseases
Accuracy of human auscultation
| Topic of study | Results | References |
|---|---|---|
| The accuracy of lung auscultation | <Correct detection rate by sounds> | [ |
| – Pulmonologists: 28% (abnormal bronchial sound), 90% (wheezes) | ||
| – Pediatricians: 16% (abnormal bronchial sound), 83% (wheezes) | ||
| – Interns: 13% (abnormal bronchial sound), 83% (wheezes) | ||
| Physicians’ classification of lung sounds from video recordings | <Multirater agreement (Fleiss’ κ) between observers> | [ |
| – Detailed categories: 0.04 (rhonchi), 0.43 (high-pitched wheezes) | ||
| – Combined categories: 0.59 (wheezes), 0.62 (crackles) | ||
| Pulmonary auscultatory skills during training in internal medicine and family practice | <Identification rates by sounds> | [ |
| – Trainees of family practice: 0% (whispered pectoriloquy), 84% (expiratory wheeze) | ||
| – Trainees of internal medicine: 1% (whispered pectoriloquy), 82% (expiratory wheeze) | ||
| – Pulmonary fellows: 5% (whispered pectoriloquy), 100% (expiratory wheeze) | ||
| Comparing the auscultatory accuracy of health care professionals | <Correct detection rates by sounds> | [ |
| – Staff of internal medicine: 86.7% (wheezes), 96.7% (crackles) | ||
| – Resident of internal medicine: 59.0% (crackles), 80.0% (wheezes) | ||
| – Adult ICU nurses: 47.0% (crackles), 88.0% (wheezes) | ||
| The contribution of spectrogram for visualization sound in clinical practice | <Proper diagnosis rate of medical students> | [ |
| Normal sounds: 57% (sound) → 63% (plus spectrogram) | ||
| Wheezes: 70% (sound) → 83% (plus spectrogram) | ||
| Crackles: 53% (sound) → 70% (plus spectrogram) | ||
| Stridor: 70% (sound) → 73% (plus spectrogram) |
Deep learning-based analysis of respiratory sounds
| Topic of study | Number of subject/recording | Number of classes | Applied model | Result | References | |
|---|---|---|---|---|---|---|
| Recognition of pulmonary diseases from lung sounds using CNN and LSTM | 213/1483 | 6: Normal, asthma, pneumonia, bronchiectasis, COPD, heart failure | CNN, biLSTM | Accuracy | [ | |
| biLSTM: 98.16% | ||||||
| CNN: 99.04% | ||||||
| CNN + biLSTM: 99.62% | ||||||
| Classification of respiratory sounds using OST and deep residual networks | Not available/489 | 3: Crackle, wheeze, normal | OST, ResNets | Accuracy | [ | |
| STFT: 93.98% | ||||||
| ST: 97.79% | ||||||
| OST + ResNets: 98.79% | ||||||
| Detection of respiratory sounds based on wavelet coefficients and machine learning | 130/705 | 3: Crackles, rhonchi, normal | SVM, ANN, KNN | Accuracy | [ | |
| SVM: 69.50% | ||||||
| ANN: 85.43% | ||||||
| KNN: 68.51% | ||||||
| Benchmarking of eight recurrent neural network variants for breath phase and adventitious sound detection | 279/9765 | 6: Inhalation, exhalation, wheeze, stridor, rhonchus, crackles | LSTM, GRU, BiLSTM, BiGRUc, CNN-LSTM, CNN-GRU, CNN-BiLSTM, and CNN-BiGRU | F1 score | [ | |
| LSTM: 73.9% | GRU: 77.6% | |||||
| BiLSTM: 76.2% | BiGRU: 78.4% | |||||
| CNN-LSTM: 78.1% | CNN-GRU: 80.6% | |||||
| CNN-BiLSTM: 80.3% | CNN-BiGRU: 80.6% | |||||
| Classification of lung sounds through DS-CNN models with fused STFT and MFCC features | Not available/12,691 | 4: Normal, wheeze, crackle, unknown | DS-CNN, VGG-16, AlexNet, DS-AlexNet, LSTM, GRU, TCNd | Accuracy | [ | |
| DS-CNN: 85.74% | VGG-16: 85.66% | |||||
| AlexNet: 79.92% | DS-AlexNet: 80.86% | |||||
| LSTM: 76.92% | GRU: 78.50% | |||||
| TCN: 75.51% | ||||||
| Implementation of AI algorithms in pulmonary auscultation examination | 50/522 | 4: Wheezes, rhonchi, fine and coarse crackles | Neural network | F1-score (%) | [ | |
| Coarse crackles: Doctors (42.8%), NN (47.1%) | ||||||
| Fine crackles: Doctors (51.1%), NN (64.6%) | ||||||
| Wheezes: Doctors (61.8%), NN (66.4%) | ||||||
| Rhonchi: Doctors (61.0%), NN (72%) | ||||||
| AI accuracy in detecting pathological breath sounds in children | 25/192 | 2: Crackles, wheeze | Neural network | PPAa/NPAb | [ | |
| Crackles: Clinicloud 0.95/0.99, Littman 0.82/0.96 | ||||||
| Wheezes: Clinicloud 0.90/0.97, Littman 0.80/0.95 | ||||||
| Classification of lung sounds using CNN | 1630/17,930 | ① 2: Healthy, pathological | CNN, SVM | Accuracy (CNN/SVM) | [ | |
| ② 3: Rale, rhonchus, normal | ① 86%/86% | ② 76%/75% | ||||
| Feature extraction technique for pulmonary sound analysis based on EMD | 30/120 | 3: Normal, wheezes, crackles | ANN, SVM, GMM | Accuracy | [ | |
| EMD with ANN: 94.16% | ||||||
| EMD with SVM: 93.75% | ||||||
| EMD with GMM: 88.16% | ||||||
| Application of deep Learning to classify the severity of COPD | Not available/120 | 2: Crackles, wheeze | NN, DBN | Accuracy | [ | |
| NN: 77.60% | ||||||
| DBN: 95.84% | ||||||
| Application of deep Learning to detect early COPD | 50/600 | 1: Wheeze | DBN | Accuracy | [ | |
| DBN: 93.67% | ||||||
| Application of semi-supervised deep learning to lung sound analysis | 284/11627 | 2: Crackles, wheeze | SVM | AUC | [ | |
| Crackle: 0.74 | ||||||
| Wheeze: 0.86 | ||||||
aPPA positive percent agreement
bNPA negative percent agreement
cBiGRU bidirectional gated recurrent unit
dTCN temporal convolutional network, DBN deep belief networks, COPD chronic obstructive pulmonary disease
Developing stethoscopes: digital, wireless, or wearable device
| Model/study | Characteristics | Manufacturer/references |
|---|---|---|
| Littmann 3100 Electronic Stethoscope | 24× amplification | Littmann® |
| Record and save | ||
| Bluetooth transmission | ||
| Stethee Pro | 96× amplification | M3DICINE Inc® |
| Machine learning algorithm | ||
| Ambient noise cancellation | ||
| Thinklabs One Digital Amplified Medical Stethoscope | 100× amplification | Thinklabs One® |
| Precision filtering | ||
| Personal protective equipment auscultation | ||
| StethoMe | Homecare service | StethoMe® |
| AI analyses the respiratory sounds | ||
| A wearable stethoscope for long-term ambulatory respiratory health monitoring | Long-term ambulatory | [ |
| Respiratory health monitoring | ||
| Diaphragm-less acousto-electric transducer | ||
| Wearable multimodal stethoscope patch | Wearable biosignal acquisition | [ |
| High quality cardiac and pulmonary auscultation | ||
| Wearable cardiorespiratory monitoring | Estimation of respiration using a phonocardiogram | [ |
| Epidermal mechano-acoustic electrophysiological measurement device | Water-permeable, adhesive, biocompatible, and reversible device | [ |
Clinical trials of novel digital stethoscope and AI-assisted analysis
| Topic of study | Results/characteristics | Condition/disease | Reference and ClinicalTrial.gov. identifier |
|---|---|---|---|
| Detecting respiratory pathologies using CNN and variational autoencoders | CNN was used to classify chronic disease, non-chronic disease and healthy group | Chronic disease | [ |
| Non-chronic disease | |||
| Healthy | |||
| Observational (completed) | |||
| Predicting honeycombing on HRCT by the acoustic characteristics of fine crackles | Acoustic properties of fine crackles distinguish the honeycombing from non-honeycombing group | Honeycombing | [ |
| Non-honeycombing | |||
| Observational (completed) | |||
| Diagnosing interstitial pneumonia by analyzing inspiratory lung sounds recorded with phonopneumography | Spectral analysis of lung sounds is useful in the diagnosis and evaluation of the severity of IP | Interstitial pneumonia | [ |
| Healthy | |||
| Observational (completed) | |||
| Evaluating Auscul-X, a Touch Free Digital Stethoscope | Multichannel, touch-free electronic stethoscope | COVID-19 | NCT04570189 |
| Observational (recruiting) | |||
| Collecting respiratory sound samples to diagnose COVID-19 patients | VOQX Electronic Stethoscope | COVID-19 | NCT04910191 |
| Sound signals are processed by machine learning algorithm | Interventional (recruiting) | ||
| Clinical Evaluation of Automatic Classification of Respiratory System Sounds | StethoMe stethoscope | Wheezing, rhonchi, crackle, lung sound | NCT04208360 |
| AI software application | Observational (not yet recruiting) | ||
| Digital auscultation test—IPF data collection | Littmann Digital Stethoscope | Idiopathic pulmonary fibrosis | NCT03503188 |
| 3M Littmann Steth Assist software | Interventional (completed) | ||
| Respiratory auscultation of an open real-time tele-stethoscope system | Open real-time tele-stethoscope system | Respiratory/heart disease | NCT03596541 |
| Respiratory crackle | Interventional (not yet recruiting) |
Fig. 1Summary of new medical era using smart stethoscope