| Literature DB >> 36080949 |
Islam Ashry1, Biwei Wang1,2, Yuan Mao1,3, Mohammed Sait1, Yujian Guo1, Yousef Al-Fehaid4, Abdulmoneim Al-Shawaf4, Tien Khee Ng1, Boon S Ooi1.
Abstract
Red palm weevil (RPW) is a harmful pest that destroys many date, coconut, and oil palm plantations worldwide. It is not difficult to apply curative methods to trees infested with RPW; however, the early detection of RPW remains a major challenge, especially on large farms. In a controlled environment and an outdoor farm, we report on the integration of optical fiber distributed acoustic sensing (DAS) and machine learning (ML) for the early detection of true weevil larvae less than three weeks old. Specifically, temporal and spectral data recorded with the DAS system and processed by applying a 100-800 Hz filter are used to train convolutional neural network (CNN) models, which distinguish between "infested" and "healthy" signals with a classification accuracy of ∼97%. In addition, a strict ML-based classification approach is introduced to improve the false alarm performance metric of the system by ∼20%. In a controlled environment experiment, we find that the highest infestation alarm count of infested and healthy trees to be 1131 and 22, respectively, highlighting our system's ability to distinguish between the infested and healthy trees. On an outdoor farm, in contrast, the acoustic noise produced by wind is a major source of false alarm generation in our system. The best performance of our sensor is obtained when wind speeds are less than 9 mph. In a representative experiment, when wind speeds are less than 9 mph outdoor, the highest infestation alarm count of infested and healthy trees are recorded to be 1622 and 94, respectively.Entities:
Keywords: machine learning; optical fiber distributed acoustic sensing; red palm weevil
Mesh:
Year: 2022 PMID: 36080949 PMCID: PMC9459888 DOI: 10.3390/s22176491
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.847
Figure 1Overall approach for RPW detection using an optical fiber DAS and machine learning.
Figure 2(a) Experimental setup of the -OTDR-based optical fiber DAS used for the detection of RPW. Cir.: circulator. (b) A representative Rayleigh trace recorded by the optical fiber DAS along a 1-km SMF.
Figure 3(a) Weevil larvae less than three weeks old. Representative examples of the temporal “infested”, “calm”, and ”noisy” images (b), and their corresponding spectral images (c).
Figure 4(a) The CNN architecture for classifying “infested” and “healthy” temporal (spectral) signals. Conv: convolutional; FC: fully-connected; The dimensions of the CNN architecture associated with the spectral data are written in green. Training and validation history (b,d) and confusion matrix (c,e) when using the temporal/spectral data.
Figure 5(a) Example of a tree used in the controlled environment experiments. Infestation alarm count produced by our sensor during Exp. 1 (b) and Exp. 2 (c). I: infested tree; H: healthy tree.
Figure 6In the outdoor farm, there are two short infested and two short healthy trees (a), and another 15 tall typical trees (b). Infestation alarm count produced by our sensor during Exp. 3 (c), Exp. 4 (d), and Exp. 5 (e). I: infested tree; H: healthy tree.
Comparison of our DAS+CNN method with existing sensors for RPW detection, in chronological order.
| Method | Processing Technique | Invasive or Not | Performance or Accuracy | Advantages (Disadvantages) |
|---|---|---|---|---|
| An acoustic sensor (commercial piezoelectric microphone), 2008 [ | Speech recognition method, vector quantization (VQ), and Gaussian mixture modeling (GMM) | Not | 98% accuracy | Automatic detection using simple commercial hardware (A sound-isolated box is used) |
| An acoustic sensor (Piezoelectric sensor), 2009 [ | Feature extraction, GMM | Invasive | 99.1% accuracy | Automatic detection with well-designed algorithms (High computational complexity) |
| An acoustic sensor (electronic device with acoustic probe), 2010 [ | FFT, studying the sound intensity around 2250 Hz | Invasive | The infested sound intensity increases around 1 dB from −20 dB | Detection of a small number of larvae with a simple signal processing method (Low contrast between infested and non-infested sound) |
| An acoustic device (acoustic probe and headphone set), 2010 [ | Bandpass filtering, amplification | Invasive | 97% accuracy | Simple and portable hardware (Manual identification with four detection positions needed) |
| A radiography system (X-ray technology), 2012 [ | Visual detection based on X-ray photos | Not | Observable larvae on the photos | Simple and visual operation (Difficult for large-scale applications) |
| An acoustic sensor (audio probe), 2013 [ | Filtering and amplification, feature vector quantization | Invasive | 90% accuracy | Autonomous and continuous detection with explicit audio analysis algorithm (Extensive field experiments are needed in the future) |
| Thermal imaging (infrared thermal camera), 2015 [ | Thermal infrared images (TIR), leaf temperature maps, canopy representative temperature, crop water stress index (CWSI) | Not | Less than 75% accuracy | Large-scale and non-invasive detection (Susceptible to environmental conditions) |
| An acoustic sensor (piezoelectric microphone), 2016 [ | Likelihood indication by observer, speech recognition algorithm same as that in Ref. [ | Not | 75% accuracy by humans, 80% accuracy by machine | Manual and automated detection are compared (Susceptible to wind) |
| Some optical devices (digital camera, thermal camera, TreeRadarUnit (Radar 2000, Radar 900), resistograph, magnetic DNA biosensor, and near-infrared spectroscopy (NIRS)), 2020 [ | Visual analysis, the analysis of variance (ANOVA) PROC GLM procedure, response of the leaf spectral absorbance | Not | Accuracy: visual approach 87%, Radar 2000 77%, Radar 900 73%, resistograph 73%, thermal camera 61%, digital camera 52%, and magnetic DNA 63% | All used methods are non-invasive with a detailed comparison (Accuracy needs to be further improved) |
| An IoT system (commercial accelerometer sensor), 2020 [ | FFT, the estimation of power spectral density (PSD), peaks average difference (PAD) analysis | Invasive | Observable signature of the infestation | Simple hardware with a connection to network (Low sensitivity and contrast) |
| An acoustic sensor (USB microphone), 2021 [ | Feature extraction using Mel Frequency Cepstrum Coefficient (MFCC), discrete Fourier transform (DFT), artificial neural network (ANN), Alexnet-convolutional neural networks (CNN) | Not | 99.2% accuracy | Simple hardware and concise algorithm (A plastic tube is used to imitate the real tree) |
| A large-scale imaging detection method (aerial and street view), 2021 [ | CNN, faster R-CNN ResNet-50 FPN, XResNet, | Not | Aerial and street images can be mapped to actual palm trees | Automatic large-scale detection (Limited number of infested palm tree images available online) |
| An IoT system (acoustic detection of the public TreeVibes dataset), 2021 [ | Modified mixed depthwise CNN (MixConvNet) | Invasive | 95.90% accuracy | Integration in a smartphone application with advanced algorithm (Only verified on the public TreeVibes dataset) |
| An optical fiber distributed acoustic sensor (ours) | CNN | Not | Around 97.0% accuracy | Provides 24/7 monitoring on large-scale farms (Low performance at high wind speeds) |