| Literature DB >> 35214481 |
Danish Javeed1, Tianhan Gao1, Muhammad Taimoor Khan2, Duaa Shoukat2.
Abstract
With the new advancements in Internet of Things (IoT) and its applications in different sectors, such as the industrial sector, by connecting billions of devices and instruments, IoT has evolved as a new paradigm known as the Industrial Internet of Things (IIoT). Nonetheless, its benefits and applications have been approved in different areas, but there are possibilities for various cyberattacks because of its extensive connectivity and diverse nature. Such attacks result in financial loss and data breaches, which urge a consequential need to secure IIoT infrastructure. To combat the threats in the IIoT environment, we proposed a deep-learning SDN-enabled intelligent framework. A hybrid classifier is used for threat detection purposes, i.e., Cu-LSTMGRU + Cu-BLSTM. The proposed model achieved a better detection accuracy with low false-positive rate. We have conducted 10-fold cross-validation to show the unbiasdness of the results. The proposed scheme results are compared with Cu-DNNLSTM and Cu-DNNGRU classifiers, which were tested and trained on the same dataset. We have further compared the proposed model with other existing standard classifiers for a thorough performance evaluation. Results achieved by our proposed scheme are impressive with respect to speed efficiency, F1 score, accuracy, precision, and other evaluation metrics.Entities:
Keywords: Industrial Internet of Things (IIoT); deep learning (DL); intrusion detection system (IDS); software-defined networking (SDN)
Mesh:
Year: 2022 PMID: 35214481 PMCID: PMC8875738 DOI: 10.3390/s22041582
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Existing literature.
| Ref | Year | Algorithm | Dataset | Achievements | Limitations |
|---|---|---|---|---|---|
| [ | 2019 | SVM, RBM | CMU, KDD99 | Proposed detection scheme for multiclass using SVM and RBM with an accuracy of 89%. | Dataset is not flow-based, old, and static. |
| [ | 2018 | LSTM, CNN, RNN | ISCX2012 | In the proposed scheme, feature filtration is performed with a verification accuracy of 98%. | Time overhead as the scheme is computationally complex. |
| [ | 2019 | CNN, LSTM, MLP | Tools Tshark, Wireshark data | Used Fast Gradient Sign method (FGSM), JSMA, JSMA-RE to solve port scanning issue. | Computationally complex. |
| [ | 2018 | DT, ELM, SVM, NN, Ada-Boost | NSL-KDD | For SDN proposed anomaly detection scheme with the detection accuracy of 80%. | Real-time environment performance of the classifier is not enough. |
| [ | 2019 | MLP | CTU-13 ISOT | To detect botnet in SDN intrusion detection scheme is proposed based on MLP. | Experimentation is not performed on botnet infected terminals. |
| [ | 2019 | MLP | Real time | Botnet detection scheme using MLP with a detection accuracy of 98%. | Evaluation is performed only on real-time traffic. |
| [ | 2019 | RL, CB-TRW | Real traffic | In a software-defined network, DoS and port scan detection and prevention method is presented using RL and CB-TRW. | Only false-positive rate (FPR) and CPU consumption is used as a performance parameter. |
| [ | 2017 | RNN | NSL-KDD | R2L and probe detection using RNN classifiers. | Comparison is made with machine-learning algorithm. |
| [ | 2021 | DNNGRU-BLSTM | CICIDS2018 | Obtained efficient detection rate by using a hybrid classifier of DL for multi-class attacks. | The proposed method cannot detect the DDoS attacks by reflecting all of the features of the blocks formed when the attack occurs. |
| [ | 2018 | GRU-RNN | NSL-KDD | Using six network features, the proposed scheme GRU-RNN achieved 89% detection accuracy. | The dataset NSL-KDD is not flow-based. |
| [ | 2018 | DNN | Barnyard | Proposed deep-learning and flow-based detection scheme with snort with a detection accuracy of 85%. | Computationally complex. |
| [ | 2012 | Genetic Algorithm | KDD99 | Obtained sufficient detection rate. | The dataset is not IoT-based and outdated, with high false-positive rates. |
| [ | 2018 | RBM | KDD99 | The authors achieved a precision rate of 94 %. | The dataset is not IoT-based and too old. |
| [ | 2018 | CNN-RNN | CTU13-ISOT | The model can detect botnets at the packet level. | The detection accuracy is low, and time complexity is high. |
| [ | 2018 | DM, SM | NSL-KDD | Achieved efficient output by developing shallow and deep models. | The dataset is not IoT based. |
| [ | 2015 | SVM | NSL-KDD | Better detection accuracy. | Inherent limitations, the strong signal needed in data. |
| [ | 2018 | LSTM-GRU | NSL-KDD | Achieved an accuracy of 87%. | The detection accuracy is too low. |
| [ | 2017 | FLS-Based Approach | NGIDS-DS | Showed the rational attack activities and usual traffic changing aspects of real-world networks. | The complexity of the dataset is not explored properly. |
| [ | 2019 | GRU-RNN | NSL-KDD, CICIDS17 | Achieved 89% accuracy for multiclass using GRU-RNN classifier. | Diverse features are not used for enhancement of classifier. |
Figure 1Network Model.
Figure 2Detection Scheme.
Hybrid algorithms description.
| Algorithm | Layers | AF | Neurons | LF | Optimizer | Batch-Size | Epochs |
|---|---|---|---|---|---|---|---|
| Cu-LSTMGRU (1) | Relu | (200) | |||||
| Cu-BLSTM (1) | Relu | (100) | |||||
| Cu-LSTMGRU+Cu-BLSTM | Dropout | – | (0.3) | CC-E | Adamax | 32 | 05 |
| Output Layer (1) | Softmax | 07 | |||||
| Dense (3) | – | (200,100,50) | – | ||||
| DNN Layer (1) | Relu | (200) | |||||
| LSTM Layer (1) | Relu | (100) | |||||
| Cu-DNN–LSTM | Dropout | – | (0.3) | CC-E | Adamax | 32 | 05 |
| Dense (3) | – | (200,100,50) | – | ||||
| Output Layer (1) | Softmax | 07 | |||||
| DNN Layer (1) | Relu | (200) | |||||
| GRU Layer (1) | Relu | (100) | |||||
| Cu-DNN–GRU | Dropout | – | (0.3) | CC-E | Adamax | 32 | 05 |
| Dense (3) | – | (200,100,50) | – | ||||
| Output Layer (1) | Softmax | 07 |
Dataset description.
| Attack Category | Subcategory | Attack Instances |
|---|---|---|
| Benign | – | 49,500 |
| Ack | 3400 | |
| Scan | 3300 | |
| Mirai | SYN | 3300 |
| UDP | 3400 | |
| UDP Plain | 3300 | |
| Combo | 3300 | |
| Bashlite | Junk | 3300 |
| TCP | 3400 | |
| Total | – | 76,200 |
Experimental setup.
| CPU | 7700, i7, 7th Generation with 2.80 GHz processor |
| RAM | 16 GB |
| GPU | Nvidia GeForce 1060 6 GB |
| Language | Python, version 3.8 |
| Libraries | Keras, Numpy, Pandas, TensorFlow and Scikitlearn |
| OS | Windows 10, 64 bit |
Figure 3ROC curves of the models.
Figure 4Confusion metrics of the models.
10-fold results of the hybrid models.
| Parameter | Hybrid Models | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Precision (%) |
| 98.30 | 99.85 | 98.76 | 99.81 | 99.83 | 99.21 | 99.65 | 99.93 | 98.41 | 99.67 |
| Cu-DNN–LSTM | 98.92 | 98.52 | 93.77 | 96.23 | 98.94 | 97.53 | 95.69 | 98.29 | 97.51 | 99.37 | |
| Cu-DNN–GRU | 97.76 | 96.50 | 95.30 | 96.50 | 96.50 | 97.40 | 96.90 | 96.90 | 97.15 | 97.10 | |
| Recall (%) |
| 99.83 | 98.52 | 99.23 | 97.74 | 98.39 | 99.11 | 97.52 | 97.29 | 98.44 | 98.92 |
| Cu-DNN–LSTM | 99.49 | 99.39 | 99.93 | 99.81 | 99.31 | 99.41 | 99.91 | 97.96 | 99.09 | 98.54 | |
| Cu-DNN–GRU | 99.37 | 98.50 | 98.50 | 99.30 | 99.30 | 99.37 | 98.30 | 98.21 | 98.21 | 97.37 | |
| Accuracy (%) |
| 99.50 | 99.11 | 99.23 | 99.74 | 99.39 | 99.66 | 99.25 | 99.29 | 99.44 | 99.92 |
| Cu-DNN–LSTM | 98.96 | 98.63 | 95.62 | 97.32 | 98.85 | 97.97 | 97.01 | 97.51 | 97.74 | 98.62 | |
| Cu-DNN–GRU | 99.18 | 97.73 | 95.64 | 98.36 | 98.81 | 99.23 | 98.94 | 98.31 | 98.85 | 98.10 | |
| F1-Score (%) |
| 99.83 | 99.52 | 99.23 | 99.74 | 99.39 | 99.11 | 99.25 | 99.29 | 99.44 | 99.91 |
| Cu-DNN–LSTM | 99.49 | 99.39 | 99.93 | 99.81 | 99.31 | 99.41 | 99.91 | 97.96 | 99.09 | 98.54 | |
| Cu-DNN–GRU | 99.37 | 97.80 | 97.50 | 97.70 | 99.20 | 99.15 | 99.40 | 99.40 | 99.10 | 99.50 |
Figure 5Accuracy, recall, F1-score, and precision.
Figure 6FPR, FNR, FDR and FOR Results.
Figure 7TPR, TNR, and MCC.
Figure 8Speed efficiency of the models.
Comparison with existing benchmarks.
| Ref | [ | [ | [ | Proposed |
|---|---|---|---|---|
| Algorithm | GRU-RNN | Autoencoder(EDSA) | Multi-CNN | Cu-LSTMGRU + |
| Cu-BLSTM | ||||
| Dataset | CICIDS17 | CICDDoS2019 | NSL-KDD | N-BaIoT |
| Accuracy | 89% | 98% | 86.95% | 99.45% |
| 10-fold | - | - | ✓ | ✓ |
| Multiclass | ✓ | ✓ | - | ✓ |
| GPU-Enabled | - | - | - | ✓ |
| F1-Score | 99% | - | 88.41% | 99.47% |
| Recall | 99% | - | 87.25% | 98.49% |
| Precision | 99% | - | 89.56% | 99.34% |
| Testing time | - | - | - | 9.79 ms |