Literature DB >> 33802217

Application of Deep Learning on Millimeter-Wave Radar Signals: A Review.

Fahad Jibrin Abdu1, Yixiong Zhang1, Maozhong Fu1, Yuhan Li1, Zhenmiao Deng1.   

Abstract

The progress brought by the deep learning technology over the last decade has inspired many research domains, such as radar signal processing, speech and audio recognition, etc., to apply it to their respective problems. Most of the prominent deep learning models exploit data representations acquired with either Lidar or camera sensors, leaving automotive radars rarely used. This is despite the vital potential of radars in adverse weather conditions, as well as their ability to simultaneously measure an object's range and radial velocity seamlessly. As radar signals have not been exploited very much so far, there is a lack of available benchmark data. However, recently, there has been a lot of interest in applying radar data as input to various deep learning algorithms, as more datasets are being provided. To this end, this paper presents a survey of various deep learning approaches processing radar signals to accomplish some significant tasks in an autonomous driving application, such as detection and classification. We have itemized the review based on different radar signal representations, as it is one of the critical aspects while using radar data with deep learning models. Furthermore, we give an extensive review of the recent deep learning-based multi-sensor fusion models exploiting radar signals and camera images for object detection tasks. We then provide a summary of the available datasets containing radar data. Finally, we discuss the gaps and important innovations in the reviewed papers and highlight some possible future research prospects.

Entities:  

Keywords:  automotive radars; autonomous driving; datasets; deep learning; multi-sensor fusion; object classification; object detection

Year:  2021        PMID: 33802217      PMCID: PMC7999239          DOI: 10.3390/s21061951

Source DB:  PubMed          Journal:  Sensors (Basel)        ISSN: 1424-8220            Impact factor:   3.576


  14 in total

1.  3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey.

Authors:  Mohammed Bennamoun; Ferdous Sohel
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2014-11       Impact factor: 6.226

2.  Long short-term memory.

Authors:  S Hochreiter; J Schmidhuber
Journal:  Neural Comput       Date:  1997-11-15       Impact factor: 2.026

Review 3.  Deep learning.

Authors:  Yann LeCun; Yoshua Bengio; Geoffrey Hinton
Journal:  Nature       Date:  2015-05-28       Impact factor: 49.962

4.  The ApolloScape Open Dataset for Autonomous Driving and Its Application.

Authors:  Xinyu Huang; Peng Wang; Xinjing Cheng; Dingfu Zhou; Qichuan Geng; Ruigang Yang
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2019-07-02       Impact factor: 6.226

5.  Unifying obstacle detection, recognition, and fusion based on millimeter wave radar and RGB-depth sensors for the visually impaired.

Authors:  Ningbo Long; Kaiwei Wang; Ruiqi Cheng; Weijian Hu; Kailun Yang
Journal:  Rev Sci Instrum       Date:  2019-04       Impact factor: 1.523

6.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks.

Authors:  Shaoqing Ren; Kaiming He; Ross Girshick; Jian Sun
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2016-06-06       Impact factor: 6.226

7.  Neocognitron: a self organizing neural network model for a mechanism of pattern recognition unaffected by shift in position.

Authors:  K Fukushima
Journal:  Biol Cybern       Date:  1980       Impact factor: 2.086

8.  Representational power of restricted boltzmann machines and deep belief networks.

Authors:  Nicolas Le Roux; Yoshua Bengio
Journal:  Neural Comput       Date:  2008-06       Impact factor: 2.026

9.  Spatial Attention Fusion for Obstacle Detection Using MmWave Radar and Vision Sensor.

Authors:  Shuo Chang; Yifan Zhang; Fan Zhang; Xiaotong Zhao; Sai Huang; Zhiyong Feng; Zhiqing Wei
Journal:  Sensors (Basel)       Date:  2020-02-11       Impact factor: 3.576

10.  Multi-Target Detection Method Based on Variable Carrier Frequency Chirp Sequence.

Authors:  Wei Wang; Jinsong Du; Jie Gao
Journal:  Sensors (Basel)       Date:  2018-10-10       Impact factor: 3.576

View more
  3 in total

Review 1.  Towards Deep Radar Perception for Autonomous Driving: Datasets, Methods, and Challenges.

Authors:  Yi Zhou; Lulu Liu; Haocheng Zhao; Miguel López-Benítez; Limin Yu; Yutao Yue
Journal:  Sensors (Basel)       Date:  2022-05-31       Impact factor: 3.847

2.  Pedestrian and Animal Recognition Using Doppler Radar Signature and Deep Learning.

Authors:  Danny Buchman; Michail Drozdov; Tomas Krilavičius; Rytis Maskeliūnas; Robertas Damaševičius
Journal:  Sensors (Basel)       Date:  2022-05-01       Impact factor: 3.847

3.  Architecture Exploration of a Backprojection Algorithm for Real-Time Video SAR.

Authors:  Seokwon Lee; Inmo Ban; Myeongjin Lee; Yunho Jung; Wookyung Lee
Journal:  Sensors (Basel)       Date:  2021-12-10       Impact factor: 3.576

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.