Literature DB >> 33573136

Unsupervised Learning of Depth and Camera Pose with Feature Map Warping.

Ente Guo1, Zhifeng Chen1, Yanlin Zhou2, Dapeng Oliver Wu2.   

Abstract

Estimating the depth of image and egomotion of agent are important for autonomous and robot in understanding the surrounding environment and avoiding collision. Most existing unsupervised methods estimate depth and camera egomotion by minimizing photometric error between adjacent frames. However, the photometric consistency sometimes does not meet the real situation, such as brightness change, moving objects and occlusion. To reduce the influence of brightness change, we propose a feature pyramid matching loss (FPML) which captures the trainable feature error between a current and the adjacent frames and therefore it is more robust than photometric error. In addition, we propose the occlusion-aware mask (OAM) network which can indicate occlusion according to change of masks to improve estimation accuracy of depth and camera pose. The experimental results verify that the proposed unsupervised approach is highly competitive against the state-of-the-art methods, both qualitatively and quantitatively. Specifically, our method reduces absolute relative error (Abs Rel) by 0.017-0.088.

Entities:  

Keywords:  feature pyramid matching loss; monocular depth estimation; occlusion-aware mask network; single camera egomotion

Year:  2021        PMID: 33573136      PMCID: PMC7866542          DOI: 10.3390/s21030923

Source DB:  PubMed          Journal:  Sensors (Basel)        ISSN: 1424-8220            Impact factor:   3.576


  3 in total

1.  Image quality assessment: from error visibility to structural similarity.

Authors:  Zhou Wang; Alan Conrad Bovik; Hamid Rahim Sheikh; Eero P Simoncelli
Journal:  IEEE Trans Image Process       Date:  2004-04       Impact factor: 10.856

2.  Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields.

Authors:  Fayao Liu; Chunhua Shen; Guosheng Lin; Ian Reid
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2015-12-03       Impact factor: 6.226

3.  Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understanding.

Authors:  Chenxu Luo; Zhenheng Yang; Peng Wang; Yang Wang; Wei Xu; Ramkant Nevatia; Alan Yuille
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2019-07-23       Impact factor: 6.226

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.