| Literature DB >> 35808155 |
Yang Zhang1,2,3, Li Zhou4, Haisen Li1,2,3, Jianjun Zhu1,2,3, Weidong Du1,2,3.
Abstract
With the development of artificial intelligence technology, visual simultaneous localization and mapping (SLAM) has become a cheap and efficient localization method for underwater robots. However, there are many problems in underwater visual SLAM, such as more serious underwater imaging distortion, more underwater noise, and unclear details. In this paper, we study these two problems and chooses the ORB-SLAM2 algorithm as the method to obtain the motion trajectory of the underwater robot. The causes of radial distortion and tangential distortion of underwater cameras are analyzed, a distortion correction model is constructed, and five distortion correction coefficients are obtained through pool experiments. Comparing the performances of contrast-limited adaptive histogram equalization (CLAHE), median filtering (MF), and dark channel prior (DCP) image enhancement methods in underwater SLAM, it is found that the DCP method has the best image effect evaluation, the largest number of oriented fast and rotated brief (ORB) feature matching, and the highest localization trajectory accuracy. The results show that the ORB-SLAM2 algorithm can effectively locate the underwater robot, and the correct distortion correction coefficient and DCP improve the stability and accuracy of the ORB-SLAM2 algorithm.Entities:
Keywords: dark channel prior; distortion correction; image enhancement; underwater robot; visual SLAM
Mesh:
Year: 2022 PMID: 35808155 PMCID: PMC9269032 DOI: 10.3390/s22134657
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.847
Figure 1Schematic diagram of underwater visual SLAM.
Figure 2Causes of radial and tangential distortion in underwater images.
ROV and monocular camera parameters table.
| Item | Parameter | |
|---|---|---|
| ROV | Size | 416 × 355 × 210 mm |
| Working depth | 75 m | |
| Weight in air | 2.8 kg | |
| Speed | 3 kn | |
| Camera | Type | Monocular |
| Resolution | 1920 × 1080 | |
| Focal length | 3.6 mm | |
| PTZ angle | ±55° |
Figure 3Camera calibration. (a) Schematic diagram of the process of acquiring calibration images by the ROV in the pool; (b) The position of the camera relative to the calibration plate during image acquisition.
Figure 4Partial results of decomposition of video data into images. (a) Partial results of Test 1 data decomposition; (b) Partial results of Test 2 data decomposition.
Details of the two datasets.
| Dataset | Duration | Frame Rate | Number of Images | Image Quality |
|---|---|---|---|---|
| Test 1 | 57 s | 25 fps | 1433 | High |
| Test 2 | 105 s | 25 fps | 2630 | Low |
Figure 5Test 1 image enhancement results. (a) Original image; (b) CLAHE; (c) MF; (d) DCP.
Figure 6Test 2 image enhancement results. (a) Original image; (b) CLAHE; (c) MF; (d) DCP.
PSNR and SSIM calculated values for the CLAHE, MF, and DCP methods.
| Methods | Test 1 | Test 2 | ||
|---|---|---|---|---|
| PSNR | SSIM | PSNR | SSIM | |
| CLAHE | 21.596 | 0.879 | 21.179 | 0.891 |
| MF | 25.596 | 0.911 |
|
|
| DCP |
|
| 16.759 | 0.769 |
Figure 7Feature matching results of the Test 1 dataset. (a) Original image; (b) CLAHE; (c) MF; (d) DCP.
Figure 8Feature matching results of the Test 2 dataset. (a) Original image; (b) CLAHE; (c) MF; (d) DCP.
Figure 9Number of feature matches.
Figure 10SLAM results for the Test 1 dataset. (a) Original; (b) CLAHE; (c) MF; (d) DCP.
Figure 11SLAM results for the Test 2 dataset. (a) Original; (b) CLAHE; (c) MF; (d) DCP.
Figure 12SLAM running result data. (a) Test 1 dataset; (b) Test 2 dataset.
Figure 13Keyframe motion trajectory. (a) Test 1; (b) Test 2.
Figure 14Comparison of the same keyframe trajectory with the original data. (a) Test 1; (b) Test 2.