| Literature DB >> 35345477 |
Ke Xu1, Qin Wang1, Huangqing Xiao1, Kelin Liu1.
Abstract
High-dynamic-range (HDR) image has a wide range of applications, but its access is limited. Multi-exposure image fusion techniques have been widely concerned because they can obtain images similar to HDR images. In order to solve the detail loss of multi-exposure image fusion (MEF) in image reconstruction process, exposure moderate evaluation and relative brightness are used as joint weight functions. On the basis of the existing Laplacian pyramid fusion algorithm, the improved weight function can capture the more accurate image details, thereby making the fused image more detailed. In 20 sets of multi-exposure image sequences, six multi-exposure image fusion methods are compared in both subjective and objective aspects. Both qualitative and quantitative performance analysis of experimental results confirm that the proposed multi-scale decomposition image fusion method can produce high-quality HDR images.Entities:
Keywords: Laplacian pyramid (LP); high dynamic range image; image fusion; multi-exposure images; multi-scale decomposition
Year: 2022 PMID: 35345477 PMCID: PMC8957254 DOI: 10.3389/fnbot.2022.846580
Source DB: PubMed Journal: Front Neurorobot ISSN: 1662-5218 Impact factor: 2.650
Figure 1The workflow of the proposed image fusion based on improved weight function.
Figure 2The Laplace decomposition process of the image.
Multi-exposure image fusion algorithm based on improved weight function.
Figure 3Comparison of Arno scene experiment results of different methods.
Figure 4Comparison of Ballons scene experiment results of different methods.
Figure 5Comparison of kluki scene experiment results of different methods.
Figure 6Information entropy comparison of seven fusion methods.
Information entropy comparison of seven fusion methods.
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|
| 1. Arno |
| 7.258 | 7.175 | 7.581 | 7.343 | 7.490 | 7.498 | 7.424 |
| 2. Balloons | 7.752 | 7.113 | 7.264 |
| 7.435 | 7.676 | 7.113 | 7.703 |
| 3. Cave | 7.577 | 7.463 | 7.488 | 7.396 | 7.551 | 7.572 | 7.463 |
|
| 4. ChineseGarden | 7.248 | 7.762 | 7.598 |
| 7.704 | 7.728 | 7.762 | 7.752 |
| 5. Church | 7.601 | 7.565 | 7.693 |
| 7.744 | 7.774 | 7.565 | 7.737 |
| 6. Farmhouse | 7.356 | 7.251 | 7.214 | 7.237 | 7.162 | 7.176 | 7.251 |
|
| 7. House | 7.687 | 7.408 | 7.360 | 7.659 | 7.609 |
| 7.408 | 7.697 |
| 8. Kluki | 7.312 | 7.603 | 7.620 | 7.696 | 7.618 | 7.801 | 7.603 |
|
| 9. Lamp |
| 7.195 | 7.343 | 7.535 | 7.452 | 7.642 | 7.195 | 7.657 |
| 10. Landscape |
| 7.655 | 7.303 | 7.322 | 6.938 | 7.460 | 7.655 | 7.305 |
| 11. Laurenziana | 7.469 | 7.751 | 7.423 |
| 7.717 | 7.786 | 7.751 | 7.805 |
| 12. Lighthouse | 7.458 | 7.384 | 7.413 | 7.292 | 7.167 |
| 7.384 | 7.283 |
| 13. MadisonCapitol | 7.637 | 7.576 | 7.705 | 7.678 | 7.586 | 7.787 | 7.576 |
|
| 14. Mask | 7.190 | 7.623 | 7.610 |
| 7.580 | 7.738 | 7.623 | 7.735 |
| 15. Office |
| 7.473 | 7.236 | 7.236 | 7.473 | 7.507 | 7.473 | 7.387 |
| 16. Ostrow |
| 7.382 | 7.105 | 7.122 | 7.356 | 7.460 | 7.382 | 7.342 |
| 17. Room | 7.254 | 7.701 | 7.681 | 7.424 |
| 7.608 | 7.701 | 7.687 |
| 18. Set |
| 7.394 | 7.092 | 7.347 | 7.255 | 7.438 | 7.394 | 7.150 |
| 19. Tower | 7.672 | 7.576 | 7.579 | 7.675 | 7.657 | 7.646 | 7.576 |
|
| 20. Venice | 7.584 | 7.701 | 7.430 | 7.513 | 7.571 |
| 7.701 | 7.387 |
| 21. Average | 7.548 | 7.492 | 7.438 | 7.526 | 7.493 |
| 7.526 | 7.567 |
The bold value indicates the highest objective evaluation index value in this group of experiments.
Comparison of MEF-SSIM indexes of seven fusion methods.
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|
| 1. Arno | 0.975 | 0.958 | 0.965 |
| 0.969 | 0.980 | 0.98 | 0.987 |
| 2. Balloons | 0.959 | 0.893 | 0.945 | 0.968 | 0.948 | 0.965 | 0.965 |
|
| 3. Cave |
| 0.964 | 0.961 | 0.972 | 0.978 | 0.948 | 0.969 | 0.980 |
| 4. ChineseGarden | 0.987 | 0.982 | 0.982 |
| 0.984 | 0.985 | 0.986 | 0.989 |
| 5. Church | 0.985 | 0.978 | 0.979 | 0.991 | 0.992 |
| 0.986 | 0.991 |
| 6. Farmhouse | 0.970 | 0.971 | 0.977 | 0.976 | 0.985 |
| 0.977 | 0.978 |
| 7. House |
| 0.865 | 0.926 | 0.964 | 0.957 | 0.898 | 0.941 | 0.953 |
| 8. Kluki | 0.967 | 0.952 | 0.965 |
| 0.968 | 0.971 | 0.965 | 0.970 |
| 9. Lamp | 0.968 | 0.972 | 0.972 | 0.973 | 0.942 |
| 0.983 | 0.965 |
| 10. Landscape | 0.984 | 0.851 | 0.931 | 0.960 | 0.929 | 0.954 | 0.955 |
|
| 11. Laurenziana | 0.98 | 0.982 | 0.976 | 0.989 | 0.987 |
| 0.982 | 0.986 |
| 12. Lighthouse |
| 0.964 | 0.953 | 0.965 | 0.950 | 0.970 | 0.968 | 0.975 |
| 13. MadisonCapitol |
| 0.932 | 0.918 | 0.973 | 0.968 | 0.977 | 0.973 |
|
| 14. Mask | 0.987 | 0.975 | 0.982 |
| 0.979 | 0.988 | 0.981 | 0.990 |
| 15. Office | 0.896 | 0.968 | 0.957 | 0.971 | 0.967 | 0.967 | 0.973 |
|
| 16. Ostrow | 0.965 | 0.967 | 0.973 | 0.974 |
| 0.978 | 0.972 | 0.976 |
| 17. Room | 0.976 | 0.975 | 0.973 |
| 0.960 | 0.988 | 0.984 | 0.980 |
| 18. Set | 0.983 | 0.922 | 0.924 | 0.954 | 0.943 | 0.934 | 0.947 |
|
| 19. Tower | 0.980 | 0.954 | 0.952 | 0.972 | 0.954 | 0.940 | 0.935 |
|
| 20. Venice | 0.975 | 0.962 | 0.966 | 0.981 | 0.971 |
| 0.975 | 0.969 |
| 21. Average | 0.973 | 0.949 | 0.959 | 0.976 | 0.966 | 0.969 | 0.970 |
|
The bold value indicates the highest objective evaluation index value in this group of experiments.
Figure 7Comparison of MEF-SSIM indexes of seven fusion methods.
Ablation experiment of weight function.
|
|
|
|
|
|---|---|---|---|
| Entroy | 7.513 | 7.525 |
|
| MEF-SSIM | 0.966 | 0.970 |
|
The bold value indicates the highest objective evaluation index value in this group of experiments.
Comparison of image fusion efficiency of seven fusion methods.
|
|
|
|
|
|
|
|
|
|
|---|---|---|---|---|---|---|---|---|
| Average time(s) | 4.974 | 0.983 | 1.090 | 1.569 | 0.691 | 1.361 | 2.814 |
|
The bold value indicates the highest objective evaluation index value in this group of experiments.