# imagefusion_deeplearning

**Repository Path**: hli1221/imagefusion_deeplearning

## Basic Information

- **Project Name**: imagefusion_deeplearning
- **Description**: Infrared and visible image fusion using deep learning framework(ICPR 2018, Beijing)
- **Primary Language**: Matlab
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2022-05-01
- **Last Updated**: 2022-05-01

## Categories & Tags

**Categories**: Uncategorized

**Tags**: image-fusion, Deep-learning, vgg

## README

# Infrared and Visible Image Fusion using a Deep Learning Framework

[Hui Li](https://hli1221.github.io/), Xiao-Jun Wu*, Josef Kittler  
International Conference of Pattern Recognition 2018

*Li H, Wu X J, Kittler J. Infrared and Visible Image Fusion using a Deep Learning Framework[C]//Pattern Recognition (ICPR), 2018 24rd International Conference on. IEEE, 2018: 2705 - 2710.*

- [IEEEXplore](https://ieeexplore.ieee.org/document/8546006)
- [ArXiv](https://arxiv.org/abs/1804.06992)


### Requirements
You will need the following tools to run this codes:
- [MatConvNet](http://www.vlfeat.org/matconvnet/)
- [VGG-19, imagenet-vgg-verydeep-19](http://www.vlfeat.org/matconvnet/pretrained/)


If you have any question about this code, feel free to reach me(hui_li_jnu@163.com, lihui.cv@jiangnan.edu.cn) 


### Fusion method
![](https://github.com/hli1221/imagefusion_deeplearning/blob/master/framework/framework_method.png)

### Fusion detail content
![](https://github.com/hli1221/imagefusion_deeplearning/blob/master/framework/fusion_detail.png)

### Multi-layers fusion strategy
![](https://github.com/hli1221/imagefusion_deeplearning/blob/master/framework/fusion_strategy.png)

### Quality metric - Nabf
Nabf - 'B. K. Shreyamsha Kumar. Multifocus and Multispectral Image Fusion based on Pixel Significance using Discrete Cosine Harmonic Wavelet Transform. Signal, Image and Video Processing, 2012.'
![](https://github.com/hli1221/imagefusion_deeplearning/blob/master/framework/Nabf.png)


### Pytorch version

For reference only

https://github.com/GrimReaperSam/imagefusion_pytorch

# Citation

*Li H, Wu X J, Kittler J. Infrared and Visible Image Fusion using a Deep Learning Framework[C]//Pattern Recognition (ICPR), 2018 24rd International Conference on. IEEE, 2018: 2705 - 2710.*

```
@inproceedings{li2018infrared,
  title={Infrared and Visible Image Fusion using a Deep Learning Framework},
  author={Li, Hui and Wu, Xiao-Jun and Kittler, Josef},
  booktitle={2018 24th International Conference on Pattern Recognition (ICPR)},
  pages={2705--2710},
  year={2018},
  organization={IEEE}
}
```