Two-stage fusion of thermal hyperspectral and visible RGB image by PCA and guided filter

Wenzhi Liao, Xin Huang, Frieke Van Coillie, Guy Thoonen, Aleksandra Pizurica, Paul Scheunders, Wilfried Philips, Akira Iwasaki, Naoto Yokoya, Jocelyn Chanussot

Research output: Contribution to conferencePaperpeer-review

6 Citations (Scopus)


Nowadays, advanced technology in remote sensing allows us to get multi-sensor and multi-resolution data from the same region. Fusion of these data sources for classification remains challenging problems. In this paper, we propose a novel algorithm for hyperspectral (HS) image pansharpening with two-stage guided filtering in PCA (principal component analysis) domain. In the first stage, we first downsample the high-resolution RGB image to the same spatial resolution of original low-resolution HS image, and use guided filter to transfer the image details (e.g. edge) of the downsampled RGB image to the original HS image in the PCA domain. In the second stage, we perform upsampling on the resulting HS image from the first stage by using original high-resolution RGB image and guided filter in PCA domain. This yields a clear improvement over an older approach with one stage guided filtering in PCA domain. Experimental results on fusion of a low spatial-resolution Thermal Infrared HS image and a high spatial-resolution visible RGB image from the 2014 IEEE GRSS Data Fusion Contest, are very encouraging.
Original languageEnglish
Number of pages4
Publication statusPublished - 2015
Event7th workshop on hyperspectral image and signal processing : evolution in remote sensing 2015 - Tokyo, Japan
Duration: 2 Jun 20155 Jun 2015


Workshop7th workshop on hyperspectral image and signal processing : evolution in remote sensing 2015


  • principal component analysis
  • hyperspectral images
  • pansharpening
  • guided filter
  • spatial resolution
  • image edge detection
  • remote sensing

Cite this