Local Similarity-Based Spatial-Spectral Fusion Hyperspectral Image Classification With Deep CNN and Gabor Filtering

• Published in: IEEE transactions on geoscience and remote sensing Vol. 60; pp. 1 - 15
• Main Authors: Bhatti, Uzair Aslam, Yu, Zhaoyuan, Chanussot, Jocelyn, Zeeshan, Zeeshan, Yuan, Linwang, Luo, Wen, Nawaz, Saqib Ali, Bhatti, Mughair Aslam, Ain, Qurat Ul, Mehmood, Anum
• Format: Journal Article
• Language: English
• Published: New York IEEE 01-01-2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE); Institute of Electrical and Electronics Engineers
• Subjects: Algorithms; Artificial neural networks; Classification; Classification algorithms; Computer Science; Convolutional neural network (CNN); Convolutional neural networks; Data mining; deep convolutional neural network (DCNN); Feature extraction; Gabor features; Gabor filters; hyperspectral image (HSI) classification; Hyperspectral imaging; Image classification; Machine learning; Neural networks; Nonlinear systems; Nonlinearity; Optimization; Principal component analysis; Signal and Image Processing; Similarity; Spatial data; Spectra; Training; Tunnels; Gabor features; hyper- spectral image (HSI) classification; Convolutional neural network (CNN); deep convolutional neural network (DCNN)
• ISSN: 0196-2892; 1558-0644
• DOI: 10.1109/TGRS.2021.3090410

Currently, the different deep neural network (DNN) learning approaches have done much for the classification of hyperspectral images (HSIs), especially most of them use the convolutional neural network (CNN). HSI data have the characteristics of multidimensionality, correlation, nonlinearity, and a large amount of data. Therefore, it is particularly important to extract deeper features in HSIs by reducing dimensionalities which help improve the classification in both spectral and spatial domains. In this article, we present a spatial-spectral HSI classification algorithm, local similarity projection Gabor filtering (LSPGF), which uses local similarity projection (LSP)-based reduced dimensional CNN with a 2-D Gabor filtering algorithm. First, use the local similarity analysis to reduce the dimensionality of the hyperspectral data, and then we use the 2-D Gabor filter to filter the reduced hyperspectral data to generate spatial tunnel information. Second, use the CNN to extract features from the original hyperspectral data to generate spectral tunnel information. Third, the spatial tunnel information and the spectral tunnel information are fused to form the spatial-spectral feature information, which is input into the deep CNN to extract more effective features; and finally, a dual optimization classifier is used to classify the final extracted features. This article compares the performance of the proposed method with other algorithms in three public HSI databases and shows that the overall accuracy of the classification of LSPGF outperforms all datasets.