UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
SS-TMNet: Spatial–Spectral Transformer Network with Multi-Scale Convolution for Hyperspectral Image Classification
Huang, Xiaohui1; Zhou, Yunfei1; Yang, Xiaofei2; Zhu, Xianhong1; Wang, Ke3
2023-02-22
Source PublicationRemote Sensing
ISSN2072-4292
Volume15Issue:5Pages:1206
Abstract

Hyperspectral image (HSI) classification is a significant foundation for remote sensing image analysis, widely used in biology, aerospace, and other applications. Convolution neural networks (CNNs) and attention mechanisms have shown outstanding ability in HSI classification and have been widely studied in recent years. However, the existing CNN-based and attention mechanism-based methods cannot fully use spatial–spectral information, which is not conducive to further improving HSI classification accuracy. This paper proposes a new spatial–spectral Transformer network with multi-scale convolution (SS-TMNet), which can effectively extract local and global spatial–spectral information. SS-TMNet includes two key modules, i.e., multi-scale 3D convolution projection module (MSCP) and spatial–spectral attention module (SSAM). The MSCP uses multi-scale 3D convolutions with different depths to extract the fused spatial–spectral features. The spatial–spectral attention module includes three branches: height spatial attention, width spatial attention, and spectral attention, which can extract the fusion information of spatial and spectral features. The proposed SS-TMNet was tested on three widely used HSI datasets: Pavia University, IndianPines, and Houston2013. The experimental results show that the proposed SS-TMNet is superior to the existing methods.

KeywordAttention Mechanism Convolution Neural Network (Cnn) Hyperspectral Image (Hsi) Classification Multi-scale 3d Convolution
DOI10.3390/rs15051206
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEnvironmental Sciences & Ecology ; Geology ; Remote Sensing ; Imaging Science & Photographic Technology
WOS SubjectEnvironmental Sciences ; Geosciences, Multidisciplinary ; Remote Sensing ; Imaging Science & Photographic Technology
WOS IDWOS:000946969300001
PublisherMDPI, ST ALBAN-ANLAGE 66, CH-4052 BASEL, SWITZERLAND
Scopus ID2-s2.0-85149667326
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorYang, Xiaofei
Affiliation1.School of Information Engineering, East China Jiaotong University, Nanchang, 330013, China
2.The Department of Computer and Information Science, University of Macau, 519000, Macao
3.School of Computer Science, Shenyang Aerospace University, Shenyang, 110136, China
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Huang, Xiaohui,Zhou, Yunfei,Yang, Xiaofei,et al. SS-TMNet: Spatial–Spectral Transformer Network with Multi-Scale Convolution for Hyperspectral Image Classification[J]. Remote Sensing, 2023, 15(5), 1206.
APA Huang, Xiaohui., Zhou, Yunfei., Yang, Xiaofei., Zhu, Xianhong., & Wang, Ke (2023). SS-TMNet: Spatial–Spectral Transformer Network with Multi-Scale Convolution for Hyperspectral Image Classification. Remote Sensing, 15(5), 1206.
MLA Huang, Xiaohui,et al."SS-TMNet: Spatial–Spectral Transformer Network with Multi-Scale Convolution for Hyperspectral Image Classification".Remote Sensing 15.5(2023):1206.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Huang, Xiaohui]'s Articles
[Zhou, Yunfei]'s Articles
[Yang, Xiaofei]'s Articles
Baidu academic
Similar articles in Baidu academic
[Huang, Xiaohui]'s Articles
[Zhou, Yunfei]'s Articles
[Yang, Xiaofei]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Huang, Xiaohui]'s Articles
[Zhou, Yunfei]'s Articles
[Yang, Xiaofei]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.