Residential College | false |
Status | 已發表Published |
SS-TMNet: Spatial–Spectral Transformer Network with Multi-Scale Convolution for Hyperspectral Image Classification | |
Huang, Xiaohui1; Zhou, Yunfei1; Yang, Xiaofei2; Zhu, Xianhong1; Wang, Ke3 | |
2023-02-22 | |
Source Publication | Remote Sensing |
ISSN | 2072-4292 |
Volume | 15Issue:5Pages:1206 |
Abstract | Hyperspectral image (HSI) classification is a significant foundation for remote sensing image analysis, widely used in biology, aerospace, and other applications. Convolution neural networks (CNNs) and attention mechanisms have shown outstanding ability in HSI classification and have been widely studied in recent years. However, the existing CNN-based and attention mechanism-based methods cannot fully use spatial–spectral information, which is not conducive to further improving HSI classification accuracy. This paper proposes a new spatial–spectral Transformer network with multi-scale convolution (SS-TMNet), which can effectively extract local and global spatial–spectral information. SS-TMNet includes two key modules, i.e., multi-scale 3D convolution projection module (MSCP) and spatial–spectral attention module (SSAM). The MSCP uses multi-scale 3D convolutions with different depths to extract the fused spatial–spectral features. The spatial–spectral attention module includes three branches: height spatial attention, width spatial attention, and spectral attention, which can extract the fusion information of spatial and spectral features. The proposed SS-TMNet was tested on three widely used HSI datasets: Pavia University, IndianPines, and Houston2013. The experimental results show that the proposed SS-TMNet is superior to the existing methods. |
Keyword | Attention Mechanism Convolution Neural Network (Cnn) Hyperspectral Image (Hsi) Classification Multi-scale 3d Convolution |
DOI | 10.3390/rs15051206 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Environmental Sciences & Ecology ; Geology ; Remote Sensing ; Imaging Science & Photographic Technology |
WOS Subject | Environmental Sciences ; Geosciences, Multidisciplinary ; Remote Sensing ; Imaging Science & Photographic Technology |
WOS ID | WOS:000946969300001 |
Publisher | MDPI, ST ALBAN-ANLAGE 66, CH-4052 BASEL, SWITZERLAND |
Scopus ID | 2-s2.0-85149667326 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Yang, Xiaofei |
Affiliation | 1.School of Information Engineering, East China Jiaotong University, Nanchang, 330013, China 2.The Department of Computer and Information Science, University of Macau, 519000, Macao 3.School of Computer Science, Shenyang Aerospace University, Shenyang, 110136, China |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Huang, Xiaohui,Zhou, Yunfei,Yang, Xiaofei,et al. SS-TMNet: Spatial–Spectral Transformer Network with Multi-Scale Convolution for Hyperspectral Image Classification[J]. Remote Sensing, 2023, 15(5), 1206. |
APA | Huang, Xiaohui., Zhou, Yunfei., Yang, Xiaofei., Zhu, Xianhong., & Wang, Ke (2023). SS-TMNet: Spatial–Spectral Transformer Network with Multi-Scale Convolution for Hyperspectral Image Classification. Remote Sensing, 15(5), 1206. |
MLA | Huang, Xiaohui,et al."SS-TMNet: Spatial–Spectral Transformer Network with Multi-Scale Convolution for Hyperspectral Image Classification".Remote Sensing 15.5(2023):1206. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment