Residential College | false |
Status | 已發表Published |
The Structure-sharing Hypergraph Reasoning Attention Module for CNNs | |
Wang, Jingchao1; Huang, Guoheng1; Yuan, Xiaochen2; Zhong, Guo3; Lin, Tongxu4; Pun, Chi Man5; Xie, Fenfang3 | |
2025 | |
Source Publication | Expert Systems with Applications |
ABS Journal Level | 1 |
ISSN | 0957-4174 |
Volume | 259Pages:125240 |
Abstract | Attention mechanisms improve the performance of models by selectively processing relevant information. However, existing attention mechanisms for CNNs do not utilize the high-order semantic similarity between different channels in the input when inferring attention. To address this issue, in this paper, we propose the Structure-sharing Hypergraph Reasoning Attention Module (SHRA Module) to explore the high-order similarity among nodes via hypergraph learning. SHRA Module transforms the input CNN feature maps into hypergraph node representations, which are used to reason attention under a set of learnable hypergraph convolutions. When performing the hypergraph convolution, the SHRA Module utilizes our proposed structure-sharing hypergraph convolution (SHGCN) to perform hypergraph convolutions, where the hypergraphs from different groups and the weight matrices for hypergraph convolutions are conducted in a right-shifted-permutation sequence of hypergraphs. As a result, the weights matrices can be shared with all groups of hypergraphs while performing hypergraph convolution, thus the global information can be used by the module to have a deep look into the input feature. We evaluate SHRA Module with models in object detection, lesion segmentation, and image classification tasks to demonstrate its effectiveness. Experimental results show that SHRA Module highly significantly enhances model performance, surpassing that of classic attention modules. |
Keyword | Attention Mechanism Hypergraph Structure-sharing |
DOI | 10.1016/j.eswa.2024.125240 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering ; Operations Research & Management Science |
WOS Subject | Computer Science, Artificial Intelligenceengineering, Electrical & Electronicoperations Research & Management Science |
WOS ID | WOS:001307906700001 |
Publisher | PERGAMON-ELSEVIER SCIENCE LTDTHE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, ENGLAND |
Scopus ID | 2-s2.0-85202935276 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Wang, Jingchao; Huang, Guoheng; Zhong, Guo; Lin, Tongxu; Pun, Chi Man; Xie, Fenfang |
Affiliation | 1.School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510000, China 2.Faculty of Applied Sciences, Macao Polytechnic University, 999078, Macao 3.School of Information Science and Technology, Guangdong University of Foreign Studies, Guangzhou, 510000, China 4.School of Automation, Guangdong University of Technology, Guangzhou, 510000, China 5.Faculty of Science and Technology, University of Macau, 999078, Macao |
Corresponding Author Affilication | Faculty of Science and Technology |
Recommended Citation GB/T 7714 | Wang, Jingchao,Huang, Guoheng,Yuan, Xiaochen,et al. The Structure-sharing Hypergraph Reasoning Attention Module for CNNs[J]. Expert Systems with Applications, 2025, 259, 125240. |
APA | Wang, Jingchao., Huang, Guoheng., Yuan, Xiaochen., Zhong, Guo., Lin, Tongxu., Pun, Chi Man., & Xie, Fenfang (2025). The Structure-sharing Hypergraph Reasoning Attention Module for CNNs. Expert Systems with Applications, 259, 125240. |
MLA | Wang, Jingchao,et al."The Structure-sharing Hypergraph Reasoning Attention Module for CNNs".Expert Systems with Applications 259(2025):125240. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment