Residential Collegefalse
Status已發表Published
The Structure-sharing Hypergraph Reasoning Attention Module for CNNs
Wang, Jingchao1; Huang, Guoheng1; Yuan, Xiaochen2; Zhong, Guo3; Lin, Tongxu4; Pun, Chi Man5; Xie, Fenfang3
2025
Source PublicationExpert Systems with Applications
ABS Journal Level1
ISSN0957-4174
Volume259Pages:125240
Abstract

Attention mechanisms improve the performance of models by selectively processing relevant information. However, existing attention mechanisms for CNNs do not utilize the high-order semantic similarity between different channels in the input when inferring attention. To address this issue, in this paper, we propose the Structure-sharing Hypergraph Reasoning Attention Module (SHRA Module) to explore the high-order similarity among nodes via hypergraph learning. SHRA Module transforms the input CNN feature maps into hypergraph node representations, which are used to reason attention under a set of learnable hypergraph convolutions. When performing the hypergraph convolution, the SHRA Module utilizes our proposed structure-sharing hypergraph convolution (SHGCN) to perform hypergraph convolutions, where the hypergraphs from different groups and the weight matrices for hypergraph convolutions are conducted in a right-shifted-permutation sequence of hypergraphs. As a result, the weights matrices can be shared with all groups of hypergraphs while performing hypergraph convolution, thus the global information can be used by the module to have a deep look into the input feature. We evaluate SHRA Module with models in object detection, lesion segmentation, and image classification tasks to demonstrate its effectiveness. Experimental results show that SHRA Module highly significantly enhances model performance, surpassing that of classic attention modules.

KeywordAttention Mechanism Hypergraph Structure-sharing
DOI10.1016/j.eswa.2024.125240
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering ; Operations Research & Management Science
WOS SubjectComputer Science, Artificial Intelligenceengineering, Electrical & Electronicoperations Research & Management Science
WOS IDWOS:001307906700001
PublisherPERGAMON-ELSEVIER SCIENCE LTDTHE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, ENGLAND
Scopus ID2-s2.0-85202935276
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorWang, Jingchao; Huang, Guoheng; Zhong, Guo; Lin, Tongxu; Pun, Chi Man; Xie, Fenfang
Affiliation1.School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510000, China
2.Faculty of Applied Sciences, Macao Polytechnic University, 999078, Macao
3.School of Information Science and Technology, Guangdong University of Foreign Studies, Guangzhou, 510000, China
4.School of Automation, Guangdong University of Technology, Guangzhou, 510000, China
5.Faculty of Science and Technology, University of Macau, 999078, Macao
Corresponding Author AffilicationFaculty of Science and Technology
Recommended Citation
GB/T 7714
Wang, Jingchao,Huang, Guoheng,Yuan, Xiaochen,et al. The Structure-sharing Hypergraph Reasoning Attention Module for CNNs[J]. Expert Systems with Applications, 2025, 259, 125240.
APA Wang, Jingchao., Huang, Guoheng., Yuan, Xiaochen., Zhong, Guo., Lin, Tongxu., Pun, Chi Man., & Xie, Fenfang (2025). The Structure-sharing Hypergraph Reasoning Attention Module for CNNs. Expert Systems with Applications, 259, 125240.
MLA Wang, Jingchao,et al."The Structure-sharing Hypergraph Reasoning Attention Module for CNNs".Expert Systems with Applications 259(2025):125240.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wang, Jingchao]'s Articles
[Huang, Guoheng]'s Articles
[Yuan, Xiaochen]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wang, Jingchao]'s Articles
[Huang, Guoheng]'s Articles
[Yuan, Xiaochen]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wang, Jingchao]'s Articles
[Huang, Guoheng]'s Articles
[Yuan, Xiaochen]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.