Residential College | false |
Status | 已發表Published |
A spatiotemporal and motion information extraction network for action recognition | |
Wei Wang1; Xianmin Wang2; Mingliang Zhou1; Xuekai Wei3; Jing Li2; Xiaojun Ren2; Xuemei Zong4 | |
2024-08 | |
Source Publication | Wireless Networks |
ISSN | 1022-0038 |
Volume | 30Pages:5389-5405 |
Abstract | With the continuous advancement in Internet-of-Things and deep learning, video action recognition is gradually emerging in daily and industrial applications. Spatiotemporal and motion patterns are two crucial and complementary types of information used for action recognition. However, effectively modelling both types of information in videos remains challenging. In this paper, we propose a spatiotemporal and motion information extraction (STME) network that extracts comprehensive spatiotemporal and motion information from videos for action recognition. First, we design the STME network, which includes three efficient modules: a spatiotemporal extraction (STE) module, a short-term motion extraction (SME) module and a long-term motion extraction (LME) module. The SME and LME modules are used to model short-term and long-term motion representation, respectively. Then, we apply the STE module to capture comprehensive spatiotemporal information which can supplement the video representation for action recognition. According to our experimental results, the STME network achieves significantly better performance than existing methods on several benchmark datasets. Our codes are available at https://github.com/STME-Net/STME. |
Keyword | Action Recognition Spatiotemporal Information Motion Deep Learning |
DOI | 10.1007/s11276-023-03267-y |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering ; Telecommunications |
WOS Subject | Computer Science, Information Systems ; Engineering, Electrical & Electronic ; Telecommunications |
WOS ID | WOS:000940888900005 |
Publisher | SPRINGER, VAN GODEWIJCKSTRAAT 30, 3311 GZ DORDRECHT, NETHERLANDS |
Scopus ID | 2-s2.0-85149047645 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING |
Corresponding Author | Xianmin Wang |
Affiliation | 1.School of Computer Science, Chongqing University, Chongqing 400044, China 2.Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou 510030, China 3.Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou 510030, China 4.Jiangsu XCMG Construction Machinery Research Institute LTD, Xuzhou 221004, China |
Recommended Citation GB/T 7714 | Wei Wang,Xianmin Wang,Mingliang Zhou,et al. A spatiotemporal and motion information extraction network for action recognition[J]. Wireless Networks, 2024, 30, 5389-5405. |
APA | Wei Wang., Xianmin Wang., Mingliang Zhou., Xuekai Wei., Jing Li., Xiaojun Ren., & Xuemei Zong (2024). A spatiotemporal and motion information extraction network for action recognition. Wireless Networks, 30, 5389-5405. |
MLA | Wei Wang,et al."A spatiotemporal and motion information extraction network for action recognition".Wireless Networks 30(2024):5389-5405. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment