UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
A spatiotemporal and motion information extraction network for action recognition
Wei Wang1; Xianmin Wang2; Mingliang Zhou1; Xuekai Wei3; Jing Li2; Xiaojun Ren2; Xuemei Zong4
2024-08
Source PublicationWireless Networks
ISSN1022-0038
Volume30Pages:5389-5405
Abstract

With the continuous advancement in Internet-of-Things and deep learning, video action recognition is gradually emerging in daily and industrial applications. Spatiotemporal and motion patterns are two crucial and complementary types of information used for action recognition. However, effectively modelling both types of information in videos remains challenging. In this paper, we propose a spatiotemporal and motion information extraction (STME) network that extracts comprehensive spatiotemporal and motion information from videos for action recognition. First, we design the STME network, which includes three efficient modules: a spatiotemporal extraction (STE) module, a short-term motion extraction (SME) module and a long-term motion extraction (LME) module. The SME and LME modules are used to model short-term and long-term motion representation, respectively. Then, we apply the STE module to capture comprehensive spatiotemporal information which can supplement the video representation for action recognition. According to our experimental results, the STME network achieves significantly better performance than existing methods on several benchmark datasets. Our codes are available at https://github.com/STME-Net/STME.

KeywordAction Recognition Spatiotemporal Information Motion Deep Learning
DOI10.1007/s11276-023-03267-y
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering ; Telecommunications
WOS SubjectComputer Science, Information Systems ; Engineering, Electrical & Electronic ; Telecommunications
WOS IDWOS:000940888900005
PublisherSPRINGER, VAN GODEWIJCKSTRAAT 30, 3311 GZ DORDRECHT, NETHERLANDS
Scopus ID2-s2.0-85149047645
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING
Corresponding AuthorXianmin Wang
Affiliation1.School of Computer Science, Chongqing University, Chongqing 400044, China
2.Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou 510030, China
3.Institute of Artificial Intelligence and Blockchain, Guangzhou University, Guangzhou 510030, China
4.Jiangsu XCMG Construction Machinery Research Institute LTD, Xuzhou 221004, China
Recommended Citation
GB/T 7714
Wei Wang,Xianmin Wang,Mingliang Zhou,et al. A spatiotemporal and motion information extraction network for action recognition[J]. Wireless Networks, 2024, 30, 5389-5405.
APA Wei Wang., Xianmin Wang., Mingliang Zhou., Xuekai Wei., Jing Li., Xiaojun Ren., & Xuemei Zong (2024). A spatiotemporal and motion information extraction network for action recognition. Wireless Networks, 30, 5389-5405.
MLA Wei Wang,et al."A spatiotemporal and motion information extraction network for action recognition".Wireless Networks 30(2024):5389-5405.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wei Wang]'s Articles
[Xianmin Wang]'s Articles
[Mingliang Zhou]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wei Wang]'s Articles
[Xianmin Wang]'s Articles
[Mingliang Zhou]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wei Wang]'s Articles
[Xianmin Wang]'s Articles
[Mingliang Zhou]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.