Residential College | false |
Status | 已發表Published |
New multi-view human motion capture framework | |
Wang,Yuan1; Xu,Feiyi2; Pun,Chi Man3; Xiao,Wenqi1; Nie,Jianhui1; Xiong,Jian1; Gao,Hao1; Xu,Feng4 | |
2020-10-16 | |
Source Publication | IET Image Processing |
ISSN | 1751-9659 |
Volume | 14Issue:12Pages:2668-2674 |
Abstract | Estimating human pose and shape without markers is a challenging problem. This study proposes a multiple-view markerless human motion capture framework. Firstly, a multi-view camera system is built for capturing real-time images of moving humans on multiple views. Secondly, by employing the OpenPose method, the authors calculate robust 3D key points from 2D key points of the human body, which are estimated from the multi-view images. And dense 3D point cloud is reconstructed from images. Thirdly, they propose a novel SMPL-based method to represent human motion by fitting the SMPL model to 3D key points and 3D point clouds. In order to achieve a more accurate human pose, a penalty term is utilised to solve the problem of error accumulation in the process of human motion capture. In addition, they present a dense mesh templatebased SMPL that can be deformed to point cloud to recover a real human body shape. Finally, they map multi-view colour images onto the human mesh model to acquire rendered mesh. The experimental results show that the proposed method improves the accuracy of human pose and realises the 3D human body model more realistic. |
DOI | 10.1049/iet-ipr.2019.1606 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering ; Imaging Science & Photographic Technology |
WOS Subject | Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic ; Imaging Science & Photographic Technology |
WOS ID | WOS:000582146100006 |
Publisher | WILEY, 111 RIVER ST, HOBOKEN 07030-5774, NJ |
Scopus ID | 2-s2.0-85092577645 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Gao,Hao |
Affiliation | 1.Nanjing University of Posts and Telecommunications,Nanjing,China 2.School of Computer Science,Nanjing University of Posts and Telecommunications,Nanjing,China 3.Department of Computer and Information Science,University of Macau,Macao 4.School of Software,Tsinghua University,Beijing,China |
Recommended Citation GB/T 7714 | Wang,Yuan,Xu,Feiyi,Pun,Chi Man,et al. New multi-view human motion capture framework[J]. IET Image Processing, 2020, 14(12), 2668-2674. |
APA | Wang,Yuan., Xu,Feiyi., Pun,Chi Man., Xiao,Wenqi., Nie,Jianhui., Xiong,Jian., Gao,Hao., & Xu,Feng (2020). New multi-view human motion capture framework. IET Image Processing, 14(12), 2668-2674. |
MLA | Wang,Yuan,et al."New multi-view human motion capture framework".IET Image Processing 14.12(2020):2668-2674. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment