Residential Collegefalse
Status已發表Published
Towards Unstructured Unlabeled Optical Mocap: A Video Helps!
Milef, Nicholas1; Keyser, John1; KONG SHU1,2
2024-07
Conference NameSIGGRAPH 2024 Conference Papers
Source PublicationSIGGRAPH 2024 Conference Papers
Pages201050
Conference Date28 July 2024 through 1 August 2024
Conference PlaceDenver, USA
PublisherAssociation for Computing Machinery, Inc
Abstract

Optical motion capture (mocap) requires accurately reconstructing the human body from retroreflective markers, including pose and shape. In a typical mocap setting, marker labeling is an important but tedious and error-prone step. Previous work has shown that marker labeling can be automated by using a structured template defining specific marker placements, but this places additional recording constraints. We propose to relax these constraints and solve for Unstructured Unlabeled Optical (UUO) mocap. Compared to the typical mocap setting that either labels markers or places them w.r.t a structured layout, markers in UUO mocap can be placed anywhere on the body and even on one specific limb (e.g., right leg for biomechanics research), hence it is of more practical significance. It is also more challenging. To solve UUO mocap, we exploit a monocular video captured by a single RGB camera, which does not require camera calibration. On this video, we run an off-the-shelf method to reconstruct and track a human individual, giving strong visual priors of human body pose and shape. With both the video and UUO markers, we propose an optimization pipeline towards marker identification, marker labeling, human pose estimation, and human body reconstruction. Our technical novelties include multiple hypothesis testing to optimize global orientation, and marker localization and marker-part matching to better optimize for body surface. We conduct extensive experiments to quantitatively compare our method against state-of-the-art approaches, including marker-only mocap and video-only human body/shape reconstruction. Experiments demonstrate that our method resoundingly outperforms existing methods on three established benchmark datasets for both full-body and partial-body reconstruction.

KeywordHuman Body Reconstruction Motion Capture Partial-body Reconstruction
DOI10.1145/3641519.3657522
URLView the original
Language英語English
Scopus ID2-s2.0-85199873035
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorKONG SHU
Affiliation1.Texas A & M University, College Station, TX, United States
2.University of Macau, Macao
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Milef, Nicholas,Keyser, John,KONG SHU. Towards Unstructured Unlabeled Optical Mocap: A Video Helps![C]:Association for Computing Machinery, Inc, 2024, 201050.
APA Milef, Nicholas., Keyser, John., & KONG SHU (2024). Towards Unstructured Unlabeled Optical Mocap: A Video Helps!. SIGGRAPH 2024 Conference Papers, 201050.
Files in This Item: Download All
File Name/Size Publications Version Access License
UUO-mocap.pdf(8569KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Milef, Nicholas]'s Articles
[Keyser, John]'s Articles
[KONG SHU]'s Articles
Baidu academic
Similar articles in Baidu academic
[Milef, Nicholas]'s Articles
[Keyser, John]'s Articles
[KONG SHU]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Milef, Nicholas]'s Articles
[Keyser, John]'s Articles
[KONG SHU]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: UUO-mocap.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.