Residential College | false |
Status | 已發表Published |
DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences | |
Zhao, Yicheng1; Zhang, Han2,3; Lu, Ping2,3; Li, Ping4,5; Wu, Enhua6,7; Sheng, Bin1 | |
2022-10-01 | |
Source Publication | Virtual Reality and Intelligent Hardware |
ISSN | 2096-5796 |
Volume | 4Issue:5Pages:432-443 |
Abstract | Background: Exploring the correspondences across multi-view images is the basis of many computer vision tasks. However, most existing methods are limited on accuracy under challenging conditions. In order to learn more robust and accurate correspondences, we propose the DSD-MatchingNet for local feature matching in this paper. First, we develop a deformable feature extraction module to obtain multi-level feature maps, which harvests contextual information from dynamic receptive fields. The dynamic receptive fields provided by deformable convolution network ensures our method to obtain dense and robust correspondences. Second, we utilize the sparse-to-dense matching with the symmetry of correspondence to implement accurate pixel-level matching, which enables our method to produce more accurate correspondences. Experiments have shown that our proposed DSD-MatchingNet achieves a better performance on image matching benchmark, as well as on visual localization benchmark. Specifically, our method achieves 91.3% mean matching accuracy on HPatches dataset and 99.3% visual localization recalls on Aachen Day-Night dataset. |
Keyword | Image Matching Deformable Convolution Network Sparse-to-dense Matching |
DOI | 10.1016/j.vrih.2022.08.007 |
URL | View the original |
Language | 英語English |
Scopus ID | 2-s2.0-85143790327 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Lu, Ping; Sheng, Bin |
Affiliation | 1.Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China 2.ZTE Corporation, China 3.State Key Laboratory of Mobile Network and Mobile Multimedia Technology, China 4.Department of Computing, The Hong Kong Polytechnic University, Hong Kong 5.School of Design, The Hong Kong Polytechnic University, Hong Kong 6.State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, China 7.Faculty of Science and Technology, University of Macau, Macau, China |
Recommended Citation GB/T 7714 | Zhao, Yicheng,Zhang, Han,Lu, Ping,et al. DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences[J]. Virtual Reality and Intelligent Hardware, 2022, 4(5), 432-443. |
APA | Zhao, Yicheng., Zhang, Han., Lu, Ping., Li, Ping., Wu, Enhua., & Sheng, Bin (2022). DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences. Virtual Reality and Intelligent Hardware, 4(5), 432-443. |
MLA | Zhao, Yicheng,et al."DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences".Virtual Reality and Intelligent Hardware 4.5(2022):432-443. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment