UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences
Zhao, Yicheng1; Zhang, Han2,3; Lu, Ping2,3; Li, Ping4,5; Wu, Enhua6,7; Sheng, Bin1
2022-10-01
Source PublicationVirtual Reality and Intelligent Hardware
ISSN2096-5796
Volume4Issue:5Pages:432-443
Abstract

Background: Exploring the correspondences across multi-view images is the basis of many computer vision tasks. However, most existing methods are limited on accuracy under challenging conditions. In order to learn more robust and accurate correspondences, we propose the DSD-MatchingNet for local feature matching in this paper. First, we develop a deformable feature extraction module to obtain multi-level feature maps, which harvests contextual information from dynamic receptive fields. The dynamic receptive fields provided by deformable convolution network ensures our method to obtain dense and robust correspondences. Second, we utilize the sparse-to-dense matching with the symmetry of correspondence to implement accurate pixel-level matching, which enables our method to produce more accurate correspondences. Experiments have shown that our proposed DSD-MatchingNet achieves a better performance on image matching benchmark, as well as on visual localization benchmark. Specifically, our method achieves 91.3% mean matching accuracy on HPatches dataset and 99.3% visual localization recalls on Aachen Day-Night dataset.

KeywordImage Matching Deformable Convolution Network Sparse-to-dense Matching
DOI10.1016/j.vrih.2022.08.007
URLView the original
Language英語English
Scopus ID2-s2.0-85143790327
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorLu, Ping; Sheng, Bin
Affiliation1.Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
2.ZTE Corporation, China
3.State Key Laboratory of Mobile Network and Mobile Multimedia Technology, China
4.Department of Computing, The Hong Kong Polytechnic University, Hong Kong
5.School of Design, The Hong Kong Polytechnic University, Hong Kong
6.State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, China
7.Faculty of Science and Technology, University of Macau, Macau, China
Recommended Citation
GB/T 7714
Zhao, Yicheng,Zhang, Han,Lu, Ping,et al. DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences[J]. Virtual Reality and Intelligent Hardware, 2022, 4(5), 432-443.
APA Zhao, Yicheng., Zhang, Han., Lu, Ping., Li, Ping., Wu, Enhua., & Sheng, Bin (2022). DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences. Virtual Reality and Intelligent Hardware, 4(5), 432-443.
MLA Zhao, Yicheng,et al."DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences".Virtual Reality and Intelligent Hardware 4.5(2022):432-443.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhao, Yicheng]'s Articles
[Zhang, Han]'s Articles
[Lu, Ping]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhao, Yicheng]'s Articles
[Zhang, Han]'s Articles
[Lu, Ping]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhao, Yicheng]'s Articles
[Zhang, Han]'s Articles
[Lu, Ping]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.