UM  > Faculty of Science and Technology  > DEPARTMENT OF ELECTROMECHANICAL ENGINEERING
Residential Collegefalse
Status已發表Published
Building a Stereo and Wide-View Hybrid RGB/FIR Imaging System for Autonomous Vehicle
Yigong Zhang1; Zezhou Sun1; Banghe Wu1; Jian Yang1; Hui Kong2
2022-01-15
Source PublicationIEEE SENSORS JOURNAL
ISSN1530-437X
Volume22Issue:2Pages:1638-1651
Abstract

In this work, a novel paradigm is proposed to build a hybrid RGB/FIR camera, which outputs pixel-wisely aligned and temporally synchronized RGB and FIR frames simultaneously. Compared with the existing schemes, we innovate in several ways to make it compact, practical, and extendable for real-world applications. First, we propose a new structure layout design of the hybrid camera, and we also design a removable adjuster to detach the hybrid camera from the base platform. For RGB and FIR image registration, we have achieved a pixel-wise spatial registration of the FIR and RGB frames by a two-step alignment, where we propose a ghost-effect removal scheme to remove the ghost effect from the rolling-shutter-based FIR camera. Finally, multiple hybrid cameras are extended to a hybrid camera array, through which we can obtain wide-view spatially aligned FIR, RGB and disparity images simultaneously. The experimental results demonstrate the accuracy of the hybrid camera and the effectiveness of the designed stereo wide-view hybrid camera system.

KeywordImage Registration Image Stitching Multi-spectral Camera Stereo Matching
DOI10.1109/JSEN.2021.3131342
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEngineering ; Instruments & Instrumentation ; Physics
WOS SubjectEngineering, Electrical & Electronic ; Instruments & Instrumentation ; Physics, Applied
WOS IDWOS:000742197300060
Scopus ID2-s2.0-85120881917
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF ELECTROMECHANICAL ENGINEERING
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
Corresponding AuthorJian Yang
Affiliation1.Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information, Ministry of Education, Jiangsu Key Laboratory of Image and Video Understanding for Social Security, School of Computer Science and Engineering, Nanjing University of Sci
2.Department of Electromechanical Engineering (EME), State Key Laboratory of Internet of Things for Smart City (SKL-IOTSC), University of Macau, Taipa, Macao
Recommended Citation
GB/T 7714
Yigong Zhang,Zezhou Sun,Banghe Wu,et al. Building a Stereo and Wide-View Hybrid RGB/FIR Imaging System for Autonomous Vehicle[J]. IEEE SENSORS JOURNAL, 2022, 22(2), 1638-1651.
APA Yigong Zhang., Zezhou Sun., Banghe Wu., Jian Yang., & Hui Kong (2022). Building a Stereo and Wide-View Hybrid RGB/FIR Imaging System for Autonomous Vehicle. IEEE SENSORS JOURNAL, 22(2), 1638-1651.
MLA Yigong Zhang,et al."Building a Stereo and Wide-View Hybrid RGB/FIR Imaging System for Autonomous Vehicle".IEEE SENSORS JOURNAL 22.2(2022):1638-1651.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yigong Zhang]'s Articles
[Zezhou Sun]'s Articles
[Banghe Wu]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yigong Zhang]'s Articles
[Zezhou Sun]'s Articles
[Banghe Wu]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yigong Zhang]'s Articles
[Zezhou Sun]'s Articles
[Banghe Wu]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.