Residential College | false |
Status | 已發表Published |
Building a Stereo and Wide-View Hybrid RGB/FIR Imaging System for Autonomous Vehicle | |
Yigong Zhang1; Zezhou Sun1; Banghe Wu1; Jian Yang1; Hui Kong2 | |
2022-01-15 | |
Source Publication | IEEE SENSORS JOURNAL |
ISSN | 1530-437X |
Volume | 22Issue:2Pages:1638-1651 |
Abstract | In this work, a novel paradigm is proposed to build a hybrid RGB/FIR camera, which outputs pixel-wisely aligned and temporally synchronized RGB and FIR frames simultaneously. Compared with the existing schemes, we innovate in several ways to make it compact, practical, and extendable for real-world applications. First, we propose a new structure layout design of the hybrid camera, and we also design a removable adjuster to detach the hybrid camera from the base platform. For RGB and FIR image registration, we have achieved a pixel-wise spatial registration of the FIR and RGB frames by a two-step alignment, where we propose a ghost-effect removal scheme to remove the ghost effect from the rolling-shutter-based FIR camera. Finally, multiple hybrid cameras are extended to a hybrid camera array, through which we can obtain wide-view spatially aligned FIR, RGB and disparity images simultaneously. The experimental results demonstrate the accuracy of the hybrid camera and the effectiveness of the designed stereo wide-view hybrid camera system. |
Keyword | Image Registration Image Stitching Multi-spectral Camera Stereo Matching |
DOI | 10.1109/JSEN.2021.3131342 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Engineering ; Instruments & Instrumentation ; Physics |
WOS Subject | Engineering, Electrical & Electronic ; Instruments & Instrumentation ; Physics, Applied |
WOS ID | WOS:000742197300060 |
Scopus ID | 2-s2.0-85120881917 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF ELECTROMECHANICAL ENGINEERING THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) |
Corresponding Author | Jian Yang |
Affiliation | 1.Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information, Ministry of Education, Jiangsu Key Laboratory of Image and Video Understanding for Social Security, School of Computer Science and Engineering, Nanjing University of Sci 2.Department of Electromechanical Engineering (EME), State Key Laboratory of Internet of Things for Smart City (SKL-IOTSC), University of Macau, Taipa, Macao |
Recommended Citation GB/T 7714 | Yigong Zhang,Zezhou Sun,Banghe Wu,et al. Building a Stereo and Wide-View Hybrid RGB/FIR Imaging System for Autonomous Vehicle[J]. IEEE SENSORS JOURNAL, 2022, 22(2), 1638-1651. |
APA | Yigong Zhang., Zezhou Sun., Banghe Wu., Jian Yang., & Hui Kong (2022). Building a Stereo and Wide-View Hybrid RGB/FIR Imaging System for Autonomous Vehicle. IEEE SENSORS JOURNAL, 22(2), 1638-1651. |
MLA | Yigong Zhang,et al."Building a Stereo and Wide-View Hybrid RGB/FIR Imaging System for Autonomous Vehicle".IEEE SENSORS JOURNAL 22.2(2022):1638-1651. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment