Residential College | false |
Status | 已發表Published |
RADepthNet: Reflectance-Aware Monocular Depth Estimation | |
Li, Chuxuan1; Yi, Ran1; Ali, Saba Ghazanfar1; Ma, Lizhuang1; Wu, Enhua2; Wang, Jihong3; Mao, Lijuan3; Sheng, Bin1 | |
2022-10-01 | |
Source Publication | Virtual Reality and Intelligent Hardware |
ISSN | 2096-5796 |
Volume | 4Issue:5Pages:418-431 |
Abstract | Background: Monocular depth estimation aims to predict the dense depth map from a single RGB image, which has important applications in 3D reconstruction, automatic driving, and augmented reality. However, existing methods directly feed the original RGB image into the model to extract depth features without avoiding the interference of depth-irrelevant information on depth estimation accuracy, which leads to inferior performance. To remove the influence of depth-irrelevant information and improve depth prediction accuracy, we propose RADepthNet, a novel reflectance-guided network fusing boundary features. Specifically, our method predicts depth maps using three steps: 1) Intrinsic Image Decomposition. We propose a Reflectance extraction module consisting of an encoder-decoder structure to extract depth-related reflectance. We demonstrate that the module can reduce the influence of illumination on depth estimation through an ablation study. 2) Boundary Detection. Boundary extraction module, consisting of an encoder, a refinement block, and an upsample block, is proposed to better predict depth at object boundaries utilizing gradient constraints. 3) Depth Prediction Module. Use a different encoder from 2) to obtain depth features from the reflectance map and fuse boundary features to predict depth. Besides, we proposed FIFADataset, a depth estimation dataset applied in soccer scenarios. Extensive experiments on the public dataset and our proposed FIFADataset show that our method achieves state-of-the-art performance. |
Keyword | Monocular Depth Estimation Deep Learning Intrinsic Image Decomposition |
DOI | 10.1016/j.vrih.2022.08.005 |
URL | View the original |
Language | 英語English |
Scopus ID | 2-s2.0-85143761582 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Co-First Author | Wang, Jihong |
Corresponding Author | Sheng, Bin |
Affiliation | 1.Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China 2.Department of State Key Laboratory of Computer Science, University of Macau, Macau, 999078, China 3.Shanghai University of Sports, Shanghai, 200438, China |
Recommended Citation GB/T 7714 | Li, Chuxuan,Yi, Ran,Ali, Saba Ghazanfar,et al. RADepthNet: Reflectance-Aware Monocular Depth Estimation[J]. Virtual Reality and Intelligent Hardware, 2022, 4(5), 418-431. |
APA | Li, Chuxuan., Yi, Ran., Ali, Saba Ghazanfar., Ma, Lizhuang., Wu, Enhua., Wang, Jihong., Mao, Lijuan., & Sheng, Bin (2022). RADepthNet: Reflectance-Aware Monocular Depth Estimation. Virtual Reality and Intelligent Hardware, 4(5), 418-431. |
MLA | Li, Chuxuan,et al."RADepthNet: Reflectance-Aware Monocular Depth Estimation".Virtual Reality and Intelligent Hardware 4.5(2022):418-431. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment