UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
RADepthNet: Reflectance-Aware Monocular Depth Estimation
Li, Chuxuan1; Yi, Ran1; Ali, Saba Ghazanfar1; Ma, Lizhuang1; Wu, Enhua2; Wang, Jihong3; Mao, Lijuan3; Sheng, Bin1
2022-10-01
Source PublicationVirtual Reality and Intelligent Hardware
ISSN2096-5796
Volume4Issue:5Pages:418-431
Abstract

Background: Monocular depth estimation aims to predict the dense depth map from a single RGB image, which has important applications in 3D reconstruction, automatic driving, and augmented reality. However, existing methods directly feed the original RGB image into the model to extract depth features without avoiding the interference of depth-irrelevant information on depth estimation accuracy, which leads to inferior performance. To remove the influence of depth-irrelevant information and improve depth prediction accuracy, we propose RADepthNet, a novel reflectance-guided network fusing boundary features. Specifically, our method predicts depth maps using three steps: 1) Intrinsic Image Decomposition. We propose a Reflectance extraction module consisting of an encoder-decoder structure to extract depth-related reflectance. We demonstrate that the module can reduce the influence of illumination on depth estimation through an ablation study. 2) Boundary Detection. Boundary extraction module, consisting of an encoder, a refinement block, and an upsample block, is proposed to better predict depth at object boundaries utilizing gradient constraints. 3) Depth Prediction Module. Use a different encoder from 2) to obtain depth features from the reflectance map and fuse boundary features to predict depth. Besides, we proposed FIFADataset, a depth estimation dataset applied in soccer scenarios. Extensive experiments on the public dataset and our proposed FIFADataset show that our method achieves state-of-the-art performance.

KeywordMonocular Depth Estimation Deep Learning Intrinsic Image Decomposition
DOI10.1016/j.vrih.2022.08.005
URLView the original
Language英語English
Scopus ID2-s2.0-85143761582
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Co-First AuthorWang, Jihong
Corresponding AuthorSheng, Bin
Affiliation1.Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
2.Department of State Key Laboratory of Computer Science, University of Macau, Macau, 999078, China
3.Shanghai University of Sports, Shanghai, 200438, China
Recommended Citation
GB/T 7714
Li, Chuxuan,Yi, Ran,Ali, Saba Ghazanfar,et al. RADepthNet: Reflectance-Aware Monocular Depth Estimation[J]. Virtual Reality and Intelligent Hardware, 2022, 4(5), 418-431.
APA Li, Chuxuan., Yi, Ran., Ali, Saba Ghazanfar., Ma, Lizhuang., Wu, Enhua., Wang, Jihong., Mao, Lijuan., & Sheng, Bin (2022). RADepthNet: Reflectance-Aware Monocular Depth Estimation. Virtual Reality and Intelligent Hardware, 4(5), 418-431.
MLA Li, Chuxuan,et al."RADepthNet: Reflectance-Aware Monocular Depth Estimation".Virtual Reality and Intelligent Hardware 4.5(2022):418-431.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Li, Chuxuan]'s Articles
[Yi, Ran]'s Articles
[Ali, Saba Ghazanfar]'s Articles
Baidu academic
Similar articles in Baidu academic
[Li, Chuxuan]'s Articles
[Yi, Ran]'s Articles
[Ali, Saba Ghazanfar]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Li, Chuxuan]'s Articles
[Yi, Ran]'s Articles
[Ali, Saba Ghazanfar]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.