Residential College | false |
Status | 已發表Published |
Virtual Reality Aided High-Quality 3D Reconstruction by Remote Drones | |
Zhang, Di1; Xu, Feng2; Pun, Chi Man3; Yang, Yang1; Lan, Rushi4; Wang, Liejun5; Li, Yujie6; Gao, Hao5 | |
2021-09-14 | |
Source Publication | ACM Transactions on Internet Technology |
ISSN | 1533-5399 |
Volume | 22Issue:1Pages:18 |
Abstract | Artificial intelligence including deep learning and 3D reconstruction methods is changing the daily life of people. Now, an unmanned aerial vehicle that can move freely in the air and avoid harsh ground conditions has been commonly adopted as a suitable tool for 3D reconstruction. The traditional 3D reconstruction mission based on drones usually consists of two steps: image collection and offline post-processing. But there are two problems: one is the uncertainty of whether all parts of the target object are covered, and another is the tedious post-processing time. Inspired by modern deep learning methods, we build a telexistence drone system with an onboard deep learning computation module and a wireless data transmission module that perform incremental real-time dense reconstruction of urban cities by itself. Two technical contributions are proposed to solve the preceding issues. First, based on the popular depth fusion surface reconstruction framework, we combine it with a visual-inertial odometry estimator that integrates the inertial measurement unit and allows for robust camera tracking as well as high-accuracy online 3D scan. Second, the capability of real-time 3D reconstruction enables a new rendering technique that can visualize the reconstructed geometry of the target as navigation guidance in the HMD. Therefore, it turns the traditional path-planning-based modeling process into an interactive one, leading to a higher level of scan completeness. The experiments in the simulation system and our real prototype demonstrate an improved quality of the 3D model using our artificial intelligence leveraged drone system. |
Keyword | 3d Reconstruction Human-robot-interaction Telexistence Unmanned Aerial Vehicle Virtual Reality |
DOI | 10.1145/3458930 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Information Systems ; Computer Science, Software Engineering |
WOS ID | WOS:000717399100018 |
Publisher | ASSOC COMPUTING MACHINERY1601 Broadway, 10th Floor, NEW YORK, NY 10019-7434 |
Scopus ID | 2-s2.0-85119199966 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Zhang, Di |
Affiliation | 1.Nanjing University of Posts and Telecommunications, Nanjing, China 2.Tsinghua University, Beijing, China 3.University of Macau, Taipa, Macao 4.Guilin University of Electronic Technology, Guilin, China 5.Xinjiang University, Ürümqi, China 6.Fukuoka University, Kitakyushu City, Japan |
Recommended Citation GB/T 7714 | Zhang, Di,Xu, Feng,Pun, Chi Man,et al. Virtual Reality Aided High-Quality 3D Reconstruction by Remote Drones[J]. ACM Transactions on Internet Technology, 2021, 22(1), 18. |
APA | Zhang, Di., Xu, Feng., Pun, Chi Man., Yang, Yang., Lan, Rushi., Wang, Liejun., Li, Yujie., & Gao, Hao (2021). Virtual Reality Aided High-Quality 3D Reconstruction by Remote Drones. ACM Transactions on Internet Technology, 22(1), 18. |
MLA | Zhang, Di,et al."Virtual Reality Aided High-Quality 3D Reconstruction by Remote Drones".ACM Transactions on Internet Technology 22.1(2021):18. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment