Residential College | false |
Status | 已發表Published |
MIX-RS: A Multi-Indexing System Based on HDFS for Remote Sensing Data Storage | |
Jiashu Wu1,2; Jingpan Xiong1,2; Hao Dai1,2; Yang Wang3; Chengzhong Xu1,4 | |
2022-12-01 | |
Source Publication | Tsinghua Science and Technology |
ISSN | 1007-0214 |
Volume | 27Issue:6Pages:881-893 |
Abstract | A large volume of Remote Sensing (RS) data has been generated with the deployment of satellite technologies. The data facilitate research in ecological monitoring, land management and desertification, etc. The characteristics of RS data (e.g., enormous volume, large single-file size, and demanding requirement of fault tolerance) make the Hadoop Distributed File System (HDFS) an ideal choice for RS data storage as it is efficient, scalable, and equipped with a data replication mechanism for failure resilience. To use RS data, one of the most important techniques is geospatial indexing. However, the large data volume makes it time-consuming to efficiently construct and leverage. Considering that most modern geospatial data centres are equipped with HDFS-based big data processing infrastructures, deploying multiple geospatial indices becomes natural to optimise the efficacy. Moreover, because of the reliability introduced by high-quality hardware and the infrequently modified property of the RS data, the use of multi-indexing will not cause large overhead. Therefore, we design a framework called Multi-IndeXing-RS (MIX-RS) that unifies the multi-indexing mechanism on top of the HDFS with data replication enabled for both fault tolerance and geospatial indexing efficiency. Given the fault tolerance provided by the HDFS, RS data are structurally stored inside for faster geospatial indexing. Additionally, multi-indexing enhances efficiency. The proposed technique naturally sits on top of the HDFS to form a holistic framework without incurring severe overhead or sophisticated system implementation efforts. The MIX-RS framework is implemented and evaluated using real remote sensing data provided by the Chinese Academy of Sciences, demonstrating excellent geospatial indexing performance. |
Keyword | Geospatial Indexing Hadoop Distributed File System (Hdfs) Multi-indexing Mechanism Multi-indexing-rs (Mix-rs) Remote Sensing (Rs) Data |
DOI | 10.26599/TST.2021.9010082 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Information Systems ; Computer Science, Software Engineering ; Engineering, Electrical & Electronic |
WOS ID | WOS:000814631700004 |
Scopus ID | 2-s2.0-85133685670 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology |
Corresponding Author | Yang Wang |
Affiliation | 1.Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China 2.University of Chinese Academy of Sciences, Beijing, 100049, China 3.Guangdong-HongKong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China 4.University of Macau, Faculty of Science and Technology, 999078, Macao |
Recommended Citation GB/T 7714 | Jiashu Wu,Jingpan Xiong,Hao Dai,et al. MIX-RS: A Multi-Indexing System Based on HDFS for Remote Sensing Data Storage[J]. Tsinghua Science and Technology, 2022, 27(6), 881-893. |
APA | Jiashu Wu., Jingpan Xiong., Hao Dai., Yang Wang., & Chengzhong Xu (2022). MIX-RS: A Multi-Indexing System Based on HDFS for Remote Sensing Data Storage. Tsinghua Science and Technology, 27(6), 881-893. |
MLA | Jiashu Wu,et al."MIX-RS: A Multi-Indexing System Based on HDFS for Remote Sensing Data Storage".Tsinghua Science and Technology 27.6(2022):881-893. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment