UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
MIX-RS: A Multi-Indexing System Based on HDFS for Remote Sensing Data Storage
Jiashu Wu1,2; Jingpan Xiong1,2; Hao Dai1,2; Yang Wang3; Chengzhong Xu1,4
2022-12-01
Source PublicationTsinghua Science and Technology
ISSN1007-0214
Volume27Issue:6Pages:881-893
Abstract

A large volume of Remote Sensing (RS) data has been generated with the deployment of satellite technologies. The data facilitate research in ecological monitoring, land management and desertification, etc. The characteristics of RS data (e.g., enormous volume, large single-file size, and demanding requirement of fault tolerance) make the Hadoop Distributed File System (HDFS) an ideal choice for RS data storage as it is efficient, scalable, and equipped with a data replication mechanism for failure resilience. To use RS data, one of the most important techniques is geospatial indexing. However, the large data volume makes it time-consuming to efficiently construct and leverage. Considering that most modern geospatial data centres are equipped with HDFS-based big data processing infrastructures, deploying multiple geospatial indices becomes natural to optimise the efficacy. Moreover, because of the reliability introduced by high-quality hardware and the infrequently modified property of the RS data, the use of multi-indexing will not cause large overhead. Therefore, we design a framework called Multi-IndeXing-RS (MIX-RS) that unifies the multi-indexing mechanism on top of the HDFS with data replication enabled for both fault tolerance and geospatial indexing efficiency. Given the fault tolerance provided by the HDFS, RS data are structurally stored inside for faster geospatial indexing. Additionally, multi-indexing enhances efficiency. The proposed technique naturally sits on top of the HDFS to form a holistic framework without incurring severe overhead or sophisticated system implementation efforts. The MIX-RS framework is implemented and evaluated using real remote sensing data provided by the Chinese Academy of Sciences, demonstrating excellent geospatial indexing performance.

KeywordGeospatial Indexing Hadoop Distributed File System (Hdfs) Multi-indexing Mechanism Multi-indexing-rs (Mix-rs) Remote Sensing (Rs) Data
DOI10.26599/TST.2021.9010082
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Information Systems ; Computer Science, Software Engineering ; Engineering, Electrical & Electronic
WOS IDWOS:000814631700004
Scopus ID2-s2.0-85133685670
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
Corresponding AuthorYang Wang
Affiliation1.Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
2.University of Chinese Academy of Sciences, Beijing, 100049, China
3.Guangdong-HongKong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
4.University of Macau, Faculty of Science and Technology, 999078, Macao
Recommended Citation
GB/T 7714
Jiashu Wu,Jingpan Xiong,Hao Dai,et al. MIX-RS: A Multi-Indexing System Based on HDFS for Remote Sensing Data Storage[J]. Tsinghua Science and Technology, 2022, 27(6), 881-893.
APA Jiashu Wu., Jingpan Xiong., Hao Dai., Yang Wang., & Chengzhong Xu (2022). MIX-RS: A Multi-Indexing System Based on HDFS for Remote Sensing Data Storage. Tsinghua Science and Technology, 27(6), 881-893.
MLA Jiashu Wu,et al."MIX-RS: A Multi-Indexing System Based on HDFS for Remote Sensing Data Storage".Tsinghua Science and Technology 27.6(2022):881-893.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Jiashu Wu]'s Articles
[Jingpan Xiong]'s Articles
[Hao Dai]'s Articles
Baidu academic
Similar articles in Baidu academic
[Jiashu Wu]'s Articles
[Jingpan Xiong]'s Articles
[Hao Dai]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Jiashu Wu]'s Articles
[Jingpan Xiong]'s Articles
[Hao Dai]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.