Residential College | false |
Status | 已發表Published |
The State of the Art of Metadata Managements in Large-Scale Distributed File Systems Scalability, Performance and Availability | |
Hao Dai1; Yang Wang1; Kenneth B. Kent2; Lingfang Zeng3; Chengzhong Xu4 | |
2022-05-04 | |
Source Publication | IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS |
ISSN | 1045-9219 |
Volume | 33Issue:12Pages:3850-3869 |
Abstract | File system metadata is the data in charge of maintaining namespace, permission semantics and location of file data blocks. Operations on the metadata can account for up to 80% of total file system operations. As such, the performance of metadata services significantly impacts the overall performance of file systems. A large-scale distributed file system (DFS) is a storage system that is composed of multiple storage devices spreading across different sites to accommodate data files, and in most cases, to provide users with location independent access interfaces. Large-scale DFSs have been widely deployed as a substrate to a plethora of computing systems, and thus their metadata management efficiency is crucial to a massive number of applications, especially with the advent of the big data age, which poses tremendous pressure on underlying storage systems. This paper reports the state-of-the-art research on metadata services in large-scale distributed file systems, which is conducted from three indicative perspectives that are always used to characterize DFSs: high-scalability, high-performance, and high-availability, with special focus on their respective major challenges as well as their developed mainstream technologies. Additionally, the paper also identifies and analyzes several existing problems in the research, which could be used as a reference for related studies. |
Keyword | High-availability High-performance High-scalability Large-scale Distributed File System Metadata Management |
DOI | 10.1109/TPDS.2022.3170574 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Theory & Methods ; Engineering, Electrical & Electronic |
WOS ID | WOS:000831139000007 |
Publisher | IEEE COMPUTER SOC, 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314 |
Scopus ID | 2-s2.0-85129364532 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology |
Corresponding Author | Yang Wang; Lingfang Zeng |
Affiliation | 1.Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China. 2.Faculty of Computer Science, University of New Brunswick, Fredericton, NB E3B 5A3, Canada 3.ZJ Lab-Enflame Joint Innovation Research Center, Zhejiang Lab, Hangzhou, Zhejiang 310058, China 4.Faculty of Science and Technology, University of Macau, Macau 999078, China |
Recommended Citation GB/T 7714 | Hao Dai,Yang Wang,Kenneth B. Kent,et al. The State of the Art of Metadata Managements in Large-Scale Distributed File Systems Scalability, Performance and Availability[J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33(12), 3850-3869. |
APA | Hao Dai., Yang Wang., Kenneth B. Kent., Lingfang Zeng., & Chengzhong Xu (2022). The State of the Art of Metadata Managements in Large-Scale Distributed File Systems Scalability, Performance and Availability. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 33(12), 3850-3869. |
MLA | Hao Dai,et al."The State of the Art of Metadata Managements in Large-Scale Distributed File Systems Scalability, Performance and Availability".IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS 33.12(2022):3850-3869. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment