UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
The State of the Art of Metadata Managements in Large-Scale Distributed File Systems Scalability, Performance and Availability
Hao Dai1; Yang Wang1; Kenneth B. Kent2; Lingfang Zeng3; Chengzhong Xu4
2022-05-04
Source PublicationIEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS
ISSN1045-9219
Volume33Issue:12Pages:3850-3869
Abstract

File system metadata is the data in charge of maintaining namespace, permission semantics and location of file data blocks. Operations on the metadata can account for up to 80% of total file system operations. As such, the performance of metadata services significantly impacts the overall performance of file systems. A large-scale distributed file system (DFS) is a storage system that is composed of multiple storage devices spreading across different sites to accommodate data files, and in most cases, to provide users with location independent access interfaces. Large-scale DFSs have been widely deployed as a substrate to a plethora of computing systems, and thus their metadata management efficiency is crucial to a massive number of applications, especially with the advent of the big data age, which poses tremendous pressure on underlying storage systems. This paper reports the state-of-the-art research on metadata services in large-scale distributed file systems, which is conducted from three indicative perspectives that are always used to characterize DFSs: high-scalability, high-performance, and high-availability, with special focus on their respective major challenges as well as their developed mainstream technologies. Additionally, the paper also identifies and analyzes several existing problems in the research, which could be used as a reference for related studies.

KeywordHigh-availability High-performance High-scalability Large-scale Distributed File System Metadata Management
DOI10.1109/TPDS.2022.3170574
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS IDWOS:000831139000007
PublisherIEEE COMPUTER SOC, 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314
Scopus ID2-s2.0-85129364532
Fulltext Access
Citation statistics
Cited Times [WOS]:7   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
CollectionFaculty of Science and Technology
Corresponding AuthorYang Wang; Lingfang Zeng
Affiliation1.Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China.
2.Faculty of Computer Science, University of New Brunswick, Fredericton, NB E3B 5A3, Canada
3.ZJ Lab-Enflame Joint Innovation Research Center, Zhejiang Lab, Hangzhou, Zhejiang 310058, China
4.Faculty of Science and Technology, University of Macau, Macau 999078, China
Recommended Citation
GB/T 7714
Hao Dai,Yang Wang,Kenneth B. Kent,et al. The State of the Art of Metadata Managements in Large-Scale Distributed File Systems Scalability, Performance and Availability[J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33(12), 3850-3869.
APA Hao Dai., Yang Wang., Kenneth B. Kent., Lingfang Zeng., & Chengzhong Xu (2022). The State of the Art of Metadata Managements in Large-Scale Distributed File Systems Scalability, Performance and Availability. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 33(12), 3850-3869.
MLA Hao Dai,et al."The State of the Art of Metadata Managements in Large-Scale Distributed File Systems Scalability, Performance and Availability".IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS 33.12(2022):3850-3869.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Hao Dai]'s Articles
[Yang Wang]'s Articles
[Kenneth B. Kent]'s Articles
Baidu academic
Similar articles in Baidu academic
[Hao Dai]'s Articles
[Yang Wang]'s Articles
[Kenneth B. Kent]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Hao Dai]'s Articles
[Yang Wang]'s Articles
[Kenneth B. Kent]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.