Residential Collegefalse
Status已發表Published
Energy-aware cluster reconfiguration algorithm for the big data analytics platform spark
Kairong Duan1; Simon Fong1; Wei Song2; Athanasios V. Vasilakos3; Raymond Wong4
2017-12-18
Source PublicationSustainability (Switzerland)
ISSN2071-1050
Volume9Issue:12
Abstract

The development of Cloud computing and data analytics technologies has made it possible to process big data faster. Distributed computing schemes, for instance, can help to reduce the time required for data analysis and thus enhance its efficiency. However, fewer researchers have paid attention to the problem of the high-energy consumption of the cluster, placing a heavy burden on the environment, especially when the number of nodes is extremely large. As a consequence, the principle of sustainable development is violated. Considering this problem, this paper proposes an approach that can be applied to remove less-efficient nodes or to migrate over-utilized nodes of the cluster so as to adjust the load of the cluster properly and thereby achieve the goal of energy conservation. Furthermore, in order to testify the performance of the proposed methodology, we present the simulation results implemented by using CloudSim.

KeywordCloud Computing Sustainable Computing Spark
DOI10.3390/su9122357
URLView the original
Indexed BySCIE ; SSCI
Language英語English
WOS Research AreaScience & Technology - Other Topics ; Environmental Sciences & Ecology
WOS SubjectGreen & Sustainable Science & Technology ; Environmental Sciences ; Environmental Studies
WOS IDWOS:000419231500203
PublisherMDPI, ST ALBAN-ANLAGE 66, CH-4052 BASEL, SWITZERLAND
Scopus ID2-s2.0-85038438826
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorSimon Fong
Affiliation1.Department of Computer and Information Science, University of Macau, Taipa 999078, Macau, China
2.School of Computer Science, North China University of Technology, Beijing 100144, China
3.Lab of Networks and Cybersecurity, Innopolis University, Innopolis 420500, Russia
4.School of Computer Science and Engineering, University of New South Wales, Sydney 2052, Australia
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Kairong Duan,Simon Fong,Wei Song,et al. Energy-aware cluster reconfiguration algorithm for the big data analytics platform spark[J]. Sustainability (Switzerland), 2017, 9(12).
APA Kairong Duan., Simon Fong., Wei Song., Athanasios V. Vasilakos., & Raymond Wong (2017). Energy-aware cluster reconfiguration algorithm for the big data analytics platform spark. Sustainability (Switzerland), 9(12).
MLA Kairong Duan,et al."Energy-aware cluster reconfiguration algorithm for the big data analytics platform spark".Sustainability (Switzerland) 9.12(2017).
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Kairong Duan]'s Articles
[Simon Fong]'s Articles
[Wei Song]'s Articles
Baidu academic
Similar articles in Baidu academic
[Kairong Duan]'s Articles
[Simon Fong]'s Articles
[Wei Song]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Kairong Duan]'s Articles
[Simon Fong]'s Articles
[Wei Song]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.