Residential College | false |
Status | 已發表Published |
Energy-aware cluster reconfiguration algorithm for the big data analytics platform spark | |
Kairong Duan1; Simon Fong1; Wei Song2; Athanasios V. Vasilakos3; Raymond Wong4 | |
2017-12-18 | |
Source Publication | Sustainability (Switzerland) |
ISSN | 2071-1050 |
Volume | 9Issue:12 |
Abstract | The development of Cloud computing and data analytics technologies has made it possible to process big data faster. Distributed computing schemes, for instance, can help to reduce the time required for data analysis and thus enhance its efficiency. However, fewer researchers have paid attention to the problem of the high-energy consumption of the cluster, placing a heavy burden on the environment, especially when the number of nodes is extremely large. As a consequence, the principle of sustainable development is violated. Considering this problem, this paper proposes an approach that can be applied to remove less-efficient nodes or to migrate over-utilized nodes of the cluster so as to adjust the load of the cluster properly and thereby achieve the goal of energy conservation. Furthermore, in order to testify the performance of the proposed methodology, we present the simulation results implemented by using CloudSim. |
Keyword | Cloud Computing Sustainable Computing Spark |
DOI | 10.3390/su9122357 |
URL | View the original |
Indexed By | SCIE ; SSCI |
Language | 英語English |
WOS Research Area | Science & Technology - Other Topics ; Environmental Sciences & Ecology |
WOS Subject | Green & Sustainable Science & Technology ; Environmental Sciences ; Environmental Studies |
WOS ID | WOS:000419231500203 |
Publisher | MDPI, ST ALBAN-ANLAGE 66, CH-4052 BASEL, SWITZERLAND |
Scopus ID | 2-s2.0-85038438826 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Simon Fong |
Affiliation | 1.Department of Computer and Information Science, University of Macau, Taipa 999078, Macau, China 2.School of Computer Science, North China University of Technology, Beijing 100144, China 3.Lab of Networks and Cybersecurity, Innopolis University, Innopolis 420500, Russia 4.School of Computer Science and Engineering, University of New South Wales, Sydney 2052, Australia |
First Author Affilication | University of Macau |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Kairong Duan,Simon Fong,Wei Song,et al. Energy-aware cluster reconfiguration algorithm for the big data analytics platform spark[J]. Sustainability (Switzerland), 2017, 9(12). |
APA | Kairong Duan., Simon Fong., Wei Song., Athanasios V. Vasilakos., & Raymond Wong (2017). Energy-aware cluster reconfiguration algorithm for the big data analytics platform spark. Sustainability (Switzerland), 9(12). |
MLA | Kairong Duan,et al."Energy-aware cluster reconfiguration algorithm for the big data analytics platform spark".Sustainability (Switzerland) 9.12(2017). |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment