Residential College | false |
Status | 已發表Published |
Countering the concept-drift problems in big data by an incrementally optimized stream mining model | |
Hang Yang1; Simon Fong2 | |
2014-07-22 | |
Source Publication | Journal of Systems and Software |
ABS Journal Level | 2 |
ISSN | 0164-1212 |
Volume | 102Pages:158-166 |
Abstract | Mining the potential value hidden behind big data has been a popular research topic around the world. For an infinite big data scenario, the underlying data distribution of newly arrived data may be appeared differently from the old one in the real world. This phenomenon is so-called the concept-drift problem that exists commonly in the scenario of big data mining. In the past decade, decision tree inductions use multi-tree learning to detect the drift using alternative trees as a solution. However, multi-tree algorithms consume more computing resources than the singletree. This paper proposes a singletree with an optimized node-splitting mechanism to detect the drift in a test-then-training tree-building process. In the experiment, we compare the performance of the new method to some state-of-art singletree and multi-tree algorithms. Result shows that the new algorithm performs with good accuracy while a more compact model size and less use of memory than the others. |
Keyword | Concept Drift Data Stream Mining Very Fast Decision Tree |
DOI | 10.1016/j.jss.2014.07.010 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Software Engineering ; Computer Science, Theory & Methods |
WOS ID | WOS:000350927300012 |
Publisher | ELSEVIER SCIENCE INC, 360 PARK AVE SOUTH, NEW YORK, NY 10010-1710 USA |
Scopus ID | 2-s2.0-84923227603 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Simon Fong |
Affiliation | 1.Electric Power Research Institute, China Southern Power Grid, China 2.Department of Computer and Information Science, Faculty of Science and Technology, University of Macau, Macau |
Corresponding Author Affilication | Faculty of Science and Technology |
Recommended Citation GB/T 7714 | Hang Yang,Simon Fong. Countering the concept-drift problems in big data by an incrementally optimized stream mining model[J]. Journal of Systems and Software, 2014, 102, 158-166. |
APA | Hang Yang., & Simon Fong (2014). Countering the concept-drift problems in big data by an incrementally optimized stream mining model. Journal of Systems and Software, 102, 158-166. |
MLA | Hang Yang,et al."Countering the concept-drift problems in big data by an incrementally optimized stream mining model".Journal of Systems and Software 102(2014):158-166. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment