Residential Collegefalse
Status已發表Published
Countering the concept-drift problems in big data by an incrementally optimized stream mining model
Hang Yang1; Simon Fong2
2014-07-22
Source PublicationJournal of Systems and Software
ABS Journal Level2
ISSN0164-1212
Volume102Pages:158-166
Abstract

Mining the potential value hidden behind big data has been a popular research topic around the world. For an infinite big data scenario, the underlying data distribution of newly arrived data may be appeared differently from the old one in the real world. This phenomenon is so-called the concept-drift problem that exists commonly in the scenario of big data mining. In the past decade, decision tree inductions use multi-tree learning to detect the drift using alternative trees as a solution. However, multi-tree algorithms consume more computing resources than the singletree. This paper proposes a singletree with an optimized node-splitting mechanism to detect the drift in a test-then-training tree-building process. In the experiment, we compare the performance of the new method to some state-of-art singletree and multi-tree algorithms. Result shows that the new algorithm performs with good accuracy while a more compact model size and less use of memory than the others.

KeywordConcept Drift Data Stream Mining Very Fast Decision Tree
DOI10.1016/j.jss.2014.07.010
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Software Engineering ; Computer Science, Theory & Methods
WOS IDWOS:000350927300012
PublisherELSEVIER SCIENCE INC, 360 PARK AVE SOUTH, NEW YORK, NY 10010-1710 USA
Scopus ID2-s2.0-84923227603
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorSimon Fong
Affiliation1.Electric Power Research Institute, China Southern Power Grid, China
2.Department of Computer and Information Science, Faculty of Science and Technology, University of Macau, Macau
Corresponding Author AffilicationFaculty of Science and Technology
Recommended Citation
GB/T 7714
Hang Yang,Simon Fong. Countering the concept-drift problems in big data by an incrementally optimized stream mining model[J]. Journal of Systems and Software, 2014, 102, 158-166.
APA Hang Yang., & Simon Fong (2014). Countering the concept-drift problems in big data by an incrementally optimized stream mining model. Journal of Systems and Software, 102, 158-166.
MLA Hang Yang,et al."Countering the concept-drift problems in big data by an incrementally optimized stream mining model".Journal of Systems and Software 102(2014):158-166.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Hang Yang]'s Articles
[Simon Fong]'s Articles
Baidu academic
Similar articles in Baidu academic
[Hang Yang]'s Articles
[Simon Fong]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Hang Yang]'s Articles
[Simon Fong]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.