Residential College | false |
Status | 已發表Published |
Lightweight feature selection methods based on standardized measure of dispersion for mining big data | |
Simon Fong; Robert P. Biuk-Aghai; Yain-Whar Si | |
2017-03-13 | |
Conference Name | IEEE International Conference on Computer and Information Technology (CIT) |
Source Publication | 2016 IEEE International Conference on Computer and Information Technology (CIT) |
Pages | 553-559 |
Conference Date | 8-10 Dec. 2016 |
Conference Place | Nadi, Fiji |
Publisher | IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA |
Abstract | Big data analytics is emerging as an important research field nowadays with many technical challenges that confront both commercial IT deployment and big data research communities. One of the inherent problems of big data is the curse of dimensionality. Modern data are described with many attributes and stored with high dimensions. In data analytics, feature selection has been popularly used to lighten the processing load in inducing a data mining model. However, when mining high dimensional data the search space from which an optimal feature subset is to be derived grows exponentially. That leads to an intractable demand in computation. In order to tackle this problem of high-dimensionality and the challenge of achieving high-speed processing over big data, a collection of novel lightweight feature selection methods is proposed in this paper. The feature selection methods are designed particularly for processing high-dimensional data quickly, by fast clustering and separating attributes using the standardized measure of dispersion. For performance evaluation, several types of big data with large degrees of dimensionality are put under test with our new feature selection algorithms. The new methods achieve enhanced classification accuracy within a relatively short time in comparison to existing feature selection methods. |
Keyword | Feature Selection Classification Big Data |
DOI | 10.1109/CIT.2016.120 |
URL | View the original |
Indexed By | CPCI-S ; CPCI-SSH |
Language | 英語English |
WOS Research Area | Computer Science ; Information Science & Library Science |
WOS Subject | Computer Science, Artificial Intelligence ; Computer Science, Information Systems ; Information Science & Library Science |
WOS ID | WOS:000411239100079 |
Scopus ID | 2-s2.0-85017340099 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Simon Fong |
Affiliation | Department of Computer and Information Science Faculty of Science and Technology University of Macau Taipa, Macau SAR |
First Author Affilication | Faculty of Science and Technology |
Corresponding Author Affilication | Faculty of Science and Technology |
Recommended Citation GB/T 7714 | Simon Fong,Robert P. Biuk-Aghai,Yain-Whar Si. Lightweight feature selection methods based on standardized measure of dispersion for mining big data[C]:IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA, 2017, 553-559. |
APA | Simon Fong., Robert P. Biuk-Aghai., & Yain-Whar Si (2017). Lightweight feature selection methods based on standardized measure of dispersion for mining big data. 2016 IEEE International Conference on Computer and Information Technology (CIT), 553-559. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment