Residential College | false |
Status | 已發表Published |
A novel sensor data pre-processing methodology for the internet of things using anomaly detection and transfer-by-subspace-similarity transformation | |
Yan Zhong1; Simon Fong2; Shimin Hu2; Raymond Wong3; Weiwei Lin4 | |
2019-10-18 | |
Source Publication | Sensors |
ISSN | 1424-8220 |
Volume | 19Issue:20Pages:4536 |
Abstract | The Internet of Things (IoT) and sensors are becoming increasingly popular, especially in monitoring large and ambient environments. Applications that embrace IoT and sensors often require mining the data feeds that are collected at frequent intervals for intelligence. Despite the fact that such sensor data are massive, most of the data contents are identical and repetitive; for example, human traffic in a park at night. Most of the traditional classification algorithms were originally formulated decades ago, and they were not designed to handle such sensor data effectively. Hence, the performance of the learned model is often poor because of the small granularity in classification and the sporadic patterns in the data. To improve the quality of data mining from the IoT data, a new pre-processing methodology based on subspace similarity detection is proposed. Our method can be well integrated with traditional data mining algorithms and anomaly detection methods. The pre-processing method is flexible for handling similar kinds of sensor data that are sporadic in nature that exist in many ambient sensing applications. The proposed methodology is evaluated by extensive experiment with a collection of classical data mining models. An improvement over the precision rate is shown by using the proposed method. |
Keyword | Internet Of Things Sensor Data Preprocessing Subspace Similarity |
DOI | 10.3390/s19204536 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Chemistry ; Engineering ; Instruments & Instrumentation |
WOS Subject | Chemistry, Analytical ; Engineering, Electrical & Electronic ; Instruments & Instrumentation |
WOS ID | WOS:000497864700184 |
Publisher | MDPI, ST ALBAN-ANLAGE 66, CH-4052 BASEL, SWITZERLAND |
Scopus ID | 2-s2.0-85073657163 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Co-First Author | Yan Zhong; Simon Fong; Shimin Hu; Raymond Wong |
Corresponding Author | Simon Fong |
Affiliation | 1.Department of Big Data and Cloud Computing,Zhuhai Institutes of Advanced Technology of the Chinese Academy of Sciences,Zhuhai,519000,China 2.Department of Computer and Information Science,University of Macau,Taipa,999078,Macao 3.School of Computer Science & Engineering,University of New South Wales,Sydney,2052,Australia 4.School of Computer Science and Engineering,South China University of Technology,Guangzhou,510006,China |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Yan Zhong,Simon Fong,Shimin Hu,et al. A novel sensor data pre-processing methodology for the internet of things using anomaly detection and transfer-by-subspace-similarity transformation[J]. Sensors, 2019, 19(20), 4536. |
APA | Yan Zhong., Simon Fong., Shimin Hu., Raymond Wong., & Weiwei Lin (2019). A novel sensor data pre-processing methodology for the internet of things using anomaly detection and transfer-by-subspace-similarity transformation. Sensors, 19(20), 4536. |
MLA | Yan Zhong,et al."A novel sensor data pre-processing methodology for the internet of things using anomaly detection and transfer-by-subspace-similarity transformation".Sensors 19.20(2019):4536. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment