Residential Collegefalse
Status已發表Published
A novel sensor data pre-processing methodology for the internet of things using anomaly detection and transfer-by-subspace-similarity transformation
Yan Zhong1; Simon Fong2; Shimin Hu2; Raymond Wong3; Weiwei Lin4
2019-10-18
Source PublicationSensors
ISSN1424-8220
Volume19Issue:20Pages:4536
Abstract

The Internet of Things (IoT) and sensors are becoming increasingly popular, especially in monitoring large and ambient environments. Applications that embrace IoT and sensors often require mining the data feeds that are collected at frequent intervals for intelligence. Despite the fact that such sensor data are massive, most of the data contents are identical and repetitive; for example, human traffic in a park at night. Most of the traditional classification algorithms were originally formulated decades ago, and they were not designed to handle such sensor data effectively. Hence, the performance of the learned model is often poor because of the small granularity in classification and the sporadic patterns in the data. To improve the quality of data mining from the IoT data, a new pre-processing methodology based on subspace similarity detection is proposed. Our method can be well integrated with traditional data mining algorithms and anomaly detection methods. The pre-processing method is flexible for handling similar kinds of sensor data that are sporadic in nature that exist in many ambient sensing applications. The proposed methodology is evaluated by extensive experiment with a collection of classical data mining models. An improvement over the precision rate is shown by using the proposed method.

KeywordInternet Of Things Sensor Data Preprocessing Subspace Similarity
DOI10.3390/s19204536
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaChemistry ; Engineering ; Instruments & Instrumentation
WOS SubjectChemistry, Analytical ; Engineering, Electrical & Electronic ; Instruments & Instrumentation
WOS IDWOS:000497864700184
PublisherMDPI, ST ALBAN-ANLAGE 66, CH-4052 BASEL, SWITZERLAND
Scopus ID2-s2.0-85073657163
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Co-First AuthorYan Zhong; Simon Fong; Shimin Hu; Raymond Wong
Corresponding AuthorSimon Fong
Affiliation1.Department of Big Data and Cloud Computing,Zhuhai Institutes of Advanced Technology of the Chinese Academy of Sciences,Zhuhai,519000,China
2.Department of Computer and Information Science,University of Macau,Taipa,999078,Macao
3.School of Computer Science & Engineering,University of New South Wales,Sydney,2052,Australia
4.School of Computer Science and Engineering,South China University of Technology,Guangzhou,510006,China
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Yan Zhong,Simon Fong,Shimin Hu,et al. A novel sensor data pre-processing methodology for the internet of things using anomaly detection and transfer-by-subspace-similarity transformation[J]. Sensors, 2019, 19(20), 4536.
APA Yan Zhong., Simon Fong., Shimin Hu., Raymond Wong., & Weiwei Lin (2019). A novel sensor data pre-processing methodology for the internet of things using anomaly detection and transfer-by-subspace-similarity transformation. Sensors, 19(20), 4536.
MLA Yan Zhong,et al."A novel sensor data pre-processing methodology for the internet of things using anomaly detection and transfer-by-subspace-similarity transformation".Sensors 19.20(2019):4536.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yan Zhong]'s Articles
[Simon Fong]'s Articles
[Shimin Hu]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yan Zhong]'s Articles
[Simon Fong]'s Articles
[Shimin Hu]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yan Zhong]'s Articles
[Simon Fong]'s Articles
[Shimin Hu]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.