Residential College | false |
Status | 已發表Published |
Incremental Methods for Detecting Outliers from Multivariate Data Stream | |
Simon Fong2; Zhicong Luo2; Bee Wah Yap3; Suash Deb1 | |
2014 | |
Conference Name | IASTED International Conference on Artificial Intelligence and Applications, AIA 2014 |
Source Publication | Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, AIA 2014 |
Pages | 369-377 |
Conference Date | February 17 – 19, 2014 |
Conference Place | Innsbruck, Austria |
Abstract | Outlier detection is one of the most important data mining techniques. It has broad applications like fraud detection, credit approval, computer network intrusion detection, anti-money laundering, etc. The basis of outlier detection is to identify data points which are "different" or "far away" from the rest of the data points in the given dataset. Traditional outlier detection method is based on statistical analysis. However, this traditional method has an inherent drawback-it requires the availability of the entire dataset. In practice, especially in the real time data feed application, it is not so realistic to wait for all the data because fresh data are streaming in very quickly. Outlier detection is hence done in batches. However two drawbacks may arise: relatively long processing time because of the massive size, and the result may be outdated soon between successive updates. In this paper, we propose several novel incremental methods to process the real time data effectively for outlier detection. For the experiment, we test three types of mechanisms for analyzing the dataset, namely Global Analysis, Cumulative Analysis and Lightweight Analysis with Sliding Window. The experiment dataset is "household power consumption" which is a popular benchmarking data for Massive Online Analysis. |
Keyword | Data Stream Mining Incremental Processing Outlier Detection |
DOI | 10.2316/P.2014.816-006 |
URL | View the original |
Language | 英語English |
Scopus ID | 2-s2.0-84898466527 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Affiliation | 1.Cambridge Institute of Technology 2.Universidade de Macau 3.Universiti Teknologi MARA |
First Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Simon Fong,Zhicong Luo,Bee Wah Yap,et al. Incremental Methods for Detecting Outliers from Multivariate Data Stream[C], 2014, 369-377. |
APA | Simon Fong., Zhicong Luo., Bee Wah Yap., & Suash Deb (2014). Incremental Methods for Detecting Outliers from Multivariate Data Stream. Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, AIA 2014, 369-377. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment