Residential Collegefalse
Status已發表Published
Incremental Methods for Detecting Outliers from Multivariate Data Stream
Simon Fong2; Zhicong Luo2; Bee Wah Yap3; Suash Deb1
2014
Conference NameIASTED International Conference on Artificial Intelligence and Applications, AIA 2014
Source PublicationProceedings of the IASTED International Conference on Artificial Intelligence and Applications, AIA 2014
Pages369-377
Conference DateFebruary 17 – 19, 2014
Conference PlaceInnsbruck, Austria
Abstract

Outlier detection is one of the most important data mining techniques. It has broad applications like fraud detection, credit approval, computer network intrusion detection, anti-money laundering, etc. The basis of outlier detection is to identify data points which are "different" or "far away" from the rest of the data points in the given dataset. Traditional outlier detection method is based on statistical analysis. However, this traditional method has an inherent drawback-it requires the availability of the entire dataset. In practice, especially in the real time data feed application, it is not so realistic to wait for all the data because fresh data are streaming in very quickly. Outlier detection is hence done in batches. However two drawbacks may arise: relatively long processing time because of the massive size, and the result may be outdated soon between successive updates. In this paper, we propose several novel incremental methods to process the real time data effectively for outlier detection. For the experiment, we test three types of mechanisms for analyzing the dataset, namely Global Analysis, Cumulative Analysis and Lightweight Analysis with Sliding Window. The experiment dataset is "household power consumption" which is a popular benchmarking data for Massive Online Analysis.

KeywordData Stream Mining Incremental Processing Outlier Detection
DOI10.2316/P.2014.816-006
URLView the original
Language英語English
Scopus ID2-s2.0-84898466527
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Affiliation1.Cambridge Institute of Technology
2.Universidade de Macau
3.Universiti Teknologi MARA
First Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Simon Fong,Zhicong Luo,Bee Wah Yap,et al. Incremental Methods for Detecting Outliers from Multivariate Data Stream[C], 2014, 369-377.
APA Simon Fong., Zhicong Luo., Bee Wah Yap., & Suash Deb (2014). Incremental Methods for Detecting Outliers from Multivariate Data Stream. Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, AIA 2014, 369-377.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Simon Fong]'s Articles
[Zhicong Luo]'s Articles
[Bee Wah Yap]'s Articles
Baidu academic
Similar articles in Baidu academic
[Simon Fong]'s Articles
[Zhicong Luo]'s Articles
[Bee Wah Yap]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Simon Fong]'s Articles
[Zhicong Luo]'s Articles
[Bee Wah Yap]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.