342
Views
10
CrossRef citations to date
0
Altmetric
Articles

Research on real-time outlier detection over big data streams

, &
Pages 93-101 | Received 10 Sep 2017, Accepted 18 Sep 2017, Published online: 31 Oct 2017

References

  • Gandomi A , Haider M . Beyond the hype: big data concepts, methods, and analytics. Int J Inf Manage. 2015;35(2):137–144.10.1016/j.ijinfomgt.2014.10.007
  • Silva A , Antunes C . Multi-relational pattern mining over data streams. Data Min Knowl Discov. 2015;29(6):1783–1814.10.1007/s10618-014-0394-6
  • Nori F , Deypir M , Sadreddini MH . A sliding window based algorithm for frequent closed itemset mining over data streams. J Syst Software. 2013;86(3):615–623.10.1016/j.jss.2012.10.011
  • Xhafa F , Naranjo V . Processing and analytics of big data streams with Yahoo! S4. IEEE 29th Int Conf Adv Inform Network Appl. 2015;263–270.
  • Ding S , Wu F , Qian J , et al . Research on data stream clustering algorithms. Artif Intell Rev. 2015;43(4):593–600.10.1007/s10462-013-9398-7
  • Namiot D . On big data stream processing. Int J Open Inform Technol. 2015;3(8):48–51.
  • Sun DW , Zhang GY , Zheng WM . Big data stream computing: technologies and instances. J Software. 2014;25(4):839–862.
  • Singh K , Upadhyaya S . Outlier detection: applications and techniques. IJCSI Int J Comp Sci Iss. 2012;9(3):307–323.
  • Yogitaa, DT . A framework for outlier detection in evolving data streams by weighting attributes in clustering. 2nd Int Conf Commun Comput Secur . 2012;214–222.
  • Sadik S , Gruenwald L . Research issues in outlier detection for data streams. ACM SIGKDD Explor Newslett arch. 2013;15(1):33–40.
  • Thakkar P , Vala J , Prajapati V . Survey on outlier detection in data stream. Int J Comput Appl. 2016;136(2):0975–8887.
  • Yeh M-Y , Dai B-R , Chen M-S . Clustering over multiple evolving streams by events and correlations. IEEE Trans Knowl Data Eng. 2007;1349–1362.10.1109/TKDE.2007.1071
  • Almusallam NY , Tari Z , Bertok P , et al . Dimensionality reduction for intrusion detection systems in multi-data streams-A review and proposal of unsupervised feature selection scheme. Emerg Comput. 2016;467–487.
  • Ren J , Wu Q , Zhang J , et al. Efficient outlier detection algorithm for heterogeneous data streams. Six Int Conf Fuzzy Syst Knowl Discov. 2009;259–264.10.1109/FSKD.2009.548
  • Koupaie HM , Ibrahim S , Hosseinkhani J . Outlier detection in stream data by clustering method. Int J Adv Comput Sci Inf Technol. 2013;25–34.
  • Tan SC, Ting KM , Liu TF . Fast anomaly detection for streaming data. Proc Twenty-Second Int Jt Conf Artif Intell. 2011;1511–1516.
  • Vijayarani S , Jothi P . An efficient clustering algorithm for outlier detection in data streams. Int J Adv Res Comp Commun Eng. 2013;2(9):3657–3665.
  • Niennattrakul V , Keogh E , Chotirat AR . Data editing techniques to allow the application of distance-based outlier detection to streams. IEEE 13th Int Conf Data Min . 2013;947–952.
  • Hido S , Tsuboi Y , Kashima H , et al . Statistical outlier detection using direct density ratio estimation. Knowl Inform Syst. 2011;26(2):309–336.10.1007/s10115-010-0283-2
  • Zhang Y , Hamm NAS , Meratnia N , et al . Statistics-based outlier detection for wireless sensor networks. Int J Geograph Inform Sci. 2012;26(8):1373–1392.10.1080/13658816.2012.654493
  • Pang LX , Chawla S , Wei L , et al . On detection of emerging anomalous traffic patterns using GPS data. Data Knowl Eng. 2013;87(9):357–373.10.1016/j.datak.2013.05.002
  • Smrithy GS , Munirathinam S , Balakrishnan R . Online anomaly detection using non-parametric technique for big data streams in cloud collaborative environment. IEEE Int Conf Big Data (Big Data). 2016;2016:1950–1955.10.1109/BigData.2016.7840816
  • Hossein MK , Ibrahim S , Hosseinkhani J . Outlier detection in stream data by clustering method. Int J Adv Comp Sci Inform Technol. 2013;2(3):25–34.
  • Zhou XY , Sun ZH , Zhang BL , et al . A fast outlier detection algorithm for high dimensional categorical data streams. J Software. 2007;18(4):933–942.10.1360/jos180933
  • Elahi M . Efficient clustering-based outlier detection algorithm for dynamic data stream. IEEE Fifth Int Conf Fuzzy Syst Knowl Discov. 2008;298–304.
  • Bhosale SV . Outlier detection in straming data using clustering approached. Int J Comp Sci Inform Technol. 2014;5(5):6050–6053.
  • Sreevidya SS . Detection of outliers in data stream using clustering method. Int J Sci Eng Technol Res. 2015;4(3):559–563.
  • Kumar D , Bezdek JC , Rajasegarar S , et al . Adaptive cluster tendency visualization and anomaly detection for streaming data. ACM Trans Knowl Discov Data. 2016;11(2):24–40.
  • Cassisi C , Ferro A , Giugno R , et al . Enhancing density-based clustering: Parameter reduction and outlier detection. Inform Syst. 2013;38(3):317–330.10.1016/j.is.2012.09.001
  • Shiblee Sadik M , Gruenwald L . DBOD-DS: distance based outlier detection for data streams. Database Expert Syst Appl. 2010;62(61):122–136.
  • Wu K , Zhang K , Fan W , et al . RS-Forest: a rapid density estimator for streaming anomaly detection. IEEE Int Conf Data Min. 2014;2014:600–609.
  • Schubert E , Zimek A , Kriegel HP . Fast and scalable outlier detection with approximate nearest neighbor ensembles. Database Syst Adv Appl. 2015;90(50):19–36.
  • Yuan Y , Cao H , Zhang Y , et al . Outlier mining based on neighbor-density-deviation with minimum hyper-sphere. Inform Technol Cont. 2016;45(3):267–277.
  • SK Paul , Bhaumik P . AIDCOR:artificial immunity inspired density based clustering with outlier removal. Int J Mach Learn Cybernet . 2016;1-26.
  • Chugh N , Chugh M , Agarwal A . Outlier detection in streaming data: a research perspective. 2014 Int Conf Parall Distrib Grid Comput. 2014;429–432.
  • Knorr EM , Ng, RT Algorithms for mining distance-based outliers in large datasets. 98 Proc 24 Int Conf Very Larg Data Bases . 1998;392–403.
  • Angiulli F , Fassetti F . Detecting distance-based outliers in streams of data. CIKM ‘07 Proc Sixteenth ACM Conf Inform Knowl Manage . 2007;811-820.10.1145/1321440
  • Ishida K , Kitagawa H . Detecting current outliers: continuous outlier detection over time-series data streams. Database Exper Syst Appl. 2008;255–268.
  • Niennattrakul V , Keogh E , Ratanamahatana CA . Data editing techniques to allow the application of distance-based outlier detection to streams. IEEE Int Conf Data Min. 2010;2010:947–952.
  • Cao L , Yang D , Wang Q , et al Rundensteiner.Scalable distance-based outlier detection over high-volume data streams. IEEE 30th Int Conf Data Eng . 2014;76-87.
  • Radovanović M , Nanopoulos A , Ivanović M . Reverse nearest neighbors in unsupervised distance-based outlier detection. IEEE Trans Knowl Data Eng. 2015;27(5):1369–1382.10.1109/TKDE.2014.2365790
  • Tran L , Fan L , Shahabi C . Distance-based outlier detection in data streams. Proc VLDB Endow. 2016;9(12):1089–1100.10.14778/2994509

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.