958
Views
2
CrossRef citations to date
0
Altmetric
Data Science, Quality & Reliability

Contextual anomaly detection for high-dimensional data using Dirichlet process variational autoencoder

&
Pages 433-444 | Received 18 Jun 2021, Accepted 23 Dec 2021, Published online: 15 Feb 2022

References

  • Ahmed, I. , Galoppo, T. , Hu, X. and Ding, Y. (2021) Graph regularized autoencoder and its application in unsupervised anomaly detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, doi: 10.1109/TPAMI.2021.3066111.
  • Ambrogioni, L. , Güçlü, U. , van Gerven, M.A. and Maris, E. (2017) The kernel mixture network: A nonparametric method for conditional density estimation of continuous random variables. arXiv preprint arXiv:1705.07111.
  • Amin, M.R. , Garg, P. , and Coskun, B. (2019) Cadence: Conditional anomaly detection for events using noise-contrastive estimation, in Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security, pp. 71–82, Association for Computing Machinery, New York, NY.
  • An, J. and Cho, S. (2015) Variational autoencoder based anomaly detection using reconstruction probability. Special Lecture on IE, 2 (1), 1–18.
  • Bishop, C.M. (2006) Pattern Recognition and Machine Learning . Springer, New York, NY.
  • Blei, D.M. , and Jordan, M.I. (2006) Variational inference for Dirichlet process mixtures. Bayesian Analysis, 1 (1), 121–143.
  • Blei, D.M. , Kucukelbir, A. and McAuliffe, J.D. (2017) Variational inference: A review for statisticians. Journal of the American Statistical Association , 112 (518), 859–877.
  • Dua, D. and Graff, C. (2019) UCI machine learning repository . University of California, Irvine, School of Information and Computer Sciences. http://archive.ics.uci.edu/ml (accessed 21 October 2021).
  • Hill, D.J. and Minsker, B.S. (2010) Anomaly detection in streaming environmental sensor data: A data-driven modeling approach. Environmental Modelling & Software , 25 (9), 1014–1022.
  • Hong, C. and Hauskrecht, M. (2015) Mcode: Multivariate conditional outlier detection. arXiv preprint arXiv:1505.04097.
  • Hwang, J. and Kim, H. (2020) Variational deep clustering of wafer map patterns. IEEE Transactions on Semiconductor Manufacturing , 33 (3), 466–475.
  • Jabbar, E. , Besse, P. , Loubes, J.-M. and Merle, C. (2019) Conditional anomaly detection for quality and productivity improvement of electronics manufacturing systems, in International Conference on Machine Learning, Optimization, and Data Science, pp. 711–724, Siena, Italy, Springer,
  • Kim, H. , Huo, X. and Shi, J. (2014) A single interval based classifier. Annals of Operations Research , 216 (1), 307–325.
  • Kim, H. and Kim, H. (2018) Functional logistic regression with fused lasso penalty. Journal of Statistical Computation and Simulation , 88 (15), 2982–2999.
  • Kim, K. , Shin, J. and Kim, H. (2021) Locally most powerful Bayesian test for out-of-distribution detection using deep generative models. Advances in Neural Information Processing Systems , 34 .
  • Kim, K. , Zabihi, H. , Kim, H. and Lee, U. (2017) Trailsense: A crowdsensing system for detecting risky mountain trail segments with walking pattern analysis. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1 (3), 1–31.
  • Kingma, D.P. and Welling, M. (2014) Auto-encoding variational Bayes , in International Conference on Learning Representations, Banff, AB, Canada.
  • Ko, T. and Kim, H. (2019) Fault classification in high-dimensional complex processes using semi-supervised deep convolutional generative models. IEEE Transactions on Industrial Informatics , 16 (4), 2868–2877.
  • Li, L. , Yan, J. , Wang, H. and Jin, Y. (2020) Anomaly detection of time series with smoothness-inducing sequential variational auto-encoder. IEEE Transactions on Neural Networks and Learning Systems , 32 (3), 1177–1191.
  • Li, W. , Hu, W. , Chen, N. and Feng, C. (2021) Stacking VAE with graph neural networks for effective and interpretable time series anomaly detection. arXiv preprint arXiv:2105.08397.
  • Lin, S. , Clark, R. , Birke, R. , Schönborn, S. , Trigoni, N. and Roberts, S. (2020) Anomaly detection for time series using VAE-LSTM hybrid model, in ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE Press, Piscataway, NJ, pp. 4322–4326.
  • Liu, J. , Guo, J. , Orlik, P. , Shibata, M. , Nakahara, D. , Mii, S. and Takáč, M. (2018) Anomaly detection in manufacturing systems using structured neural networks, in 2018 13th World Congress on Intelligent Control and Automation (WCICA ), IEEE Press, Piscataway, NJ, pp. 175–180.
  • Lu, Y.-C. , Chen, F. , Wang, Y. and Lu, C.-T. (2016) Discovering anomalies on mixed-type data using a generalized student-t based approach. IEEE Transactions on Knowledge and Data Engineering , 28 (10), 2582–2595.
  • Malhotra, P. , Ramakrishnan, A. , Anand, G. , Vig, L. , Agarwal, P. and Shroff, G. (2016) LSTM-based encoder-decoder for multi-sensor anomaly detection, in Anomaly Detection Workshop at 33rd International Conference on Machine Learning , New York, USA.
  • Niu, Z. , Yu, K. and Wu, X. (2020) LSTM-based VAE-GAN for time-series anomaly detection. Sensors , 20 (13).
  • Ohkubo, M. and Nagata, Y. (2019) Conditional anomaly detection based on a latent class model. Total Quality Management & Business Excellence , 30 (sup1), S227–S239.
  • Shulman, Y. (2019) Unsupervised contextual anomaly detection using joint deep variational generative models. arXiv preprint arXiv:1904.00548.
  • Song, X. , Wu, M. , Jermaine, C. and Ranka, S. (2007) Conditional anomaly detection. IEEE Transactions on Knowledge and Data Engineering , 19 (5), 631–645.
  • Stripling, E. , Baesens, B. , Chizi, B. and vanden Broucke, S. (2018) Isolation-based conditional anomaly detection on mixed-attribute data to uncover workers’ compensation fraud. Decision Support Systems , 111 , 13–26.
  • Tan, Y. , Jin, B. , Nettekoven, A. , Chen, Y. , Yue, Y. , Topcu, U. and Sangiovanni-Vincentelli, A. (2019) An encoder-decoder based approach for anomaly detection with application in additive manufacturing, in 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA) , IEEE Press, Piscataway, NJ, pp. 1008–1015.
  • Von Schleinitz, J. , Graf, M. , Trutschnig, W. and Schröder, A. (2021) VASP: An autoencoder-based approach for multivariate anomaly detection and robust time series prediction with application in motorsport. Engineering Applications of Artificial Intelligence , 104 , 104354.
  • Xie, M. , Han, S. , Tian, B. and Parvin, S. (2011) Anomaly detection in wireless sensor networks: A survey. Journal of Network and Computer Applications , 34 (4), 1302–1325.
  • Xu, H. , Chen, W. , Zhao, N. , Li, Z. , Bu, J. , Li, Z. , Liu, Y. , Zhao, Y. , Pei, D. , Feng, Y. , Chen, J. , Wang, Z. and Qiao, H. (2018) Unsupervised anomaly detection via variational auto-encoder for seasonal KPIs in web applications, in Proceedings of the 2018 World Wide Web Conference , pp. 187–196, Lyon, France.
  • Zong, B. , Song, Q. , Min, M.R. , Cheng, W. , Lumezanu, C. , Cho, D. and Chen, H. (2018) Deep autoencoding Gaussian mixture model for unsupervised anomaly detection, in International Conference on Learning Representations, Vancouver, BC, Canada.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.