Online Structural Change-Point Detection of High-dimensional Streaming Data via Dynamic Sparse Subspace Learning

References

• Aminikhanghahi, S., and Cook, D. J. (2017), “A Survey of Methods for Time Series Change Point Detection,” Knowledge and Information Systems, 51, 339–367. DOI: 10.1007/s10115-016-0987-z.
   PubMed Web of Science ®Google Scholar
• Beck, A., and Teboulle, M. (2009), “A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems,” SIAM Journal on Imaging Sciences, 2, 183–202. DOI: 10.1137/080716542.
   Web of Science ®Google Scholar
• Bellman, R. (1966), “Dynamic Programming,” Science, 153, 34–37. DOI: 10.1126/science.153.3731.34.
   PubMed Web of Science ®Google Scholar
• Dempster, A. P. (1972), “Covariance Selection,” Biometrics, 28, 157–175. DOI: 10.2307/2528966.
   Web of Science ®Google Scholar
• Dhulekar, N., Nambirajan, S., Oztan, B., and Yener, B. (2015), “Seizure Prediction by Graph Mining, Transfer Learning, and Transformation Learning,” in International Workshop on Machine Learning and Data Mining in Pattern Recognition (pp. 32–52), Springer.
   Google Scholar
• Drton, M., and Perlman, M. D. (2008), “A Sinful Approach to Gaussian Graphical Model Selection,” Journal of Statistical Planning and Inference, 138, 1179–1200. DOI: 10.1016/j.jspi.2007.05.035.
   Web of Science ®Google Scholar
• Elhamifar, E., and Vidal, R. (2013), “Sparse Subspace Clustering: Algorithm, Theory, and Applications,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 2765–2781. DOI: 10.1109/TPAMI.2013.57.
   PubMed Web of Science ®Google Scholar
• Fothergill, S., Mentis, H., Kohli, P., and Nowozin, S. (2012), “Instructing People for Training Gestural Interactive Systems,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1737–1746).
   Google Scholar
• Foygel, R., and Drton, M. (2010), “Extended Bayesian Information Criteria for Gaussian Graphical Models,” arXiv preprint arXiv:1011.6640.
   Google Scholar
• Gibberd, A. J., and Nelson, J. D. (2017), “Regularized Estimation of Piecewise Constant Gaussian Graphical Models: The Group-Fused Graphical Lasso,” Journal of Computational and Graphical Statistics, 26, 623–634. DOI: 10.1080/10618600.2017.1302340.
   Web of Science ®Google Scholar
• Gómez, A. M. E., Paynabar, K., and Pacella, M. (2020), “Functional Directed Graphical Models and Applications in Root-Cause Analysis and Diagnosis,” Journal of Quality Technology, 53, 421–437. DOI: 10.1080/00224065.2020.1805380.
   Web of Science ®Google Scholar
• Guo, Y., Gao, J., and Li, F. (2013), “Spatial Subspace Clustering for Hyperspectral Data Segmentation,” in Conference of The Society of Digital Information and Wireless Communications (SDIWC) (Vol. 1), p. 3.
   Google Scholar
• Haslbeck, J., and Waldorp, L. J. (2015), “mgm: Estimating Time-Varying Mixed Graphical Models in High-Dimensional Data,” arXiv preprint arXiv:1510.06871.
   Google Scholar
• Jackson, B., Scargle, J. D., Barnes, D., Arabhi, S., Alt, A., Gioumousis, P., Gwin, E., Sangtrakulcharoen, P., Tan, L., and Tsai, T. T. (2005), “An Algorithm for Optimal Partitioning of Data on an Interval,” IEEE Signal Processing Letters, 12, 105–108. DOI: 10.1109/LSP.2001.838216.
   Web of Science ®Google Scholar
• Jiao, Y., Chen, Y., and Gu, Y. (2018), “Subspace Change-Point Detection: A New Model and Solution,” IEEE Journal of Selected Topics in Signal Processing, 12, 1224–1239. DOI: 10.1109/JSTSP.2018.2873147.
   Web of Science ®Google Scholar
• Killick, R., Fearnhead, P., and Eckley, I. A. (2012), “Optimal Detection of Changepoints with a Linear Computational Cost,” Journal of the American Statistical Association, 107, 1590–1598. DOI: 10.1080/01621459.2012.737745.
   Web of Science ®Google Scholar
• Kirkland, L.-A., Kanfer, F., and Millard, S. (2015), “Lasso Tuning Parameter Selection,” in Annual Proceedings of the South African Statistical Association Conference (vol. 2015, pp. 49–56), South African Statistical Association (SASA).
   Google Scholar
• Kitov, I., Turuntaev, S., Konovalov, A., Stepnov, A., and Pupatenko, V. (2019), “Use of Waveform Cross Correlation to Reconstruct the Aftershock Sequence of the August 14, 2016, Sakhalin Earthquake,” Seismic Instruments, 55, 544–558. DOI: 10.3103/S0747923919050074.
   Web of Science ®Google Scholar
• Kolar, M., and Xing, E. (2011), “On Time Varying Undirected Graphs,” in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (pp. 407–415). JMLR Workshop and Conference Proceedings.
   Google Scholar
• Kolar, M., and Xing, E. P. (2012), “Estimating Networks with Jumps,” Electronic Journal of Statistics, 6, 2069–2106. DOI: 10.1214/12-EJS739.
   PubMed Web of Science ®Google Scholar
• Lewandowski, D., Kurowicka, D., and Joe, H. (2009), “Generating Random Correlation Matrices based on Vines and Extended Onion Method,” Journal of Multivariate Analysis, 100, 1989–2001. DOI: 10.1016/j.jmva.2009.04.008.
   Web of Science ®Google Scholar
• Li, B., and Solea, E. (2018), “A Nonparametric Graphical Model for Functional Data with Application to Brain Networks based on fMRI,” Journal of the American Statistical Association, 113, 1637–1655. DOI: 10.1080/01621459.2017.1356726.
   Web of Science ®Google Scholar
• Li, C.-G., and Vidal, R. (2015), “Structured Sparse Subspace Clustering: A Unified Optimization Framework,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 277–286).
   Google Scholar
• Li, C.-G., You, C., and Vidal, R. (2017), “Structured Sparse Subspace Clustering: A Joint Affinity Learning and Subspace Clustering Framework,” IEEE Transactions on Image Processing, 26, 2988–3001. DOI: 10.1109/TIP.2017.2691557.
   PubMed Web of Science ®Google Scholar
• Meinshausen, N., and Bühlmann, P. (2006), “High-Dimensional Graphs and Variable Selection with the Lasso,” The Annals of Statistics, 34, 1436–1462. DOI: 10.1214/009053606000000281.
   Web of Science ®Google Scholar
• Nowinski, J. L. (1981), “Applications of Functional Analysis in Engineering,” International Journal of Engineering Science, 19, 1377–1390. DOI: 10.1016/0020-7225(81)90035-5.
   Web of Science ®Google Scholar
• Parsons, L., Haque, E., and Liu, H. (2004), “Subspace Clustering for High Dimensional Data: A Review,” ACM Sigkdd Explorations Newsletter, 6, 90–105. DOI: 10.1145/1007730.1007731.
   Google Scholar
• Peel, L., and Clauset, A. (2015), “Detecting Change Points in the Large-Scale Structure of Evolving Networks,” in Twenty-Ninth AAAI Conference on Artificial Intelligence.
   Google Scholar
• Qiao, X., Guo, S., and James, G. M. (2019), “Functional Graphical Models,” Journal of the American Statistical Association, 114, 211–222. DOI: 10.1080/01621459.2017.1390466.
   Web of Science ®Google Scholar
• Qiao, X., Qian, C., James, G. M., and Guo, S. (2020), “Doubly Functional Graphical Models in High Dimensions,” Biometrika, 107, 415–431. DOI: 10.1093/biomet/asz072.
   Web of Science ®Google Scholar
• Qiu, H., Han, F., Liu, H., and Caffo, B. (2016), “Joint Estimation of Multiple Graphical Models from High Dimensional Time Series,” Journal of the Royal Statistical Society, Series B, 78, 487–504. DOI: 10.1111/rssb.12123.
   Google Scholar
• Ren, Z., Sun, T., Zhang, C.-H., and Zhou, H. H. (2015), “Asymptotic Normality and Optimalities in Estimation of Large Gaussian Graphical Models,” The Annals of Statistics, 43, 991–1026. DOI: 10.1214/14-AOS1286.
   Web of Science ®Google Scholar
• Rothman, A. J., Bickel, P. J., Levina, E., and Zhu, J. (2008), “Sparse Permutation Invariant Covariance Estimation,” Electronic Journal of Statistics, 2, 494–515. DOI: 10.1214/08-EJS176.
   Web of Science ®Google Scholar
• Scott, A. J., and Knott, M. (1974), “A Cluster Analysis Method for Grouping Means in the Analysis of Variance,” Biometrics, 30, 507–512. DOI: 10.2307/2529204.
   Web of Science ®Google Scholar
• Shi, M., Zhang, L., Sun, W., and Song, X. (2019), “A Fuzzy c-Means Algorithm Guided by Attribute Correlations and its Application in the Big Data Analysis of Tunnel Boring Machine,” Knowledge-Based Systems, 182, 104859. DOI: 10.1016/j.knosys.2019.07.030.
   Web of Science ®Google Scholar
• Thatcher, R. W., North, D., and Biver, C. (2005), Eeg and Intelligence: Relations between EEG Coherence, EEG Phase Delay and Power,” Clinical Neurophysiology, 116, 2129–2141. DOI: 10.1016/j.clinph.2005.04.026.
   PubMed Web of Science ®Google Scholar
• Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., and Knight, K. (2005), “Sparsity and Smoothness via the Fused Lasso,” Journal of the Royal Statistical Society, Series B, 67, 91–108. DOI: 10.1111/j.1467-9868.2005.00490.x.
   Google Scholar
• Tierney, S., Gao, J., and Guo, Y. (2014), “Subspace Clustering for Sequential Data,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 1019–1026).
   Google Scholar
• Wang, Y.-X., and Xu, H. (2013), “Noisy Sparse Subspace Clustering,” in International Conference on Machine Learning, pp. 89–97. PMLR.
   Google Scholar
• Wu, J., Chen, Y., and Zhou, S. (2016), “Online Detection of Steady-State Operation Using a Multiple-Change-Point Model and Exact Bayesian Inference,” IIE Transactions, 48, 599–613. DOI: 10.1080/0740817X.2015.1110268.
   Web of Science ®Google Scholar
• Wu, J., Xu, H., Zhang, C., and Yuan, Y. (2019), “A Sequential Bayesian Partitioning Approach for Online Steady-State Detection of Multivariate Systems,” IEEE Transactions on Automation Science and Engineering, 16, 1882–1895. DOI: 10.1109/TASE.2019.2900482.
   Web of Science ®Google Scholar
• Yuan, M., and Lin, Y. (2006), “Model Selection and Estimation in Regression with Grouped Variables,” Journal of the Royal Statistical Society, Series B, 68, 49–67. DOI: 10.1111/j.1467-9868.2005.00532.x.
   Google Scholar
• Zhang, C., Yan, H., Lee, S., and Shi, J. (2020), “Dynamic Multivariate Functional Data Modeling Via Sparse Subspace Learning,” Technometrics, 63, 370–383. DOI: 10.1080/00401706.2020.1800516.
   Web of Science ®Google Scholar
• Zhang, J., Li, C.-G., Zhang, H., and Guo, J. (2016), “Low-Rank and Structured Sparse Subspace Clustering,” in 2016 Visual Communications and Image Processing (VCIP) (pp. 1–4), IEEE. DOI: 10.1109/VCIP.2016.7805514.
   Google Scholar
• Zhou, S., Lafferty, J., and Wasserman, L. (2010), “Time Varying Undirected Graphs,” Machine Learning, 80, 295–319. DOI: 10.1007/s10994-010-5180-0.
   Web of Science ®Google Scholar
• Zhu, H., Strawn, N., and Dunson, D. B. (2016), “Bayesian Graphical Models for Multivariate Functional Data,” Journal of Machine Learning Research 17, 1–27
   Web of Science ®Google Scholar