Supervised subgraph augmented non-negative matrix factorization for interpretable manufacturing time series data analytics

References

• Baddeley, A. (2003) Working memory: Looking back and looking forward. Nature Reviews Neuroscience, 4(10), 829–839.
   PubMed Web of Science ®Google Scholar
• Bertsekas, D.P. (2015) Convex Optimization Algorithms, Athena Scientific, Belmont, MA.
   Google Scholar
• Borgelt, C. and Berthold, M.R. (2002) Mining molecular fragments: Finding relevant substructures of molecules, in Proceedings of the IEEE International Conference on Data Mining, IEEE Press, Piscataway, NJ, pp. 51–58.
   Google Scholar
• Boutsidis, C. and Gallopoulos, E. (2008) SVD based initialization: A head start for nonnegative matrix factorization. Pattern Recognition, 41(4), 1350–1362.
   Web of Science ®Google Scholar
• Boyd, S., Parikh, N., Chu, E., Peleato, B. and Eckstein, J. (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends^® in Machine Learning, 3(1), 1–122.
   Google Scholar
• Brecher, C., Müller, S., Faber, M. and Herfs, W. (2012) Design and implementation of a comprehensible cognitive assembly system, in Advances in Ergonomics in Manufacturing, CRC Press, Boca Raton, FL, pp. 272–281.
   Google Scholar
• Breiman, L. (1995) Better subset regression using the nonnegative garrote. Technometrics, 37(4), 373–384.
   Web of Science ®Google Scholar
• Daw, C.S., Finney, C.E.A. and Tracy, E.R. (2003) A review of symbolic analysis of experimental data. Review of Scientific Instruments, 74(2), 915–930.
   Web of Science ®Google Scholar
• Doshi-Velez, F. and Kim, B. (2017) Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608.
   Google Scholar
• Du, M., Liu, N. and Hu, X. (2018) Techniques for interpretable machine learning. arXiv preprint arXiv:1808.00033.
   Google Scholar
• Esmaeilian, B., Behdad, S. and Wang, B. (2016) The evolution and future of manufacturing: A review. Journal of Manufacturing Systems, 39, 79–100.
   Web of Science ®Google Scholar
• Fan, J. and Li, R. (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96(456), 1348–1360.
   Web of Science ®Google Scholar
• Fan, J. and Lv, J. (2010) A selective overview of variable selection in high dimensional feature space. Statistica Sinica, 20(1), 101–148.
   PubMed Web of Science ®Google Scholar
• Freitas, A.A. (2014) Comprehensible classification models: A position paper. ACM SIGKDD Explorations Newsletter, 15(1), 1–10.
   Google Scholar
• Garcia-Molina, H., Joglekar, M., Marcus, A., Parameswaran, A. and Verroios, V. (2016) Challenges in data crowdsourcing. IEEE Transactions on Knowledge and Data Engineering, 28(4), 901–911.
   Web of Science ®Google Scholar
• Gautama, T., Mandic, D.P. and van Hulle, M.M. (2003) A differential entropy based method for determining the optimal embedding parameters of a signal, in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, IEEE Press, Piscataway, NJ, pp. VI-29.
   Google Scholar
• Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F. and Pedreschi, D. (2018) A survey of methods for explaining black box models. ACM Computing Surveys (CSUR), 51(5), 93.
   Web of Science ®Google Scholar
• Gupta, M., Cotter, A., Pfeifer, J., Voevodski, K., Canini, K., Mangylov, A., Moczydlowski, W. and van Esbroeck, A. (2016) Monotonic calibrated interpolated look-up tables. The Journal of Machine Learning Research, 17(1), 3790–3836.
   Google Scholar
• Guyon, I. and Elisseeff, A. (2003) An introduction to variable and feature selection. Journal of Machine Learning Research, 3, 1157–1182.
   Google Scholar
• Hofer, H., Borgelt, C. and Berthold, M.R. (2004) Large scale mining of molecular fragments with wildcards. Intelligent Data Analysis, 8(5), 495–504.
   Google Scholar
• Jiang, C., Coenen, F., Sanderson, R. and Zito, M. (2010) Text classification using graph mining-based feature extraction. Knowledge-Based Systems, 23(4), 302–308.
   Web of Science ®Google Scholar
• Jiang, C., Coenen, F. and Zito, M. (2013) A survey of frequent subgraph mining algorithms. The Knowledge Engineering Review, 28(1), 75–105.
   Web of Science ®Google Scholar
• Jin, R. and Shi, J. (2012) Reconfigured piecewise linear regression tree for multistage manufacturing process control. IIE Transactions, 44(4), 249–261.
   Web of Science ®Google Scholar
• Klingberg, T. (2010) Training and plasticity of working memory. Trends in Cognitive Sciences, 14(7), 317–324.
   PubMed Web of Science ®Google Scholar
• Last, M., Klein, Y. and Kandel, A. (2001) Knowledge discovery in time series databases. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 31(1), 160–169.
   Web of Science ®Google Scholar
• Lee, H., Yoo, J. and Choi, S. (2010) Semi-supervised nonnegative matrix factorization. IEEE Signal Processing Letters, 17(1), 4–7.
   Web of Science ®Google Scholar
• Letham, B., Rudin, C., McCormick, T.H. and Madigan, D. (2015) Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction model. The Annals of Applied Statistics, 9(3), 1350–1371.
   Web of Science ®Google Scholar
• Lin, J., Keogh, E., Wei, L. and Lonardi, S. (2007) Experiencing SAX: A novel symbolic representation of time series. Data Mining and Knowledge Discovery, 15(2), 107–144.
   Web of Science ®Google Scholar
• Liu, C., Zhang, K., Xiong, H., Jiang, G. and Yang, Q. (2016) Temporal skeletonization on sequential data: Patterns, categorization, and visualization. IEEE Transactions on Knowledge and Data Engineering, 28(1), 211–223.
   Web of Science ®Google Scholar
• Liu, K. and Huang, S. (2016) Integration of data fusion methodology and degradation modeling process to improve prognostics. IEEE Transactions on Automation Science and Engineering, 13(1), 344–354.
   Web of Science ®Google Scholar
• Liu, X., Lin, Z. and Wang, H. (2008) Novel online methods for time series segmentation. IEEE Transactions on Knowledge and Data Engineering, 20(12), 1616–1626.
   Web of Science ®Google Scholar
• Luo, Y., Sohani, A., Hochberg, E. and Szolovits, P. (2014) Automatic lymphoma classification with sentence subgraph mining from pathology reports. Journal of the American Medical Informatics Association, 21(5), 824–832.
   Web of Science ®Google Scholar
• Luo, Y., Xin, Y., Hochberg, E., Joshi, R., Uzuner, O. and Szolovits, P. (2015) Subgraph augmented non-negative tensor factorization (SANTF) for modeling clinical narrative text. Journal of the American Medical Informatics Association, 22(5), 1009–1019.
   Web of Science ®Google Scholar
• Luo, Y., Xin, Y., Joshi, R., Celi, L. and Szolovits, P. (2016) Predicting ICU mortality risk by grouping temporal trends from a multivariate panel of physiologic measurements, in Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, AAAI Press, Phoenix, AZ, pp. 42–50.
   Google Scholar
• Mayer, M.P. and Schlick, C.M. (2012) Improving operator’s conformity with expectations in a cognitively automated assembly cell using human heuristics, in Advances in Ergonomics in Manufacturing, CRC Press, Boca Raton, FL, pp. 302–311.
   Google Scholar
• Miller, G.A. (1956) The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63(2), 81–97.
   PubMed Web of Science ®Google Scholar
• Montani, S., Leonardi, G., Bottrighi, A., Portinale, L. and Terenziani, P. (2013) Supporting flexible, efficient, and user-interpretable retrieval of similar time series. IEEE Transactions on Knowledge and Data Engineering, 25(3), 677–689.
   Web of Science ®Google Scholar
• Morris, J.S. (2015) Functional regression. Annual Review of Statistics and Its Application, 2(1), 321–359.
   Web of Science ®Google Scholar
• Mueen, A. (2013) Enumeration of time series motifs of all lengths, in Proceedings of IEEE International Conferance on Data Mining, IEEE Press, Piscataway, NJ, pp. 547–556.
   Google Scholar
• Paynabar, K., Jin, J. and Pacella, M. (2013) Monitoring and diagnosis of multichannel nonlinear profile variations using uncorrelated multilinear principal component analysis. IIE Transactions, 45(11), 1235–1247.
   Web of Science ®Google Scholar
• Paynabar, K., Jin, J. and Reed, M.P. (2015) Informative sensor and feature selection via hierarchical nonnegative garrote. Technometrics, 57(4), 514–523.
   Web of Science ®Google Scholar
• Ramsay, J.O. and Silverman, B.W. (2005) Functional Data Analysis, Springer, New York, NY.
   Google Scholar
• Shi, J. (2007) Stream of Variation Modeling and Analysis for Multistage Manufacturing Processes, CRC Press/Taylor & Francis, Boca Raton, FL.
   Google Scholar
• Sripada, S.G., Reiter, E., Hunter, J. and Yu, J. (2003) Generating English summaries of time series data using the Gricean maxims, in Proceedings of ACM International Conference on Knowledge Discovery and Data Mining, ACM, Washington, DC, pp. 187–196.
   Google Scholar
• Sun, D. and Fevotte, C. (2014) Alternating direction method of multipliers for non-negative matrix factorization with the beta-divergence, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, IEEE Press, Piscataway, NJ, pp. 6201–6205.
   Google Scholar
• Sun, H., Deng, X., Wang, K. and Jin, R. (2016) Logistic regression for crystal growth process modeling through hierarchical nonnegative garrote based variable selection. IIE Transactions, 48(8), 787–796.
   Web of Science ®Google Scholar
• Sun, H., Jin, R. and Zimmerman, B. (2015) Process modeling and mapping for a plasma spray coating process, in Proceedings of IIE Annual Conference, IISE, Nashville, TN, pp. 1797–1804.
   Google Scholar
• Tibshirani, R. (1996) Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), 58(1), 267–288.
   Web of Science ®Google Scholar
• UCI Machine Learning Repository (1999) Synthetic control chart time series data set, available at http://archive.ics.uci.edu/ml/datasets/Synthetic+Control+Chart+Time+Series.
   Google Scholar
• UCI Machine Learning Repository (2016) Gas sensors for home activity monitoring data set, available at http://archive.ics.uci.edu/ml/datasets/Gas+sensors+for+home+activity+monitoring.
   Google Scholar
• Ustun, B. and Rudin, C. (2016) Supersparse linear integer models for optimized medical scoring systems. Machine Learning, 102(3), 349–391.
   Web of Science ®Google Scholar
• Vandewiele, G., Janssens, O., Ongenae, F., De Turck, F. and van Hoecke, S. (2016) GENESIM: Genetic extraction of a single, interpretable model. arXiv preprint arXiv:1611.05722.
   Google Scholar
• VanRullen, R. and Koch, C. (2003) Is perception discrete or continuous? Trends in Cognitive Sciences, 7(5), 207–213.
   PubMed Web of Science ®Google Scholar
• Wang, Y.X. and Zhang, Y.J. (2013) Nonnegative matrix factorization: A comprehensive review. IEEE Transactions on Knowledge and Data Engineering, 25(6), 1336–1353.
   Web of Science ®Google Scholar
• Xue, Y., Klabjan, D. and Luo, Y. (2019) Predicting ICU readmission using grouped physiological and medication trends. Artificial Intelligence in Medicine, 95, 27–37.
   Google Scholar
• Yuan, M. and Lin, Y. (2006) Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 68(1), 49–67.
   Web of Science ®Google Scholar
• Zhou, N. and Zhu, J. (2010) Group variable selection via a hierarchical lasso and its oracle property. Statistics and Its Interface, 3(4), 557–574.
   Web of Science ®Google Scholar