A Penalized Likelihood Method for Classification With Matrix-Valued Predictors

References

• Allen, G. I., and Tibshirani, R. J. (2010), “Transposable Regularized Covariance Models with an Application to Missing Data Imputation,” The Annals of Applied Statistics, 4, 764–790.
   PubMed Web of Science ®Google Scholar
• Baranzini, S. E., Mousavi, P., Rio, J., Caillier, S. J., Stillman, A., Villoslada, P., Wyatt, M. M., Comabella, M., Greller, L. D., Somogyi, R., Montalban, X., and Oksenberg, J. R. (2004), “Transcription-Based Prediction of Response to IFNβ using Supervised Computational Methods,” PLoS Biology, 3, e2.
   PubMed Web of Science ®Google Scholar
• Bickel, P. J., and Levina, E. (2004), “Some Theory for Fisher’s Linear Discriminant Function,‘Naive Bayes’, and Some Alternatives When There are Many More Variables than Observations,” Bernoulli, 10, 989–1010.
   Web of Science ®Google Scholar
• Boyd, S., Parikh, N., Chu, E., Peleato, B., and Eckstein, J. (2011), “Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers,” Foundations and Trends in Machine Learning, 3, 1–122.
   Google Scholar
• Buuren, S. van, and Groothuis-Oudshoorn, K. (2010), “Mice: Multivariate Imputation by Chained Equations in R,” Journal of Statistical Software, 45, 1–68.
   Web of Science ®Google Scholar
• Chi, E. C., and Lange, K. (2015), “Splitting Methods for Convex Clustering,” Journal of Computational and Graphical Statistics, 24, 994–1013.
   PubMed Web of Science ®Google Scholar
• Clemmensen, L., Hastie, T., Witten, D., and Ersbøll, B. (2011), “Sparse Discriminant Analysis,” Technometrics, 53, 406–413.
   Web of Science ®Google Scholar
• Dutilleul, P. (1999), “The MLE Algorithm for the Matrix Normal Distribution,” Journal of Statistical Computation and Simulation, 64, 105–123.
   Web of Science ®Google Scholar
• Friedman, J. H., Hastie, T. J., and Tibshirani, R. J. (2008), “Sparse Inverse Covariance Estimation with the Graphical Lasso,” Biostatistics, 9, 432–441.
   PubMed Web of Science ®Google Scholar
• Goldstein, T., O’Donoghue, B., Setzer, S., and Baraniuk, R. (2014), “Fast Alternating Direction Optimization Methods,” SIAM Journal on Imaging Sciences, 7, 1588–1623.
   Web of Science ®Google Scholar
• Guo, J. (2010), “Simultaneous Variable Selection and Class Fusion for High-Dimensional Linear Discriminant Analysis,” Biostatistics, 11, 599–608.
   PubMed Web of Science ®Google Scholar
• Gupta, A. K., and Nagar, D. K. (2000), Matrix Variate Distributions, Boca Raton, FL: Chapman and Hall/CRC Press.
   Google Scholar
• Helwig, N. E. (2015), “eegkit: Toolkit for Electroencephalography Data,” R Package Version 1.0-2.
   Google Scholar
• Hoff, P. D. (2011), “Separable Covariance Arrays via the Tucker Product, with Applications to Multivariate Relational Data,” Bayesian Analysis, 6, 179–196.
   Web of Science ®Google Scholar
• Hung, H., and Wang, C.-C. (2013), “Matrix Variate Logistic Regression Model with Application to EEG Data,” Biostatistics, 14, 189–202.
   PubMed Web of Science ®Google Scholar
• Hunter, D. R., and Li, R. (2005), “Variable Selection using MM Algorithms,” The Annals of Statistics, 33, 1617–1642.
   PubMed Web of Science ®Google Scholar
• Ingber, L. (1998), “Statistical Mechanics of Neocortical Interactions: Training and Testing Canonical Momenta Indicators of EEG,” Mathematical and Computer Modelling, 27, 33–64.
   Google Scholar
• Kim, T.-K., and Cipolla, R. (2009), “Canonical Correlation Analysis of Video Volume Tensors for Action Categorization and Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 1415–1428.
   PubMed Web of Science ®Google Scholar
• Lee, W., and Liu, Y. (2012), “Simultaneous Multiple Response Regression and Inverse Covariance Matrix Estimation via Penalized Gaussian Maximum Likelihood,” Journal of Multivariate Analysis, 111, 241–255.
   PubMed Web of Science ®Google Scholar
• Leng, C., and Tang, C. Y. (2012), “Sparse Matrix Graphical Models,” Journal of the American Statistical Association, 107, 1187–1200.
   Web of Science ®Google Scholar
• Li, B., Kim, M. K., and Altman, N. (2010), “On Dimension Folding of Matrix-or Array-Valued Statistical Objects,” The Annals of Statistics, 38, 1094–1121.
   Web of Science ®Google Scholar
• Li, L., and Zhang, X. (2017), “Parsimonious Tensor Response Regression,” Journal of the American Statistical Association, 112, 1131–1146.
   Web of Science ®Google Scholar
• Li, M., and Yuan, B. (2005), “2D-LDA: A Statistical Linear Discriminant Analysis for Image Matrix,” Pattern Recognition Letters, 26, 527–532.
   Web of Science ®Google Scholar
• Lyu, T., Lock, E. F., and Eberly, L. E. (2017), “Discriminating Sample Groups with Multi-Way Data,” Biostatistics, 18, 434–450.
   PubMed Web of Science ®Google Scholar
• Mai, Q., Yang, Y., and Zou, H. (2018), “Multiclass Sparse Discriminant Analysis,” Statistica Sinica. doi:10.5705/ss.202016.0117.
   Web of Science ®Google Scholar
• Manceur, A. M., and Dutilleul, P. (2013), “Maximum Likelihood Estimation for the Tensor Normal Distribution: Algorithm, Minimum Sample Size, and Empirical Bias and Dispersion,” Journal of Computational and Applied Mathematics, 239, 37–49.
   Web of Science ®Google Scholar
• Mitchell, M. W., Genton, M. G., and Gumpertz, M. L. (2006), “A Likelihood Ratio Test for Separability of Covariances,” Journal of Multivariate Analysis, 97, 1025–1043.
   Web of Science ®Google Scholar
• Pan, R., Wang, H., and Li, R. (2016), “Ultrahigh-Dimensional Multiclass Linear Discriminant Analysis by Pairwise Sure Independence Screening,” Journal of the American Statistical Association, 111, 169–179.
   PubMed Web of Science ®Google Scholar
• Parikh, N., and Boyd, S. (2014), “Proximal Algorithms,” Foundations and Trends in Optimization, 1, 127–239.
   Google Scholar
• Pau, G., Fuchs, F., Sklyar, O., Boutros, M., and Huber, W. (2010), “EBImage—An R package for Image Processing with Applications to Cellular Phenotypes,” Bioinformatics, 26, 979–981.
   PubMed Web of Science ®Google Scholar
• R Core Team (2017), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing.
   Google Scholar
• Roś, B., Bijma, F., de Munck, J. C., and de Gunst, M. C. (2016), “Existence and Uniqueness of the Maximum Likelihood Estimator for Models with a Kronecker Product Covariance Structure,” Journal of Multivariate Analysis, 143, 345–361.
   Web of Science ®Google Scholar
• Rothman, A. J., Levina, E., and Zhu, J. (2010), “Sparse Multivariate Regression with Covariance Estimation,” Journal of Computational and Graphical Statistics, 19, 947–962.
   PubMed Web of Science ®Google Scholar
• Tseng, P. (1991), “Applications of a Splitting Algorithm to Decomposition in Convex Programming and Variational Inequalities,” SIAM Journal on Control and Optimization, 29, 119–138.
   Web of Science ®Google Scholar
• Tsiligkaridis, T., Hero, A. O., and Zhou, S. (2012), “Kronecker Graphical Lasso,” in 2012 IEEE Statistical Signal Processing Workshop (SSP), IEEE, pp. 884–887.
   Google Scholar
• Venables, W. N., and Ripley, B. D. (2002), Modern Applied Statistics with S (4th ed.), New York: Springer.
   Google Scholar
• Witten, D. M., Friedman, J. H., and Simon, N. (2011), “New Insights and Faster Computations for the Graphical Lasso,” Journal of Computational and Graphical Statistics, 20, 892–900.
   Web of Science ®Google Scholar
• Witten, D. M., and Tibshirani, R. (2011), “Penalized Classification using Fisher’s Linear Discriminant,” Journal of the Royal Statistical Society, Series B, 73, 753–772.
   Google Scholar
• Xia, Y., and Li, L. (2017), “Hypothesis Testing of Matrix Graph Model with Application to Brain Connectivity Analysis,” Biometrics, 73, 780–791.
   PubMed Web of Science ®Google Scholar
• Xu, P., Zhu, J., Zhu, L., and Li, Y. (2015), “Covariance-Enhanced Discriminant Analysis,” Biometrika, 102, 33–45.
   PubMed Web of Science ®Google Scholar
• Yin, J., and Li, H. (2011), “A Sparse Conditional Gaussian Graphical Model for Analysis of Genetical Genomics Data,” The Annals of Applied Statistics, 5, 2630–2650.
   PubMed Web of Science ®Google Scholar
• Zhang, Y., and Schneider, J. G. (2010), “Learning Multiple Tasks with a Sparse Matrix-Normal Penalty,” in Advances in Neural Information Processing Systems, pp. 2550–2558.
   Google Scholar
• Zhong, W., and Suslick, K. S. (2015), “Matrix Discriminant Analysis With Application to Colorimetric Sensor Array Data,” Technometrics, 57, 524–534.
   PubMed Web of Science ®Google Scholar
• Zhou, H., and Li, L. (2014), “Regularized Matrix Regression,” Journal of the Royal Statistical Society, Series B, 76, 463–483.
   Google Scholar
• Zhou, S. (2014), “Gemini: Graph Estimation with Matrix Variate Normal Instances,” The Annals of Statistics, 42, 532–562.
   Web of Science ®Google Scholar
• Zhu, Y. (2017), “An augmented ADMM Algorithm with Application to the Generalized Lasso Problem,” Journal of Computational and Graphical Statistics, 26, 195–204.
   Web of Science ®Google Scholar