Guaranteed Functional Tensor Singular Value Decomposition

References

• Adamczak, R. (2008), “A Tail Inequality for Suprema of Unbounded Empirical Processes with Applications to Markov Chains,” Electronic Journal of Probability, 13, 1000–1034. DOI: 10.1214/EJP.v13-521.
   Web of Science ®Google Scholar
• Adler, R. J., and Taylor, J. E. (2009), Random Fields and Geometry, New York: Springer.
   Google Scholar
• Allen, G. I. (2013), “Multi-Way Functional Principal Components Analysis,” in 2013 5th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), pp. 220–223. IEEE.
   Google Scholar
• Anandkumar, A., Ge, R., Hsu, D., Kakade, S. M., and Telgarsky, M. (2014), “Tensor Decompositions for Learning Latent Variable Models,” The Journal of Machine Learning Research, 15, 2773–2832.
   Web of Science ®Google Scholar
• Anandkumar, A., Ge, R., and Janzamin, M. (2014), “Guaranteed Non-orthogonal Tensor Decomposition via Alternating Rank-1 Updates,” arXiv preprint arXiv:1402.5180.
   Google Scholar
• Bartlett, P. L., Bousquet, O., and Mendelson, S. (2005), “Local Rademacher Complexities,” The Annals of Statistics, 33, 1497–1537. DOI: 10.1214/009053605000000282.
   Web of Science ®Google Scholar
• Bartlett, P. L., and Mendelson, S. (2002), “Rademacher and Gaussian Complexities: Risk Bounds and Structural Results,” Journal of Machine Learning Research, 3, 463–482.
   Google Scholar
• Bokulich, N. A., Chung, J., Battaglia, T., Henderson, N., Jay, M., Li, H., Lieber, A. D., Wu, F., Perez-Perez, G. I., and Chen, Y. (2016), “Antibiotics, Birth Mode, and Diet Shape Microbiome Maturation during Early Life,” Science translational medicine, 8, 343ra82. DOI: 10.1126/scitranslmed.aad7121.
   PubMed Web of Science ®Google Scholar
• Cai, C., Li, G., Poor, H. V., and Chen, Y. (2019), “Nonconvex Low-Rank Symmetric Tensor Completion from Noisy Data,” arXiv preprint arXiv:1911.04436.
   Google Scholar
• Cai, T. T., Han, R., and Zhang, A. R. (2020), “On the Non-asymptotic Concentration of Heteroskedastic Wishart-Type Matrix,” arXiv preprint arXiv:2008.12434.
   Google Scholar
• Cai, T. T., and Yuan, M. (2012), “Minimax and Adaptive Prediction for Functional Linear Regression,” Journal of the American Statistical Association, 107, 1201–1216. DOI: 10.1080/01621459.2012.716337.
   Web of Science ®Google Scholar
• Chen, E. Y., Xia, D., Cai, C., and Fan, J. (2020), “Semiparametric Tensor Factor Analysis by Iteratively Projected svd,” arXiv preprint arXiv:2007.02404.
   Google Scholar
• Chen, K., Delicado Useros, P. F., and Müller, H.-G. (2017), “Modelling Function-Valued Stochastic Processes, with Applications to Fertility Dynamics,” Journal of the Royal Statistical Society, Series B, 79, 177–196. DOI: 10.1111/rssb.12160.
   Google Scholar
• Chen, R., Yang, D., and Zhang, C.-H. (2021), “Factor Models for High-Dimensional Tensor Time Series,” Journal of the American Statistical Association, 117, 94–116. DOI: 10.1080/01621459.2021.1912757.
   Web of Science ®Google Scholar
• De Lathauwer, L., De Moor, B., and Vandewalle, J. (2000), “On the Best Rank-1 and Rank-(r 1, r 2,…, rn) Approximation of Higher-Order Tensors,” SIAM Journal on Matrix Analysis and Applications, 21, 1324–1342. DOI: 10.1137/S0895479898346995.
   Web of Science ®Google Scholar
• Fan, Y., James, G. M., and Radchenko, P. (2015), “Functional Additive Regression,” The Annals of Statistics, 43, 2296–2325. DOI: 10.1214/15-AOS1346.
   Web of Science ®Google Scholar
• Gu, C. (2013), Smoothing spline ANOVA models (Vol. 297), New York: Springer.
   Google Scholar
• Han, Q., Wang, T., Chatterjee, S., and Samworth, R. J. (2019), “Isotonic Regression in General Dimensions,” Annals of Statistics, 47, 2440–2471.
   Web of Science ®Google Scholar
• Han, R., Luo, Y., Wang, M., and Zhang, A. R. (2020a), “Exact Clustering in Tensor Block Model: Statistical Optimality and Computational Limit,” arXiv preprint arXiv:2012.09996.
   Google Scholar
• Han, R., Willett, R., and Zhang, A. R. (2021), “An Optimal Statistical and Computational Framework for Generalized Tensor Estimation,” The Annals of Statistics, to appear. DOI: 10.1214/21-AOS2061.
   Google Scholar
• Han, Y., Chen, R., Yang, D., and Zhang, C.-H. (2020b), “Tensor Factor Model Estimation by Iterative Projection,” arXiv preprint arXiv:2006.02611.
   Google Scholar
• Happ, C., and Greven, S. (2018), “Multivariate Functional Principal Component Analysis for Data Observed on Different (Dimensional) Domains,” Journal of the American Statistical Association, 113, 649–659. DOI: 10.1080/01621459.2016.1273115.
   Web of Science ®Google Scholar
• Happ-Kurz, C. (2020), “Object-Oriented Software for Functional Data,” Journal of Statistical Software, 93, 1–38. DOI: 10.18637/jss.v093.i05.
   Web of Science ®Google Scholar
• Hasenstab, K., Scheffler, A., Telesca, D., Sugar, C. A., Jeste, S., DiStefano, C., and Şentürk, D. (2017), “A Multi-Dimensional Functional Principal Components Analysis of eeg Data,” Biometrics, 73, 999–1009. DOI: 10.1111/biom.12635.
   PubMed Web of Science ®Google Scholar
• Hong, D., Kolda, T. G., and Duersch, J. A. (2020), “Generalized Canonical Polyadic Tensor Decomposition,” SIAM Review, 62, 133–163. DOI: 10.1137/18M1203626.
   Web of Science ®Google Scholar
• Hu, X., and Yao, F. (2021), “Dynamic Principal Subspaces with Sparsity in High Dimensions,” arXiv preprint arXiv:2104.03087.
   Google Scholar
• James, G. M., Hastie, T. J., and Sugar, C. A. (2000), “Principal Component Models for Sparse Functional Data,” Biometrika, 87, 587–602. DOI: 10.1093/biomet/87.3.587.
   Web of Science ®Google Scholar
• Kimeldorf, G., and Wahba, G. (1971), “Some Results on Tchebycheffian Spline Functions,” Journal of Mathematical Analysis and Applications, 33, 82–95. DOI: 10.1016/0022-247X(71)90184-3.
   Web of Science ®Google Scholar
• Koltchinskii, V., and Yuan, M. (2010), “Sparsity in Multiple Kernel Learning,” The Annals of Statistics, 38, 3660–3695. DOI: 10.1214/10-AOS825.
   Web of Science ®Google Scholar
• Kruskal, J. B. (1976), “More Factors than Subjects, Tests and Treatments: An Indeterminacy Theorem for Canonical Decomposition and Individual Differences Scaling,” Psychometrika, 41, 281–293. DOI: 10.1007/BF02293554.
   Web of Science ®Google Scholar
• Martino, C., Shenhav, L., Marotz, C. A., Armstrong, G., McDonald, D., Vázquez-Baeza, Y., Morton, J. T., Jiang, L., Dominguez-Bello, M. G., and Swafford, A. D. (2021), “Context-Aware Dimensionality Reduction Deconvolutes Gut Microbial Community Dynamics,” Nature Biotechnology, 39, 165–168. DOI: 10.1038/s41587-020-0660-7.
   PubMed Web of Science ®Google Scholar
• Mendelson, S. (2002), “Geometric Parameters of Kernel Machines,” in International Conference on Computational Learning Theory, pp. 29–43. Springer.
   Google Scholar
• Mercer, J. (1909), “Xvi. Functions of Positive and Negative Type, and their Connection the Theory of Integral Equations,” Philosophical transactions of the royal society of London, Series A, 209, 415–446.
   Google Scholar
• Micchelli, C. A., and Wahba, G. (1981), “Design Problems for Optimal Surface Interpolation,” in Approximation Theory and Applications, ed. Z. Ziegler, pp. 329–347, New York: Academic Press.
   Google Scholar
• Pisier, G. (1983), “Some Applications of the Metric Entropy Condition to Harmonic Analysis,” in Banach Spaces, Harmonic Analysis, and Probability Theory, eds. R. C. Blei and S. J. Sidney, pp. 123–154, Berlin: Springer.
   Google Scholar
• Ramsay, J., and Silverman, B. (2006), Functional Data Analysis, New York: Springer.
   Google Scholar
• Raskutti, G., Wainwright, M. J., and Yu, B. (2012), “Minimax-Optimal Rates for Sparse Additive Models over Kernel Classes via Convex Programming,” Journal of Machine Learning Research, 13, 389–427.
   Web of Science ®Google Scholar
• Rice, J. A., and Silverman, B. W. (1991), “Estimating the Mean and Covariance Structure Nonparametrically when the Data are Curves,” Journal of the Royal Statistical Society, Series B, 53, 233–243. DOI: 10.1111/j.2517-6161.1991.tb01821.x.
   Google Scholar
• Rudelson, M., and Vershynin, R. (2013), “Hanson-Wright Inequality and Sub-Gaussian Concentration,” Electronic Communications in Probability, 18, 1–9. DOI: 10.1214/ECP.v18-2865.
   Web of Science ®Google Scholar
• Stewart, C. J., Ajami, N. J., O’Brien, J. L., Hutchinson, D. S., Smith, D. P., Wong, M. C., Ross, M. C., Lloyd, R. E., Doddapaneni, H., Metcalf, G. A., Muzny, D., Gibbs, R. A., Vatanen, T., Huttenhower, C., Xavier, R. J., Rewers, M., Hagopian, W., Toppari, J., Ziegler, A. G., She, J.-X., Akolkar, B., Lernmark, A., Hyoty, H., Vehik, K., Krischer, J. P., and Petrosino, J. F. (2018), “Temporal Development of the Gut Microbiome in Early Childhood from the Teddy Study,” Nature, 562, 583–588. DOI: 10.1038/s41586-018-0617-x.
   PubMed Web of Science ®Google Scholar
• Sun, W. W., and Li, L. (2019), “Dynamic Tensor Clustering,” Journal of the American Statistical Association, 114, 1894–1907. DOI: 10.1080/01621459.2018.1527701.
   Web of Science ®Google Scholar
• Sun, W. W., Lu, J., Liu, H., and Cheng, G. (2017), “Provable Sparse Tensor Decomposition,” Journal of the Royal Statistical Society, Series B, 79, 899–916. DOI: 10.1111/rssb.12190.
   Google Scholar
• Tong, T., Ma, C., Prater-Bennette, A., Tripp, E., and Chi, Y. (2021), “Scaling and Scalability: Provable Nonconvex Low-Rank Tensor Estimation from Incomplete Measurements,” arXiv preprint arXiv:2104.14526.
   Google Scholar
• Vershynin, R. (2018), High-Dimensional Probability: An Introduction with Applications in Data Science (Vol. 47), Cambridge: Cambridge University Press.
   Google Scholar
• Wang, D., Zhao, Z., Willett, R., and Yau, C. Y. (2020a), “Functional Autoregressive Processes in Reproducing Kernel Hilbert Spaces,” arXiv preprint arXiv:2011.13993.
   Google Scholar
• Wang, D., Zhao, Z., Yu, Y., and Willett, R. (2020b), “Functional Linear Regression with Mixed Predictors,” arXiv preprint arXiv:2012.00460.
   Google Scholar
• Wang, J., Wong, R. K., and Zhang, X. (2020), “Low-Rank Covariance Function Estimation for Multidimensional Functional Data,” Journal of the American Statistical Association, 117, 809–822. DOI: 10.1080/01621459.2020.1820344.
   Web of Science ®Google Scholar
• Wang, J.-L., Chiou, J.-M., and Müller, H.-G. (2016), “Functional Data Analysis,” Annual Review of Statistics and Its Application, 3, 257–295. DOI: 10.1146/annurev-statistics-041715-033624.
   Web of Science ®Google Scholar
• Wedin, P.-Å. (1972), “Perturbation Bounds in Connection with Singular Value Decomposition,” BIT Numerical Mathematics, 12, 99–111. DOI: 10.1007/BF01932678.
   Google Scholar
• Yao, F., Müller, H.-G., and Wang, J.-L. (2005), “Functional Linear Regression Analysis for Longitudinal Data,” The Annals of Statistics, 33, 2873–2903. DOI: 10.1214/009053605000000660.
   Web of Science ®Google Scholar
• Yuan, M., and Cai, T. T. (2010), “A Reproducing Kernel Hilbert Space Approach to Functional Linear Regression,” The Annals of Statistics, 38, 3412–3444. DOI: 10.1214/09-AOS772.
   Web of Science ®Google Scholar
• Zhang, A., and Han, R. (2019), “Optimal Sparse Singular Value Decomposition for High-Dimensional High-Order Data,” Journal of the American Statistical Association, 114, 1708–1725. DOI: 10.1080/01621459.2018.1527227.
   PubMed Web of Science ®Google Scholar
• Zhang, A., and Xia, D. (2018), “Tensor SVD: Statistical and Computational Limits,” IEEE Transactions on Information Theory, 64, 7311–7338. DOI: 10.1109/TIT.2018.2841377.
   Web of Science ®Google Scholar
• Zhang, A. R., and Zhou, Y. (2020), “On the Non-asymptotic and Sharp Lower Tail Bounds of Random Variables,” Stat, 9, e314. DOI: 10.1002/sta4.314.
   Web of Science ®Google Scholar
• Zhang, C., Han, R., Zhang, A. R., and Voyles, P. M. (2020), “Denoising Atomic Resolution 4d Scanning Transmission Electron Microscopy Data with Tensor Singular Value Decomposition,” Ultramicroscopy, 219, 113123. DOI: 10.1016/j.ultramic.2020.113123.
   PubMed Web of Science ®Google Scholar
• Zhang, Z., Allen, G. I., Zhu, H., and Dunson, D. (2019), “Tensor Network Factorizations: Relationships between Brain Structural Connectomes and Traits,” Neuroimage, 197, 330–343. DOI: 10.1016/j.neuroimage.2019.04.027.
   PubMed Web of Science ®Google Scholar