Graph-Guided Banding of the Covariance Matrix

References

• Backstrom, L., Boldi, P., Rosa, M., Ugander, J., and Vigna, S. (2011), “Four Degrees of Separation,” arXiv:1111.4570v1.
   Google Scholar
• Banerjee, O., El Ghaoui, L. E., and d’Aspremont, A. (2008), “Model Selection Through Sparse Maximum Likelihood Estimation for Multivariate Gaussian or Binary Data,” Journal of Machine Learning Research, 9, 485–516.
   Web of Science ®Google Scholar
• Bickel, P. J., and Levina, E. (2008a), “Regularized Estimation of Large Covariance Matrices,” Annals of Statistics, pp. 199–227.
   Web of Science ®Google Scholar
• ——— (2008b), “Covariance Regularization by Thresholding,” Annals of Statistics, 36, 2577–2604.
   Web of Science ®Google Scholar
• Bickel, P., and Lindner, M. (2012), “Approximating the Inverse of Banded Matrices by Banded Matrices with Applications to Probability and Statistics,” Theory of Probability & Its Applications, 56, 1–20.
   Web of Science ®Google Scholar
• Bien, J. (2016a), simulator: An Engine for Running Simulations, R package version 0.2.0, available at https://CRAN.R-project.org/package=simulator
   Google Scholar
• ——— (2016b), “The Simulator: An Engine to Streamline Simulations,” arXiv:1607.00021.
   Google Scholar
• Bien, J., Bunea, F., and Xiao, L. (2015a), “Convex Banding of the Covariance Matrix,” Journal of the American Statistical Association, 111, 834–845.
   Web of Science ®Google Scholar
• ——— (2015b), hierband: Convex Banding of the Covariance Matrix, R package version 1.0, available at https://CRAN.R-project.org/package=hierband
   Google Scholar
• Bien, J., and Tibshirani, R. (2011), “Sparse Estimation of a Covariance Matrix,” Biometrika, 98, 807–820.
   PubMed Web of Science ®Google Scholar
• Cai, T., Liu, W., and Luo, X. (2011), “A Constrained l1 Minimization Approach to Sparse Precision Matrix Estimation,” Journal of the American Statistical Association, 106, 594–607.
   Web of Science ®Google Scholar
• Cai, T. T., and Yuan, M. (2012), “Adaptive Covariance Matrix Estimation Through Block Thresholding,” The Annals of Statistics, 40, 2014–2042.
   Web of Science ®Google Scholar
• ——— (2015), “Minimax and Adaptive Estimation of CoVariance Operator for Random Variables Observed on a Lattice graph,” Journal of the American Statistical Association, 111, 253–265.
   Web of Science ®Google Scholar
• Cai, T. T., Zhang, C.-H., and Zhou, H. H. (2010), “Optimal Rates of Convergence for Covariance Matrix Estimation,” The Annals of Statistics, 38, 2118–2144.
   Web of Science ®Google Scholar
• Chandrasekaran, V., Parrilo, P. A., and Willsky, A. S. (2010), “Latent Variable Graphical Model Selection Via Convex Optimization,” in Communication, Control, and Computing (Allerton), 2010 48th Annual Allerton Conference, IEEE, pp. 1610–1613.
   Google Scholar
• Csardi, G., and Nepusz, T. (2006), “The Igraph Software Package for Complex Network Research,” InterJournal, Complex Systems, 1695, available at http://igraph.org
   Google Scholar
• Das, J., and Yu, H. (2012), “Hint: High-quality Protein Interactomes and Their Applications in Understanding Human Disease,” BMC Systems Biology, 6, 92.
   PubMed Web of Science ®Google Scholar
• Dempster, A. P. (1972), “Covariance Selection,” Biometrics, 28, 157–175.
   Web of Science ®Google Scholar
• Deng, X., and Yuan, M. (2009), “Large Gaussian Covariance Matrix Estimation with Markov Structures,” Journal of Computational and Graphical Statistics, 18, 640–657.
   Web of Science ®Google Scholar
• Donoho, D. L., Gavish, M., and Johnstone, I. M. (2013), “Optimal Shrinkage of Eigenvalues in the Spiked Covariance Model,” arXiv:1311.0851.
   Google Scholar
• Fan, J., Fan, Y., and Lv, J. (2008), “High Dimensional Covariance Matrix Estimation Using a Factor Model,” Journal of Econometrics, 147, 186–197.
   Web of Science ®Google Scholar
• Fan, J., Liao, Y., and Mincheva, M. (2013), “Large Covariance Estimation by Thresholding Principal Orthogonal Complements,” Journal of the Royal Statistical Society, Series B, 75, 603–680.
   Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2008), “Sparse Inverse Covariance Estimation with the Graphical Lasso,” Biostatistics, 9, 432–441.
   PubMed Web of Science ®Google Scholar
• Hastie, T., Tibshirani, R., and Friedman, J. (2009), The Elements of Statistical Learning; Data Mining, Inference and Prediction, Second Edition, New York: Springer Verlag.
   Google Scholar
• Huang, J., Liu, N., Pourahmadi, M., and Liu, L. (2006), “Covariance Matrix Selection and Estimation Via Penalised Normal Likelihood,” Biometrika, 93, 85.
   Web of Science ®Google Scholar
• Jacob, L., Obozinski, G., and Vert, J.-P. (2009), “Group Lasso with Overlap and Graph Lasso,” in Proceedings of the 26th Annual International Conference on Machine Learning, ACM, pp. 433–440.
   Google Scholar
• Johnstone, I. M. (2001), “On the Distribution of the Largest Eigenvalue in Principal Components Analysis,” Annals of Statistics, 29, 295–327.
   Web of Science ®Google Scholar
• Khare, K., Oh, S.-Y., and Rajaratnam, B. (2014), “A Convex Pseudolikelihood Framework for High Dimensional Partial Correlation Estimation with Convergence Guarantees,” Journal of the Royal Statistical Society, Series B, 77, 803–825.
   Google Scholar
• Lam, C., and Fan, J. (2009), “Sparsistency and Rates of Convergence in Large Covariance Matrix Estimation,” Annals of Statistics, 37, 4254–4278.
   PubMed Web of Science ®Google Scholar
• Le Cun, B. B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., and Jackel, L. D. (1990), “Handwritten Digit Recognition with a Back-propagation Network,” in Advances in Neural Information Processing Systems, Citeseer.
   Google Scholar
• Ledoit, O., and Wolf, M. (2004), “A Well-conditioned Estimator for Large-Dimensional Covariance Matrices,” Journal of Multivariate Analysis, 88, 365–411.
   Web of Science ®Google Scholar
• Levina, E., Rothman, A., and Zhu, J. (2008), “Sparse Estimation of Large Covariance Matrices Via a Nested Lasso Penalty,” The Annals of Applied Statistics, 245–263.
   Web of Science ®Google Scholar
• Liu, H., Wang, L., and Zhao, T. (2013), “Sparse Covariance Matrix Estimation with Eigenvalue Constraints,” Journal of Computational and Graphical Statistics, 23, 439–459.
   Web of Science ®Google Scholar
• Luo, X. (2011), “Recovering Model Structures from Large Low Rank and Sparse Covariance Matrix Estimation,” arXiv:1111.1133.
   Google Scholar
• Meinshausen, N., and Bühlmann, P. (2006), “High-Dimensional Graphs and Variable Selection with the Lasso,” Annals of Statistics, 34, 1436–1462.
   Web of Science ®Google Scholar
• Obozinski, G., Jacob, L., and Vert, J. (2011), “Group Lasso with Overlaps: The Latent Group Lasso Approach,” arXiv:1110.0413 .
   Google Scholar
• Peng, J., Wang, P., Zhou, N., and Zhu, J. (2009), “Partial Correlation Estimation by Joint Sparse Regression Models,” Journal of the American Statistical Association, 104, 735–746.
   PubMed Web of Science ®Google Scholar
• R Core Team (2017), R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, available at https://www.R-project.org/.
   Google Scholar
• Rothman, A. (2012), “Positive-Definite Estimators of Large Covariance Matrices,” Biometrika, 99, 733–740.
   Web of Science ®Google Scholar
• Rothman, A., Levina, E., and Zhu, J. (2008), “Sparse Permutation Invariant Covariance Estimation,” Electronic Journal of Statistics, 2, 494–515.
   Web of Science ®Google Scholar
• ——— (2009), “Generalized Thresholding of Large Covariance Matrices,” Journal of the American Statistical Association, 104, 177–186.
   Web of Science ®Google Scholar
• ——— (2010), “A New Approach to Cholesky-based Covariance Regularization in High Dimensions,” Biometrika, 97, 539.
   Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection Via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
   Google Scholar
• Travers, J., and Milgram, S. (1969), “An Experimental Study of the Small World Problem,” Sociometry, 32, 425–443.
   Google Scholar
• Wagaman, A., and Levina, E. (2009), “Discovering Sparse Covariance Structures with the Isomap,” Journal of Computational and Graphical Statistics, 18, 551–572.
   Web of Science ®Google Scholar
• Watts, D. J., and Strogatz, S. H. (1998), “Collective Dynamics of ‘Small-world’ Networks,” Nature, 393, 440–442.
   PubMed Web of Science ®Google Scholar
• Wickham, H. (2009), ggplot2: Elegant Graphics for Data Analysis, New York: Springer, available at http://had.co.nz/ggplot2/book
   Google Scholar
• Won, J.-H., Lim, J., Kim, S.-J., and Rajaratnam, B. (2013), “Condition-number-regularized Covariance Estimation,” Journal of the Royal Statistical Society, Series B, 75, 427–450.
   Google Scholar
• Wu, W. B., and Pourahmadi, M. (2003), “Nonparametric Estimation of Large Covariance Matrices of Longitudinal Data,” Biometrika, 90, 831–844.
   Web of Science ®Google Scholar
• ——— (2009), “Banding Sample Autocovariance Matrices of Stationary Processes,” Statistica Sinica, 19, 1755.
   Web of Science ®Google Scholar
• Xue, L., Ma, S., and Zou, H. (2012), “Positive-Definite l1-Penalized Estimation of Large Covariance Matrices,” Journal of the American Statistical Association, 107, 1480–1491.
   Web of Science ®Google Scholar
• Yan, X., and Bien, J. (2015), “Hierarchical Sparse Modeling: A Choice of Two Regularizers,” arXiv:1512.01631.
   Google Scholar
• Yu, G., and Bien, J. (2017), “Learning Local Dependence in Ordered Data,” Journal of Machine Learning Research, 18, 1–60.
   Web of Science ®Google Scholar
• Yuan, M. (2010), “High Dimensional Inverse Covariance Matrix Estimation Via Linear Programming,” The Journal of Machine Learning Research, 11, 2261–2286.
   Web of Science ®Google Scholar
• Yuan, M., and Lin, Y. (2006), “Model Selection and Estimation in Regression with Grouped Variables,” Journal of the Royal Statistical Society, Series B, 68, 49–67.
   Google Scholar
• ——— (2007), “Model Selection and Estimation in the Gaussian Graphical Model,” Biometrika, 94, 19–35.
   Web of Science ®Google Scholar
• Zhu, Z., and Liu, Y. (2009), “Estimating Spatial Covariance Using Penalised Likelihood with Weighted l1 Penalty,” Journal of Nonparametric Statistics, 21, 925–942.
   Web of Science ®Google Scholar