Positive-Definite ℓ₁-Penalized Estimation of Large Covariance Matrices

REFERENCES

• Anderson , T. 1984 . An Introduction to Multivariate Statistical Analysis , New York : Wiley .
   Google Scholar
• Beer , D. , Kardia , S. , Huang , C. , Giordano , T. , Levin , A. , Misek , D. , Lin , L. , Chen , G. , Gharib , T. , Thomas , D. , Lizyness , M. L. , Kuick , R. , Hayasaka , S. , Taylor , J. M. , Iannettoni , M. D. , Orringer , M. B. and Hanash , S. 2002 . “Gene-Expression Profiles Predict Survival of Patients With Lung Adenocarcinoma,” . Nature Medicine , 8 : 816 – 824 .
   PubMed Web of Science ®Google Scholar
• Bennett , G. 1962 . “Probability Inequalities for the Sum of Independent Random Variables,” . Journal of the American Statistical Association , 57 : 33 – 45 .
   Web of Science ®Google Scholar
• Bernstein , S. 1946 . The Theory of Probabilities , Moscow : Gostekhizdat .
   Google Scholar
• Bickel , P. and Levina , E. 2008a . “Regularized Estimation of Large Covariance Matrices,” . The Annals of Statistics , 36 : 199 – 227 .
   Web of Science ®Google Scholar
• ——— . 2008b . “Covariance Regularization by Thresholding,” . The Annals of Statistics , 36 : 2577 – 2604 .
   Web of Science ®Google Scholar
• Boyd , S. , Parikh , N. , Chu , E. , Peleato , B. and Eckstein , J. 2011 . “Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers,” . Foundations and Trends in Machine Learning , 3 : 1 – 122 .
   Google Scholar
• Brodie , J. , Daubechies , I. , De Mol , C. , Giannone , D. and Loris , I. 2009 . “Sparse and Stable Markowitz Portfolios,” . Proceedings of the National Academy of Sciences , 106 : 12267 – 12272 .
   PubMed Web of Science ®Google Scholar
• Cai , T. and Liu , W. 2011 . “Adaptive Thresholding for Sparse Covariance Matrix Estimation,” . Journal of the American Statistical Association , 106 : 672 – 684 .
   Web of Science ®Google Scholar
• Cai , T. , Zhang , C. and Zhou , H. 2010 . “Optimal Rates of Convergence for Covariance Matrix Estimation,” . The Annals of Statistics , 38 : 2118 – 2144 .
   Web of Science ®Google Scholar
• Cai , T. and Zhou , H. 2012a . “Minimax Estimation of Large Covariance Matrices Under ℓ1-Norm” (with discussion), . Statistica Sinica , 22 : 1319 – 1348 .
   Web of Science ®Google Scholar
• ——— . 2012b . “Optimal Rates of Convergence for Sparse Covariance Matrix Estimation,” . The Annals of Statistics , to appear
   Web of Science ®Google Scholar
• d’Aspremont , A. , Banerjee , O. and Ghaoui , L. 2008 . “First-Order Methods for Sparse Covariance Selection,” . SIAM Journal on Matrix Analysis and Applications , 30 : 56 – 66 .
   Web of Science ®Google Scholar
• DeMiguel , V. , Garlappi , L. , Nogales , F. and Uppal , R. 2009 . “A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms,” . Management Science , 55 : 798 – 812 .
   Web of Science ®Google Scholar
• Douglas , J. and Rachford , H. H. 1956 . “On the Numerical Solution of the Heat Conduction Problem in 2 and 3 Space Variables,” . Transactions of the American Mathematical Society , 82 : 421 – 439 .
   Google Scholar
• Efron , B. 2009 . “Are a Set of Microarrays Independent of Each Other?” . The Annals of Applied Statistics , 3 : 922 – 942 .
   PubMed Web of Science ®Google Scholar
• ——— . 2010 . Large-Scale Inference: Empirical Bayes Methods for Estimation, Testing, and Prediction , Cambridge : Cambridge University Press .
   Google Scholar
• El Karoui , N. 2008 . “Operator Norm Consistent Estimation of Large Dimensional Sparse Covariance Matrices,” . The Annals of Statistics , 36 : 2717 – 2756 .
   Web of Science ®Google Scholar
• ——— . 2010 . “High-Dimensionality Effects in the Markowitz Problem and Other Quadratic Programs With Linear Constraints: Risk Underestimation,” . The Annals of Statistics , 38 : 3487 – 3566 .
   Web of Science ®Google Scholar
• Fan , J. and Li , R. 2001 . “Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties,” . Journal of the American Statistical Association , 96 : 1348 – 1360 .
   Web of Science ®Google Scholar
• Fan , J. , Zhang , J. and Yu , K. 2012 . “Vast Portfolio Selection with Gross-Exposure Constraints,” . Journal of the American Statistical Association , 107 : 592 – 606 .
   PubMed Web of Science ®Google Scholar
• Fortin , M. and Glowinski , R. 1983 . Augmented Lagrangian Methods: Applications to the Numerical Solution of Boundary-Value Problems , Amsterdam : North-Holland .
   Google Scholar
• Friedman , J. , Hastie , T. and Tibshirani , R. 2008 . “Sparse Inverse Covariance Estimation With the Graphical Lasso,” . Biostatistics , 9 : 432
   PubMed Web of Science ®Google Scholar
• Furrer , R. and Bengtsson , T. 2007 . “Estimation of High-Dimensional Prior and Posterior Covariance Matrices in Kalman Filter Variants,” . Journal of Multivariate Analysis , 98 : 227 – 255 .
   Web of Science ®Google Scholar
• Glowinski , R. and Le Tallec , P. 1989 . Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics , Philadelphia , PA : SIAM .
   Google Scholar
• Jagannathan , R. and Ma , T. 2003 . “Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps,” . Journal of Finance , 58 : 1651 – 1684 .
   Web of Science ®Google Scholar
• Johnstone , I. 2001 . “On the Distribution of the Largest Eigenvalue in Principal Components Analysis,” . The Annals of Statistics , 29 : 295 – 327 .
   Web of Science ®Google Scholar
• Khan , J. , Wei , J. , Ringnér , M. , Saal , L. , Ladanyi , M. , Westermann , F. , Berthold , F. , Schwab , M. , Antonescu , C. , Peterson , C. and Meltzer , P. S. 2001 . “Classification and Diagnostic Prediction of Cancers Using Gene Expression Profiling and Artificial Neural Networks,” . Nature Medicine , 7 : 673 – 679 .
   PubMed Web of Science ®Google Scholar
• Lu , Z. 2010 . “Adaptive First-Order Methods for General Sparse Inverse Covariance Selection,” . SIAM Journal on Matrix Analysis and Applications , 31 : 2000 – 2016 .
   Web of Science ®Google Scholar
• Marčenko , V. A. and Pastur , L. A. 1967 . “Distribution of Eigenvalues for Some Sets of Random Matrices,” . Sbornik: Mathematics , 1 : 457 – 483 .
   Google Scholar
• Markowitz , H. 1952 . “Portfolio Selection,” . Journal of Finance , 7 : 77 – 91 .
   Web of Science ®Google Scholar
• Peaceman , D. H. and Rachford , H. H. 1955 . “The Numerical Solution of Parabolic Elliptic Differential Equations,” . SIAM Journal on Applied Mathematics , 3 : 28 – 41 .
   Web of Science ®Google Scholar
• Rothman , A. 2012 . “Positive Definite Estimators of Large Covariance Matrices,” . Biometrika , 99 : 733 – 740 .
   Web of Science ®Google Scholar
• Rothman , A. , Levina , E. and Zhu , J. 2009 . “Generalized Thresholding of Large Covariance Matrices,” . Journal of the American Statistical Association , 104 : 177 – 186 .
   Web of Science ®Google Scholar
• Scheinberg , K. , Ma , S. and Goldfarb , D. 2010 . “Sparse Inverse Covariance Selection via Alternating Linearization Methods,” . Advances in Neural Information Processing Systems , arXiv:1011.0097
   Google Scholar
• Subramaniana , A. , Tamayoa , P. , Moothaa , V. , Mukherjeed , S. , Eberta , B. , Gillettea , M. , Paulovichg , A. , Pomeroyh , S. , Goluba , T. , Landera , E. , Lander , E. S. and Mesirov , J. P. 2005 . “Gene Set Enrichment Analysis: A Knowledge-Based Approach for Interpreting Genome-Wide Expression Profiles,” . Proceedings of the National Academy of Sciences , 102 : 15545 – 15550 .
   PubMed Web of Science ®Google Scholar
• Wu , W. and Pourahmadi , M. 2003 . “Nonparametric Estimation of Large Covariance Matrices of Longitudinal Data,” . Biometrika , 90 : 831 – 844 .
   Web of Science ®Google Scholar
• Zou , H. 2006 . “The Adaptive Lasso and Its Oracle Properties,” . Journal of the American Statistical Association , 101 : 1418 – 1429 .
   Web of Science ®Google Scholar