1,355
Views
9
CrossRef citations to date
0
Altmetric
Theory and Methods

Estimation of the Number of Spiked Eigenvalues in a Covariance Matrix by Bulk Eigenvalue Matching Analysis

, & ORCID Icon
Pages 374-392 | Received 30 May 2020, Accepted 09 May 2021, Published online: 23 Jul 2021

References

  • Bai, J., and Ng, S. (2002), “Determining the Number of Factors in Approximate Factor Models,” Econometrica, 70, 191–221.
  • Baik, J., Ben Arous, G., and Peche, S. (2005), “Phase Transition of the Largest Eigenvalue for Nonnull Complex Sample Covariance Matrices,” The Annals of Probability, 33, 1643–1697. DOI: 10.1214/009117905000000233.
  • Bao, Z. (2020), Personal Communications.
  • Bloemendal, A., Knowles, A., Yau, H.-T., and Yin, J. (2016), “On the Principal Components of Sample Covariance Matrices,” Probability Theory and Related Fields, 164, 459–552.
  • Braeken, J., and Van Assen, M. A. (2017), “An Empirical Kaiser Criterion,” Psychological Methods, 22, 450. DOI: 10.1037/met0000074.
  • Cai, T. T., Han, X., and Pan, G. (2020), “Limiting Laws for Divergent Spiked Eigenvalues and Largest Nonspiked Eigenvalue of Sample Covariance Matrices,” Annals of Statistics, 48, 1255–1280.
  • Ding, X. (2020), “Spiked Sample Covariance Matrices With Possibly Multiple Bulk Components,” Random Matrices: Theory and Applications, 2150014.
  • Dobriban, E. (2015), “Efficient Computation of Limit Spectra of Sample Covariance Matrices,” Random Matrices: Theory and Applications, 4, 1550019. DOI: 10.1142/S2010326315500197.
  • Dobriban, E., and Owen, A. B. (2019), “Deterministic Parallel Analysis: An Improved Method for Selecting Factors and Principal Components,” Journal of the Royal Statistical Society, Series B, 81, 163–183.
  • Donoho, D. L., Gavish, M., and Johnstone, I. M. (2018), “Optimal Shrinkage of Eigenvalues in the Spiked Covariance Model,” The Annals of Statistics, 46, 1742. DOI: 10.1214/17-AOS1601.
  • Efron, B. (2004), “Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis,” Journal of the American Statistical Association, 99, 96–104. DOI: 10.1198/016214504000000089.
  • Fan, J., Guo, J., and Zheng, S. (2020), “Estimating Number of Factors by Adjusted Eigenvalues Thresholding,” Journal of the American Statistical Association, 1–33.
  • Fan, J., Liao, Y., and Mincheva, M. (2013), “Large Covariance Estimation by Thresholding Principal Orthogonal Complements,” Journal of the Royal Statistical Society, Series B, 75, 603–680. DOI: 10.1111/rssb.12016.
  • Gavish, M., and Donoho, D. L. (2014), “The Optimal Hard Threshold for Singular Values is 4/3,” IEEE Transactions on Information Theory, 60, 5040–5053.
  • 1000 Genomes Project Consortium, A. (2015), “A Global Reference for Human Genetic Variation,” Nature, 526, 68. DOI: 10.1038/nature15393.
  • Gordon, G. J., Jensen, R. V., Hsiao, L.-L., Gullans, S. R., Blumenstock, J. E., Ramaswamy, S., Richards, W. G., Sugarbaker, D. J., and Bueno, R. (2002), “Translation of Microarray Data Into Clinically Relevant Cancer Diagnostic Tests Using Gene Expression Ratios in Lung Cancer and Mesothelioma,” Cancer Research, 62, 4963–4967.
  • Götze, F., Tikhomirov, A. (2004), “Rate of Convergence in Probability to the Marchenko-Pastur Law,” Bernoulli, 10, 503–548.
  • Horn, J. L. (1965), “A Rationale and Test for the Number of Factors in Factor Analysis,” Psychometrika, 30, 179–185. DOI: 10.1007/BF02289447.
  • Horn, R. A., and Johnson, C. R. (2012), Matrix Analysis, Cambridge: Cambridge University Press.
  • Jin, J., Ke, Z. T., and Wang, W. (2017), “Phase Transitions for High Dimensional Clustering and Related Problems,” The Annals of Statistics, 45, 2151–2189. DOI: 10.1214/16-AOS1522.
  • Jin, J., and Wang, W. (2016), “Influential Features PCA for High Dimensional Clustering,” The Annals of Statistics, 44, 2323–2359.
  • Johnstone, I. M. (2001), “On the Distribution of the Largest Eigenvalue in Principal Components Analysis,” The Annals of Statistics, 29, 295–327. DOI: 10.1214/aos/1009210544.
  • Ke, Z. T. (2016), “Detecting Rare and Weak Spikes in Large Covariance Matrices,” arXiv no. 1609.00883.
  • Knowles, A., and Yin, J. (2017), “Anisotropic Local Laws for Random Matrices,” Probability Theory and Related Fields, 169, 257–352.
  • Kritchman, S., and Nadler, B. (2009), “Non-Parametric Detection of the Number of Signals: Hypothesis Testing and Random Matrix Theory,” IEEE Transactions on Signal Processing, 57, 3930–3941.
  • Kwak, J., Lee, J. O., and Park, J. (2019), “Extremal Eigenvalues of Sample Covariance Matrices With General Population,” arXiv no. 1908.07444.
  • Marcenko, V. A., and Pastur, L. A. (1967), “Distribution of Eigenvalues for Some Sets of Random Matrices,” Mathematics of the USSR-Sbornik, 1, 457–483.
  • Onatski, A. (2009), “Testing Hypotheses About the Number of Factors in Large Factor Models,” Econometrica, 77, 1447–1479.
  • Onatski, A. (2010), “Determining the Number of Factors From Empirical Distribution of Eigenvalues,” The Review of Economics and Statistics, 92, 1004–1016.
  • Passemier, D., and Yao, J. (2014), “Estimation of the Number of Spikes, Possibly Equal, in the High-Dimensional Case,” Journal of Multivariate Analysis, 127, 173–183.
  • Patterson, N., Price, A. L., and Reich, D. (2006), “Population Structure and Eigenanalysis,” PLoS Genetics, 2, e190. DOI: 10.1371/journal.pgen.0020190.
  • Paul, D. (2007), “Asymptotics of Sample Eigenstructure for a Large Dimensional Spiked Covariance Model,” Statistica Sinica, 17, 1617–1642.
  • Shabalin, A. A., and Nobel, A. B. (2013), “Reconstruction of a Low-Rank Matrix in the Presence of Gaussian Noise,” Journal of Multivariate Analysis, 118, 67–76.
  • Silverstein, J. W. (2009), “The Stieltjes Transform and Its Role in Eigenvalue Behavior of Large Dimensional Random Matrices,” in Random Matrix Theory and Its Applications, Lecture Notes Series, Singapore: Institute for Mathematical Sciences, National University of Singapore, 18, 1–25. https://doi.org/10.1142/7285
  • Uhlig, H. (1994), “On Singular Wishart and Singular Multivariate Beta Distributions,” The Annals of Statistics, 22, 395–405. DOI: 10.1214/aos/1176325375.
  • Wax, M., and Kailath, T. (1985), “Detection of Signals by Information Theoretic Criteria,” IEEE Transactions on Acoustics, Speech, and Signal Processing, 33, 387–392.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.