A Regression Modeling Approach to Structured Shrinkage Estimation

References

• Banerjee, T., Mukherjee, G., and Sun, W. (2019), “Adaptive Sparse Estimation With Side Information,” Journal of the American Statistical Association, 115, 2053–2067. DOI: 10.1080/01621459.2019.1679639.
   Web of Science ®Google Scholar
• Biscarri, W. D. (2019), “Statistical Methods for Binomial and Gaussian Sequences,” PhD thesis, University of Illinois at Urbana-Champaign.
   Google Scholar
• Brown, L. D., and Greenshtein, E. (2009), “Nonparametric Empirical Bayes and Compound Decision Approaches to Estimation of a High-Dimensional Vector of Normal Means,” The Annals of Statistics, 37, 1685–1704. DOI: 10.1214/08-AOS630.
   Web of Science ®Google Scholar
• Buades, A., Coll, B., and Morel, J.-M. (2005), “A Non-Local Algorithm for Image Denoising,” in 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05) (Vol. 2), IEEE, pp. 60–65.
   Google Scholar
• Cai, T. T. (2012), “Minimax and Adaptive Inference in Nonparametric Function Estimation,” Statistical Science, 27, 31–50. DOI: 10.1214/11-STS355.
   Web of Science ®Google Scholar
• Castillo, I., and van der Vaart, A. (2012), “Needles and Straw in a Haystack: Posterior Concentration for Possibly Sparse Sequences,” The Annals of Statistics, 40, 2069–2101. DOI: 10.1214/12-AOS1029.
   Web of Science ®Google Scholar
• Cohen, N., Greenshtein, E., and Ritov, Y. (2013), “Empirical Bayes in the Presence of Explanatory Variables,” Statistica Sinica, 23, 333–357.
   Web of Science ®Google Scholar
• Diaconis, P., and Ylvisaker, D. (1979), “Conjugate Priors for Exponential Families,” The Annals of Statistics, 7, 269–281. DOI: 10.1214/aos/1176344611.
   Web of Science ®Google Scholar
• Donoho, D. L., and Johnstone, J. M. (1994), “Ideal Spatial Adaptation by Wavelet Shrinkage,” Biometrika, 81, 425–455. DOI: 10.1093/biomet/81.3.425.
   Web of Science ®Google Scholar
• Donoho, D. L., and Johnstone, J. M. (1995), “Adapting to Unknown Smoothness via Wavelet Shrinkage,” Journal of the American Statistical Association, 90, 1200–1224.
   Web of Science ®Google Scholar
• Efron, B., and Morris, C. (1973), “Stein’s Estimation Rule and Its Competitors—An Empirical Bayes Approach,” Journal of the American Statistical Association, 68, 117–130.
   Web of Science ®Google Scholar
• Elyanow, R., Dumitrascu, B., Engelhardt, B. E., and Raphael, B. J. (2019), “netNMF-sc: Leveraging Gene-Gene Interactions for Imputation and Dimensionality Reduction in Single-Cell Expression Analysis,” bioRxiv no. 544346.
   Google Scholar
• Feng, L., and Dicker, L. H. (2018), “Approximate Nonparametric Maximum Likelihood for Mixture Models: A Convex Optimization Approach to Fitting Arbitrary Multivariate Mixing Distributions,” Computational Statistics & Data Analysis, 122, 80–91.
   Web of Science ®Google Scholar
• Fourdrinier, D., Strawderman, W. E., and Wells, M. T. (2018), Shrinkage Estimation, Cham: Springer.
   Google Scholar
• Fu, L., Sun, W., and James, G. M. (2019), “Nonparametric Empirical Bayes Estimation on Heterogeneous Data,” Technical Report, University of Southern California.
   Google Scholar
• Greenshtein, E., Mantzura, A., and Ritov, Y. (2019), “Nonparametric Empirical Bayes Improvement of Shrinkage Estimators With Applications to Time Series,” Bernoulli, 25, 3459–3478.
   Web of Science ®Google Scholar
• Greenshtein, E., and Ritov, Y. (2009), “Asymptotic Efficiency of Simple Decisions for the Compound Decision Problem,” Lecture Notes-Monograph Series, 57, 266–275.
   Google Scholar
• Gu, J., and Koenker, R. (2017), “Empirical Bayesball Remixed: Empirical Bayes Methods for Longitudinal Data,” Journal of Applied Econometrics, 32, 575–599. DOI: 10.1002/jae.2530.
   Web of Science ®Google Scholar
• Ignatiadis, N., and Wager, S. (2019a), “Bias-Aware Confidence Intervals for Empirical Bayes Analysis,” arXiv no. 1902.02774.
   Google Scholar
• Ignatiadis, N., and Wager, S. (2019b), “Covariate-Powered Empirical Bayes Estimation,” arXiv no. 1906.01611.
   Google Scholar
• James, W., and Stein, C. M. (1961), “Estimation With Quadratic Loss,” in Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability (Vol. 1), Berkeley and Los Angeles, University of California Press, pp. 367–379.
   Google Scholar
• Jiang, L., Schlesinger, F., Davis, C. A., Zhang, Y., Li, R., Salit, M., Gingeras, T. R., and Oliver, B. (2011), “Synthetic Spike-In Standards for RNA-Seq Experiments,” Genome Research, 21, 1543–1551. DOI: 10.1101/gr.121095.111.
   PubMed Web of Science ®Google Scholar
• Jiang, W., and Zhang, C.-H. (2009), “General Maximum Likelihood Empirical Bayes Estimation of Normal Means,” The Annals of Statistics, 37, 1647–1684. DOI: 10.1214/08-AOS638.
   Web of Science ®Google Scholar
• Jiang, W., and Zhang, C.-H. (2010), “Empirical Bayes In-Season Prediction of Baseball Batting Averages,” in Borrowing Strength: Theory Powering Applications—A Festschrift for Lawrence D. Brown, Beachwood, OH: Institute of Mathematical Statistics, pp. 263–273.
   Google Scholar
• Jing, B.-Y., Li, Z., Pan, G., and Zhou, W. (2016), “On Sure-Type Double Shrinkage Estimation,” Journal of the American Statistical Association, 111, 1696–1704. DOI: 10.1080/01621459.2015.1110032.
   Web of Science ®Google Scholar
• Johnstone, I. M. (2017), “Gaussian Estimation: Sequence and Wavelet Models,” Technical Report, Department of Statistics, Stanford University, Stanford.
   Google Scholar
• Kou, S., and Yang, J. J. (2017), “Optimal Shrinkage Estimation in Heteroscedastic Hierarchical Linear Models,” in Big and Complex Data Analysis, Cham: Springer, pp. 249–284.
   Google Scholar
• Li, W. V., and Li, J. J. (2018), “An Accurate and Robust Imputation Method scImpute for Single-Cell RNA-Seq Data,” Nature Communications, 9, 997. DOI: 10.1038/s41467-018-03405-7.
   PubMed Web of Science ®Google Scholar
• Lindley, D. V. (1962), “Discussion of ‘Confidence Sets for the Mean of a Multivariate Normal Distribution’, by C. M. Stein,” Journal of the Royal Statistical Society, Series B, 24, 285–287.
   Google Scholar
• Love, M. I., Huber, W., and Anders, S. (2014), “Moderated Estimation of Fold Change and Dispersion for RNA-Seq Data with DESeq2,” Genome Biology, 15, 550. DOI: 10.1186/s13059-014-0550-8.
   PubMed Web of Science ®Google Scholar
• Martin, R., and Walker, S. G. (2014), “Asymptotically Minimax Empirical Bayes Estimation of a Sparse Normal Mean Vector,” Electronic Journal of Statistics, 8, 2188–2206. DOI: 10.1214/14-EJS949.
   Web of Science ®Google Scholar
• Oman, S. D. (1982), “Contracting Towards Subspaces When Estimating the Mean of a Multivariate Normal Distribution,” Journal of Multivariate Analysis, 12, 270–290. DOI: 10.1016/0047-259X(82)90020-3.
   Web of Science ®Google Scholar
• Rigollet, P., and Hütter, J.-C. (2017), “High-Dimensional Statistics. Lecture Notes,” Massachusetts Institute of Technology, available at http://www-math.mit.edu/rigollet/PDFs/RigNotes17.pdf.
   Google Scholar
• Robbins, H. (1951), “Asymptotically Subminimax Solutions of Compound Statistical Decision Problems,” in Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability, Berkeley and Los Angeles, University of California Press, pp. 131–148.
   Google Scholar
• Robbins, H. (1955), “An Empirical Bayes Approach to Statistics,” in Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, Berkeley and Los Angeles, University of California Press, pp. 157–164.
   Google Scholar
• Robbins, H. (1964), “The Empirical Bayes Approach to Statistical Decision Problems,” The Annals of Mathematical Statistics, 35, 1–20.
   Google Scholar
• Robinson, M. D., McCarthy, D. J., and Smyth, G. K. (2010), “edgeR: A Bioconductor Package for Differential Expression Analysis of Digital Gene Expression Data,” Bioinformatics, 26, 139–140. DOI: 10.1093/bioinformatics/btp616.
   PubMed Web of Science ®Google Scholar
• Rudin, L. I., Osher, S., and Fatemi, E. (1992), “Nonlinear Total Variation Based Noise Removal Algorithms,” Physica D: Nonlinear Phenomena, 60, 259–268. DOI: 10.1016/0167-2789(92)90242-F.
   Web of Science ®Google Scholar
• Sclove, S. L., Morris, C., and Radhakrishnan, R. (1972), “Non-Optimality of Preliminary-Test Estimators for the Mean of a Multivariate Normal Distribution,” The Annals of Mathematical Statistics, 43, 1481–1490. DOI: 10.1214/aoms/1177692380.
   Google Scholar
• Smyth, G. K. (2005), “limma: Linear Models for Microarray Data,” in Bioinformatics and Computational Biology Solutions Using R and Bioconductor, New York: Springer, pp. 397–420.
   Google Scholar
• Stein, C. (1956), “Inadmissibility of the Usual Estimator for the Mean of a Multivariate Normal Distribution,” in Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability (Vol. 1), Berkeley and Los Angeles, University of California Press, pp. 197–206.
   Google Scholar
• Stein, C. (1962), “Confidence Sets for the Mean of a Multivariate Normal Distribution,” Journal of the Royal Statistical Society, Series B, 24, 265–285.
   Google Scholar
• Stein, C. (1981), “Estimation of the Mean of a Multivariate Normal Distribution,” The Annals of Statistics, 9, 1135–1151.
   Web of Science ®Google Scholar
• Stigler, S. M. (1990), “The 1988 Neyman Memorial Lecture: A Galtonian Perspective on Shrinkage Estimators,” Statistical Science, 5, 147–155.
   Google Scholar
• Stuart, T., Butler, A., Hoffman, P., Hafemeister, C., Papalexi, E., Mauck, W. M., III, Hao, Y., Stoeckius, M., Smibert, P., and Satija, R. (2019), “Comprehensive Integration of Single-Cell Data,” Cell, 177, 1888–1902. DOI: 10.1016/j.cell.2019.05.031.
   PubMed Web of Science ®Google Scholar
• Sun, W., and Cai, T. T. (2007), “Oracle and Adaptive Compound Decision Rules for False Discovery Rate Control,” Journal of the American Statistical Association, 102, 901–912. DOI: 10.1198/016214507000000545.
   Web of Science ®Google Scholar
• Tan, Z. (2015), “Improved Minimax Estimation of a Multivariate Normal Mean Under Heteroscedasticity,” Bernoulli, 21, 574–603. DOI: 10.3150/13-BEJ580.
   Web of Science ®Google Scholar
• Tan, Z. (2016), “Steinized Empirical Bayes Estimation for Heteroscedastic Data,” Statistica Sinica, 26, 1219–1248.
   Web of Science ®Google Scholar
• Tsybakov, A. B. (2008), Introduction to Nonparametric Estimation (1st ed.), New York: Springer.
   Google Scholar
• Van Dijk, D., Sharma, R., Nainys, J., Yim, K., Kathail, P., Carr, A. J., Burdziak, C., Moon, K. R., Chaffer, C. L., Pattabiraman, D., Bierie, B., Mazutis, L., Wolf, G., Krishnaswamy, S., and Pe’er, D. (2018), “Recovering Gene Interactions From Single-Cell Data Using Data Diffusion,” Cell, 174, 716–729. DOI: 10.1016/j.cell.2018.05.061.
   PubMed Web of Science ®Google Scholar
• Wang, J., Agarwal, D., Huang, M., Hu, G., Zhou, Z., Ye, C., and Zhang, N. R. (2019), “Data Denoising With Transfer Learning in Single-Cell Transcriptomics,” Nature Methods, 16, 875–878. DOI: 10.1038/s41592-019-0537-1.
   PubMed Web of Science ®Google Scholar
• Weinstein, A., Ma, Z., Brown, L. D., and Zhang, C.-H. (2018), “Group-Linear Empirical Bayes Estimates for a Heteroscedastic Normal Mean,” Journal of the American Statistical Association, 113, 698–710. DOI: 10.1080/01621459.2017.1280406.
   Web of Science ®Google Scholar
• Xie, X., Kou, S., and Brown, L. D. (2012), “SURE Estimates for a Heteroscedastic Hierarchical Model,” Journal of the American Statistical Association, 107, 1465–1479. DOI: 10.1080/01621459.2012.728154.
   PubMed Web of Science ®Google Scholar
• Xie, X., Kou, S., and Brown, L. D. (2016), “Optimal Shrinkage Estimation of Mean Parameters in Family of Distributions With Quadratic Variance,” The Annals of Statistics, 44, 564.
   PubMed Web of Science ®Google Scholar
• Zeisel, A., Muñoz-Manchado, A. B., Codeluppi, S., Lönnerberg, P., La Manno, G., Juréus, A., Marques, S., Munguba, H., He, L., Betsholtz, C., Rolney, C., Castelo-Brano, G., Hjerling-Leffler, J., and Linnarsson, S. (2015), “Cell Types in the Mouse Cortex and Hippocampus Revealed by Single-Cell RNA-Seq,” Science, 347, 1138–1142. DOI: 10.1126/science.aaa1934.
   PubMed Web of Science ®Google Scholar
• Zhang, C.-H. (2003), “Compound Decision Theory and Empirical Bayes Methods,” The Annals of Statistics, 31, 379–390. DOI: 10.1214/aos/1051027872.
   Web of Science ®Google Scholar
• Zhang, X., and Bhattacharya, A. (2017), “Empirical Bayes, SURE and Sparse Normal Mean Models,” arXiv no. 1702.05195.
   Google Scholar
• Zhao, S. D. (2020), “Simultaneous Estimation of Normal Means With Side Information,” Statistica Sinica (in press). DOI: 10.5705/ss.202019.0075.
   PubMed Web of Science ®Google Scholar