Confidence Intervals for Nonparametric Empirical Bayes Analysis

References

• Agresti, A. (2013), Categorical Data Analysis. Wiley Series in Probability and Statistics, (3rd ed.), Hoboken, NJ: Wiley.
   Google Scholar
• Anderson, T. W. (1969), “Confidence Limits for the Expected Value of an Arbitrary Bounded Random Variable with a Continuous Distribution Function,” Bulletin of the International Statistical Institute, 43, 249–251.
   Google Scholar
• Anderson, T. W., and Rubin, H. (1949), “Estimation of the Parameters of a Single Equation in a Complete System of Stochastic Equations,” The Annals of Mathematical Statistics, 20, 46–63. DOI: 10.1214/aoms/1177730090.
   Google Scholar
• ApS, M. (2020), The MOSEK Optimization Suite Manual, Version 9.2. Available at https://www.mosek.com/.
   Google Scholar
• Armstrong, T. B., and Kolesár, M. (2018), “Optimal Inference in a Class of Regression Models,” Econometrica, 86, 655–683. DOI: 10.3982/ECTA14434.
   Web of Science ®Google Scholar
• Armstrong, T. B., Kolesár, M., and Plagborg-Møller, M. (2020), “Robust Empirical Bayes Confidence Intervals,” arXiv preprint arXiv:2004.03448.
   Google Scholar
• Besançon, M., Papamarkou, T., Anthoff, D., Arslan,A., Byrne, S., Lin, D., and Pearson, J. (2021), “Distributions.jl: Definition and Modeling of Probability Distributions in the JuliaStats Ecosystem,” Journal of Statistical Software, 98, 1–30. DOI: 10.18637/jss.v098.i16.
   Web of Science ®Google Scholar
• Bezanson, J., Edelman, A., Karpinski, S., and Shah, V. B. (2017), “Julia: A Fresh Approach to Numerical Computing,” SIAM Review, 59, 65–98. DOI: 10.1137/141000671.
   Web of Science ®Google Scholar
• Bichsel, F. (1964), “Erfahrungs-Tarifierung in der Motorfahrzeughaftpflicht-Versicherung,” Mitteilungen der Vereinigung Schweizerischer Versicherungsmathematiker/Bulletin of the Swiss Association of Actuaries, 64, 119–130.
   Google Scholar
• Bickel, P. J. (1982), “On Adaptive Estimation,” The Annals of Statistics, 10, 647–671. DOI: 10.1214/aos/1176345863.
   Web of Science ®Google Scholar
• Boyd, S., and Vandenberghe, L. (2004), Convex Optimization, Cambridge: Cambridge University Press.
   Google Scholar
• Brennan, J., Vinayak, R. K., and Jamieson, K. (2020), “Estimating the Number and Effect Sizes of Non-Null Hypotheses,” in International Conference on Machine Learning, pp. 1123–1133.
   Google Scholar
• Brown, L. D., and Greenshtein, E. (2009), “Nonparametric Empirical Bayes and Compound Decision Approaches to Estimation of a High-dimensional Vector of Normal Means,” The Annals of Statistics, 37, 1685–1704. DOI: 10.1214/08-AOS630.
   Web of Science ®Google Scholar
• Brown, L. D., Greenshtein, E., and Ritov, Y. (2013), “The Poisson Compound Decision Problem Revisited,” Journal of the American Statistical Association, 108, 741–749. DOI: 10.1080/01621459.2013.771582.
   Web of Science ®Google Scholar
• Bühlmann, H., and Gisler, A. (2005), A Course in Credibility Theory and Its Applications, Berlin: Springer.
   Google Scholar
• Butucea, C., and Comte, F. (2009), “Adaptive Estimation of Linear Functionals in the Convolution Model and Applications,” Bernoulli, 15, 69–98. DOI: 10.3150/08-BEJ146.
   Web of Science ®Google Scholar
• Cai, T. T., and Low, M. G. (2003), “A Note on Nonparametric Estimation of Linear Functionals,” The Annals of Statistics, 31, 1140–1153. DOI: 10.1214/aos/1059655908.
   Web of Science ®Google Scholar
• Charnes, A., and Cooper, W. W. (1962), “Programming with Linear Fractional Functionals,” Naval Research Logistics Quarterly, 9, 181–186. DOI: 10.1002/nav.3800090303.
   Google Scholar
• Cordy, C. B., and Thomas, D. R. (1997), “Deconvolution of a Distribution Function,” Journal of the American Statistical Association, 92, 1459–1465. DOI: 10.1080/01621459.1997.10473667.
   Web of Science ®Google Scholar
• Dattner, I., Goldenshluger, A., and Juditsky, A. (2011), “On Deconvolution of Distribution Functions,” The Annals of Statistics, 39, 2477–2501. DOI: 10.1214/11-AOS907.
   Web of Science ®Google Scholar
• Deely, J., and Kruse, R. (1968), “Construction of Sequences Estimating the Mixing Distribution,” The Annals of Mathematical Statistics, 39, 286–288. DOI: 10.1214/aoms/1177698536.
   Google Scholar
• Devroye, L. (1992), “A Note on the Usefulness of Superkernels in Density Estimation,” The Annals of Statistics, 20, 2037–2056. DOI: 10.1214/aos/1176348901.
   Web of Science ®Google Scholar
• Donoho, D., and Reeves, G. (2013), “Achieving Bayes MMSE Performance in the Sparse Signal + Gaussian White Noise Model When the Noise Level is Unknown,” in 2013 IEEE International Symposium on Information Theory, pp. 101–105. DOI: 10.1109/ISIT.2013.6620196.
   Google Scholar
• Donoho, D. L. (1988), “One-Sided Inference About Functionals of a Density,” The Annals of Statistics, 16, 1390–1420. DOI: 10.1214/aos/1176351045.
   Web of Science ®Google Scholar
• Donoho, D. L.(1994), “Statistical Estimation and Optimal Recovery,” The Annals of Statistics, 22, 238–270.
   Web of Science ®Google Scholar
• Donoho, D. L., and Liu, R. C. (1989), “Hardest One-Dimensional Subproblems,” Technical Report 178, Department of Statistics, University of California, Berkeley. Available at https://digitalassets.lib.berkeley.edu/sdtr/ucb/text/178.pdf.
   Google Scholar
• Donoho, D. L., and Liu, R. C. (1991), “Geometrizing Rates of Convergence, III. The Annals of Statistics, 19, 668–701. DOI: 10.1214/aos/1176348115.
   Web of Science ®Google Scholar
• Dunning, I., Huchette, J., and Lubin, M. (2017), “JuMP: A Modeling Language for Mathematical Optimization,” SIAM Review, 59, 295–320. DOI: 10.1137/15M1020575.
   Web of Science ®Google Scholar
• Eckles, D., Ignatiadis, N., Wager, S., and Wu, H. (2020), “Noise-Induced Randomization in Regression Discontinuity Designs,” arXiv preprint arXiv:2004.09458.
   Google Scholar
• Efron, B. (1979), “Bootstrap Methods: Another Look at the Jackknife,” The Annals of Statistics, 7, 1–26. DOI: 10.1214/aos/1176344552.
   Web of Science ®Google Scholar
• Efron, B. (2010), Large-Scale Inference: Empirical Bayes Methods for Estimation, Testing, and Prediction, Cambridge: Cambridge University Press.
   Google Scholar
• Efron, B. (2011), Tweedie’s Formula and Selection Bias,” Journal of the American Statistical Association, 106, 1602–1614.
   PubMed Web of Science ®Google Scholar
• Efron, B. (2014), “Two Modeling Strategies for Empirical Bayes Estimation,” Statistical Science, 29, 285–301.
   PubMed Web of Science ®Google Scholar
• Efron, B. (2016), “Empirical Bayes Deconvolution Estimates,” Biometrika, 103, 1–20.
   Web of Science ®Google Scholar
• Efron, B. (2019), “Bayes, Oracle Bayes and Empirical Bayes,” Statistical Science, 34, 177–201.
   Web of Science ®Google Scholar
• Efron, B., and Morris, C. (1973), “Stein’s Estimation Rule and Its Competitors – An Empirical Bayes Approach,” Journal of the American Statistical Association, 68, 117–130.
   Web of Science ®Google Scholar
• Efron, B., Tibshirani, R., Storey, J. D., and Tusher, V. (2001), “Empirical Bayes Analysis of a Microarray Experiment,” Journal of the American Statistical Association, 96, 1151–1160. DOI: 10.1198/016214501753382129.
   Web of Science ®Google Scholar
• Es, B. V., and Uh, H.-w. (2005), “Asymptotic Normality of Kernel-Type Deconvolution Estimators,” Scandinavian Journal of Statistics, 32, 467–483. DOI: 10.1111/j.1467-9469.2005.00443.x.
   Web of Science ®Google Scholar
• Fieller, E. C. (1940), “The Biological Standardization of Insulin,” Supplement to the Journal of the Royal Statistical Society, 7, 1–64. DOI: 10.2307/2983630.
   Google Scholar
• Fieller, E. C. (1954), “Some Problems in Interval Estimation,” Journal of the Royal Statistical Society, Series B, 16, 175–185.
   Google Scholar
• Gilraine, M., Gu, J., and McMillan, R. (2020), “A New Method for Estimating Teacher Value-Added,” Working Paper 27094, National Bureau of Economic Research. Available at DOI: 10.3386/w27094.
   Google Scholar
• Greenshtein, E., and Itskov, T. (2018), “Application of Non-parametric Empirical Bayes to Treatment of Non-response,” Statistica Sinica, 28, 2189–2208. DOI: 10.5705/ss.202016.0270.
   Web of Science ®Google Scholar
• Gu, J., and Koenker, R. (2017), “Unobserved Heterogeneity in Income Dynamics: An Empirical Bayes Perspective,” Journal of Business & Economic Statistics, 35, 1–16.
   Web of Science ®Google Scholar
• Hajek, J. (1962), “Asymptotically Most Powerful Rank-Order Tests,” The Annals of Mathematical Statistics, 33, 1124–1147. DOI: 10.1214/aoms/1177704476.
   Google Scholar
• Heinrich, P., and Kahn, J. (2018), “Strong Identifiability and Optimal Minimax Rates for Finite Mixture Estimation,” Annals of Statistics, 46, 2844–2870.
   Web of Science ®Google Scholar
• Hirshberg, D. A., and Wager, S. (2021), “Augmented Minimax Linear Estimation,” The Annals of Statistics, 49, 3206–3227. DOI: 10.1214/21-AOS2080.
   Web of Science ®Google Scholar
• Imbens, G., and Wager, S. (2019), “Optimized Regression Discontinuity Designs,” Review of Economics and Statistics, 101, 264–278. DOI: 10.1162/rest_a_00793.
   Web of Science ®Google Scholar
• Imbens, G. W., and Manski, C. F. (2004), “Confidence Intervals for Partially Identified Parameters,” Econometrica, 72, 1845–1857. DOI: 10.1111/j.1468-0262.2004.00555.x.
   Web of Science ®Google Scholar
• Jiang, W., and Zhang, C.-H. (2009), “General Maximum Likelihood Empirical Bayes Estimation of Normal Means,” The Annals of Statistics, 37, 1647–1684. DOI: 10.1214/08-AOS638.
   Web of Science ®Google Scholar
• Johnstone, I. M. (2019), “Gaussian Estimation: Sequence and Wavelet Models,” Draft version, September 16, 2019. URL https://statweb.stanford.edu/∼imj/GE_08_09_17.pdf.
   Google Scholar
• Kallus, N. (2020), “Generalized Optimal Matching Methods for Causal Inference,” Journal of Machine Learning Research, 21, 1–54.
   PubMed Web of Science ®Google Scholar
• Karlis, D., Tzougas, G., and Frangos, N. (2018), “Confidence Intervals of the Premiums of Optimal Bonus Malus Systems,” Scandinavian Actuarial Journal, 2018, 129–144. DOI: 10.1080/03461238.2017.1307267.
   Web of Science ®Google Scholar
• Kiefer, J., and Wolfowitz, J. (1956), “Consistency of the Maximum Likelihood Estimator in the Presence of Infinitely Many Incidental Parameters,” The Annals of Mathematical Statistics, 27, 887–906. DOI: 10.1214/aoms/1177728066.
   Google Scholar
• Kim, A. K. (2014), “Minimax Bounds for Estimation of Normal Mixtures,” Bernoulli, 20, 1802–1818. DOI: 10.3150/13-BEJ542.
   Web of Science ®Google Scholar
• Koenker, R. (2020), “Empirical Bayes Confidence Intervals: An R vinaigrette.” Available at http://www.econ.uiuc.edu/∼roger/research/ebayes/cieb.pdf.
   Google Scholar
• Koenker, R., and Gu, J (2017), “REBayes: Empirical Bayes Mixture Methods in R,” Journal of Statistical Software, 82, 1–26. DOI: 10.18637/jss.v082.i08.
   Web of Science ®Google Scholar
• Koenker, R., and Mizera, I. (2014), “Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules,” Journal of the American Statistical Association, 109, 674–685. DOI: 10.1080/01621459.2013.869224.
   Web of Science ®Google Scholar
• Laird, N. M., and Louis, T. A. (1987), “Empirical Bayes Confidence Intervals Based on Bootstrap Samples,” Journal of the American Statistical Association, 82, 739–750. DOI: 10.1080/01621459.1987.10478490.
   Web of Science ®Google Scholar
• Lord, F. M. (1969), “Estimating True-Score Distributions in Psychological Testing (an Empirical Bayes Estimation Problem),” Psychometrika, 34, 259–299. DOI: 10.1007/BF02289358.
   Web of Science ®Google Scholar
• Lord, F. M., and Cressie, N. (1975), “An Empirical Bayes Procedure for Finding an Interval Estimate,” Sankhyā: The Indian Journal of Statistics, Series B, 37, 1–9.
   Google Scholar
• Lord, F. M., and Stocking, M. L. (1976), “An Interval Estimate for Making Statistical Inferences about True Scores,” Psychometrika, 41, 79–87. DOI: 10.1007/BF02291699.
   Web of Science ®Google Scholar
• Love, M. I., Huber, W., and Anders, S. (2014), “Moderated Estimation of Fold Change and Dispersion for RNA-seq Data with DESeq2,” Genome Biology, 15, Article Number 550. https://genomebiology.biomedcentral.com/articles/10.1186/s13059-014-0550-8 DOI: 10.1186/s13059-014-0550-8.
   Web of Science ®Google Scholar
• Low, M. G. (1995), “Bias-Variance Tradeoffs in Functional Estimation Problems,” The Annals of Statistics, 23, 824–835. DOI: 10.1214/aos/1176324624.
   Web of Science ®Google Scholar
• Magder, L. S., and Zeger, S. L. (1996), “A Smooth Nnonparametric Estimate of a Mixing Distribution Using Mixtures of Gaussians,” Journal of the American Statistical Association, 91, 1141–1151. DOI: 10.1080/01621459.1996.10476984.
   Web of Science ®Google Scholar
• Massart, P. (1990), “The Tight Constant in the Dvoretzky–Kiefer–Wolfowitz Inequality,” The Annals of Probability, 18, 1269–1283. DOI: 10.1214/aop/1176990746.
   Web of Science ®Google Scholar
• Matias, C., and Taupin, M.-L. (2004), “Minimax Estimation of Linear Functionals in the Convolution Model,” Mathematical Methods of Statistics, 13, 282–328.
   Google Scholar
• Morris, C. N. (1983), “Parametric Empirical Bayes Confidence Intervals,” in Scientific Inference, Data Analysis, and Robustness, Amsterdam: Elsevier, pp. 25–50.
   Google Scholar
• Muralidharan, O. (2012), “High Dimensional Exponential Family Estimation via Empirical Bayes,” Statistica Sinica, 22, 1217–1232.
   Web of Science ®Google Scholar
• Narasimhan, B., and Efron, B. (2020), “deconvolveR: A G-modeling Program for Deconvolution and Empirical Bayes Estimation,” Journal of Statistical Software, 94, 1–20. DOI: 10.18637/jss.v094.i11.
   Web of Science ®Google Scholar
• Noack, C., and Rothe, C. (2019), “Bias-Aware Inference in Fuzzy Regression Discontinuity Designs,” arXiv preprint arXiv:1906.04631.
   Google Scholar
• Pensky, M. (2017), “Minimax Theory of Estimation of Linear Functionals of the Deconvolution Density With or Without Sparsity,” The Annals of Statistics, 45, 1516–1541. DOI: 10.1214/16-AOS1498.
   Web of Science ®Google Scholar
• Politis, D. N., and Romano, J. P. (1993), “On a Family of Smoothing Kernels of Infinite Order,” in Computing Science and Statistics, Proceedings of the 25th Symposium on the Interface, San Diego, CA, pp. 141–145, Fairfax Station, VA, 1993. Interface Foundation of North America.
   Google Scholar
• Robbins, H. (1956), “An Empirical Bayes Approach to Statistics,” in Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Contributions to the Theory of Statistics, ed. J. Neyman, pp. 156–163, Berkeley: University of California Press.
   Google Scholar
• Robbins, H. (1980), “An Empirical Bayes Estimation Problem,” Proceedings of the National Academy of Sciences, 77, 6988–6989.
   Google Scholar
• Robins, J., and Van Der Vaart, A. (2006), “Adaptive Nonparametric Confidence Sets,” The Annals of Statistics, 34, 229–253. DOI: 10.1214/009053605000000877.
   Web of Science ®Google Scholar
• Rockafellar, R. T. (1970), Convex Analysis, Princeton, NJ: Princeton University Press.
   Google Scholar
• Romano, J. P., and Wolf, M. (2000), “Finite Sample Nonparametric Inference and Large Sample Efficiency,” Annals of Statistics, 28, 756–778.
   Web of Science ®Google Scholar
• Rosenbaum, P. R. (2002), Observational Studies, New York: Springer.
   Google Scholar
• Simar, L. (1976), “Maximum Likelihood Estimation of a Compound Poisson Process,” The Annals of Statistics, 4, 1200–1209. DOI: 10.1214/aos/1176343651.
   Web of Science ®Google Scholar
• Singh, D., Febbo, P. G., Ross, K., Jackson, D. G., Manola, J., Ladd,C., Tamayo,P., Renshaw, A. A., D’Amico, A. V., Richie, J. P., Lander, E. S., Loda, M., Kantoff, P. W., Golub, T. R., and Sellers, W. R. (2002), “Gene Expression Correlates of Clinical Prostate Cancer Behavior,” Cancer Cell, 1, 203–209. DOI: 10.1016/S1535-6108(02)00030-2.
   PubMed Web of Science ®Google Scholar
• Stephens, M. (2016), “False Discovery Rates: A New Deal,” Biostatistics, 18, 275–294. DOI: 10.1093/biostatistics/kxw041.
   Web of Science ®Google Scholar
• Tierney, L., and Lambert, D. (1984), “Asymptotic Efficiency of Estimators of Functionals of Mixed Distributions,” The Annals of Statistics, 12, 1380–1387. DOI: 10.1214/aos/1176346798.
   Web of Science ®Google Scholar
• Wasserman, L., Ramdas, A., and Balakrishnan, S. (2020), “Universal Inference,” Proceedings of the National Academy of Sciences, 117, 16880–16890. DOI: 10.1073/pnas.1922664117.
   PubMed Web of Science ®Google Scholar
• Weinstein, A., Ma, Z., Brown, L. D., and Zhang, C.-H. (2018), “Group-Linear Empirical Bayes Estimates for a Heteroscedastic Normal Mean,” Journal of the American Statistical Association, 113, 698–710. DOI: 10.1080/01621459.2017.1280406.
   Web of Science ®Google Scholar
• Yu, C., and Hoff, P. D. (2019), “Adaptive Sign Error Control,” Journal of Statistical Planning and Inference, 201, 133–145. DOI: 10.1016/j.jspi.2019.01.002.
   Web of Science ®Google Scholar
• Zhu, A., Ibrahim, J. G., and Love, M. I. (2018), “Heavy-Tailed Prior Distributions for Sequence Count Data: Removing the Noise and Preserving Large Differences,” Bioinformatics, 35, 2084–2092. DOI: 10.1093/bioinformatics/bty895.
   Web of Science ®Google Scholar