Exact Hamiltonian Monte Carlo for Truncated Multivariate Gaussians

REFERENCES

• Albert, J., and Chib, S. (1993), “Bayesian Analysis of Binary and Polychotomous Response Data,” Journal of the American Statistical Association, 88, 669–679.
   Web of Science ®Google Scholar
• Ashford, J., and Sowden, R. (1970), “Multi-Variate Probit Analysis,” Biometrics, 26, 535–546.
   PubMed Web of Science ®Google Scholar
• Bannerman, M.N., Sargant, R., and Lue, L. (2011), “DynamO: A Free O(N) General Event-Driven Molecular Dynamics Simulator,” Journal of Computational Chemistry, 32, 3329–3338.
   PubMed Web of Science ®Google Scholar
• Bien, J., Taylor, J., and Tibshirani, R. (2012), “A Lasso for Hierarchical Interactions,” Arxiv preprint arXiv:1205.5050.
   Google Scholar
• Chen, M.t, and Deely, J. (1992), “Application of a New Gibbs Hit-and-Run Sampler to a Constrained Linear Multiple Regression Problem,” . Technical Report 92-21, Purdue University, Center for Statistical Decision Sciences and Department of Statistics.
   Google Scholar
• Chu, E., and George, A. (1999), Inside the FFT Black Box: Serial and Parallel Fast Fourier Transform Algorithms, Boca Raton, FL: CRC Press.
   Google Scholar
• Cox, D., and Wermuth, N. (2002), “On Some Models for Multivariate Binary Variables Parallel in Complexity With the Multivariate Gaussian Distribution,” Biometrika, 89, 462–469.
   Web of Science ®Google Scholar
• Damien, P., and Walker, S. (2001), “Sampling Truncated Normal, Beta, and Gamma Densities,” Journal of Computational and Graphical Statistics, 10, 206–215.
   Web of Science ®Google Scholar
• De Boor, C. (2001), A Practical Guide to Splines, New York: Springer Verlag.
   Google Scholar
• Duane, S., Kennedy, A., Pendleton, B., and Roweth, D. (1987), “Hybrid Monte Carlo,” Physics Letters B, 195, 216–222.
   Web of Science ®Google Scholar
• Ellis, N., and Maitra, R. (2007), “Multivariate Gaussian Simulation Outside Arbitrary Ellipsoids,” Journal of Computational and Graphical Statistics, 16, 692–708.
   Web of Science ®Google Scholar
• Emrich, L., and Piedmonte, M. (1991), “A Method for Generating High-Dimensional Multivariate Binary Variates,” The American Statistician, 45, 302–304.
   Web of Science ®Google Scholar
• Gelfand, A., Smith, A., and Lee, T. (1992), “Bayesian Analysis of Constrained Parameter and Truncated Data Problems Using Gibbs Sampling,” Journal of the American Statistical Association, 87, 523–532.
   Web of Science ®Google Scholar
• Gelman, A., Carlin, J., Stern, H., and Rubin, D. (2004), Bayesian Data Analysis, Boca Raton, FL: CRC Press.
   Google Scholar
• Geweke, J. (1991), “Efficient Simulation From the Multivariate Normal and Student-t Distributions Subject to Linear Constraints and the Evaluation of Constraint Probabilities,” in Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface, pp. 571–578.
   Google Scholar
• Geweke, J., Keane, M., and Runkle, D. (1994), “Alternative Computational Approaches to Inference in the Multinomial Probit Model,” The Review of Economics and Statistics, 76, 609–632.
   Web of Science ®Google Scholar
• Glasserman, P. (2003), Monte Carlo Methods in Financial Engineering (vol. 53), New York: Springer.
   Google Scholar
• Green, P., and Silverman, B. (1994), Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach (vol. 58), London: Chapman & Hall/CRC.
   Google Scholar
• Hammersley, J., and Morton, K. (1956), “A New Monte Carlo Technique: Antithetic Variates,” in Mathematical Proceedings of the Cambridge Philosophical Society (vol. 52), New York: Cambridge University Press, pp. 449–475.
   Google Scholar
• Hans, C. (2009), “Bayesian Lasso Regression,” Biometrika, 96, 835–845.
   Web of Science ®Google Scholar
• Herbison-Evans, D. (1994), “Solving Quartics and Cubics for Graphics,” . Technical Report TR-94-487, Sydney, Australia: Basser Department of Computer Science, University of Sydney.
   Google Scholar
• Hoffman, M., and Gelman, A. (2011), “The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo,” . Arxiv preprint arXiv:1111.4246.
   Google Scholar
• Izaguirre, J., and Hampton, S. (2004), “Shadow Hybrid Monte Carlo: An Efficient Propagator in Phase Space of Macromolecules,” Journal of Computational Physics, 200, 581–604.
   Google Scholar
• Jeffreys, H. (1946), “An Invariant Form for the Prior Probability in Estimation Problems,” Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences, 186, pp. 453–461.
   PubMed Web of Science ®Google Scholar
• Kennedy, A. (1990), “The Theory of Hybrid Stochastic Algorithms,” in NATO ASIB Proceedings of 224: Probabilistic Methods in Quantum Field Theory and Quantum Gravity, Vol. 1, p. 209.
   Google Scholar
• Kennedy, A., and Bitar, K. (1994), “An Exact Local Hybrid Monte Carlo Algorithm for Gauge Theories,” Nuclear Physics B—Proceedings Supplements, 34, 786–788.
   Google Scholar
• Kotecha, J., and Djuric, P. (1999), “Gibbs Sampling Approach for Generation of Truncated Multivariate Gaussian Random Variables,” in IEEE International Conference on Acoustics, Speech, and Signal Processing: Proceedings, 1999 (Vol. 3), pp. 1757–1760.
   Google Scholar
• LeBlanc, M., and Tibshirani, R. (1998), “Monotone Shrinkage of Trees,” Journal of Computational and Graphical Statistics, 7, 417–433.
   Web of Science ®Google Scholar
• Liu, J. (2008), Monte Carlo Strategies in Scientific Computing, New York: Springer.
   Google Scholar
• Neal, R. (2010), “MCMC Using Hamiltonian Dynamics,” Handbook of Markov Chain Monte Carlo, 54, 113–162.
   Google Scholar
• Neelon, B., and Dunson, D. (2004), “Bayesian Isotonic Regression and Trend Analysis,” Biometrics, 60, 398–406.
   PubMed Web of Science ®Google Scholar
• Paninski, L., Pillow, J., and Simoncelli, E. (2004), “Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Encoding Model,” Neural Computation, 16, 2533–2561.
   PubMed Web of Science ®Google Scholar
• Park, T., and Casella, G. (2008), “The Bayesian Lasso,” Journal of the American Statistical Association, 103, 681–686.
   Web of Science ®Google Scholar
• Polson, N., and Scott, J. (2011), “The Bayesian Bridge,” . Arxiv preprint arXiv:1109.2279.
   Google Scholar
• Ramsay, J., Hooker, G., and Graves, S. (2009), Functional Data Analysis With R and MATLAB, New York: Springer Verlag.
   Google Scholar
• Rasmussen, C. (2003), “Gaussian Processes to Speed Up Hybrid Monte Carlo for Expensive Bayesian Integrals,” in Bayesian Statistics 7: Proceedings of the 7th Valencia International Meeting, New York: Oxford University Press, pp. 651–659.
   Google Scholar
• Robert, C. (1995), “Simulation of Truncated Normal Variables,” Statistics and Computing, 5, 121–125.
   Web of Science ®Google Scholar
• Robert, C., and Casella, G. (2004), Monte Carlo Statistical Methods, New York: Springer Verlag.
   Google Scholar
• Rodriguez-Yam, G., Davis, R., and Scharf, L. (2004), “Efficient Gibbs Sampling of Truncated Multivariate Normal With Application to Constrained Linear Regression,” . unpublished manuscript. Available at http://www.stat.columbia.edu/rdavis/papers/CLR.pdf.
   Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
   Google Scholar
• Tobin, J. (1958), “Estimation of Relationships for Limited Dependent Variables,” Econometrica: Journal of the Econometric Society, 24–36.
   Google Scholar