Convergence in the Wasserstein Metric for Markov Chain Monte Carlo Algorithms with Applications to Image Restoration

Abstract

In this paper, we show how the time for convergence to stationarity of a Markov chain can be assessed using the Wasserstein metric, rather than the usual choice of total variation distance. The Wasserstein metric may be more easily applied in some applications, particularly those on continuous state spaces. Bounds on convergence time are established by considering the number of iterations required to approximately couple two realizations of the Markov chain to within ε tolerance. The particular application considered is the use of the Gibbs sampler in the Bayesian restoration of a degraded image, with pixels that are a continuous grey-scale and with pixels that can only take two colours. On finite state spaces, a bound in the Wasserstein metric can be used to find a bound in total variation distance. We use this relationship to get a precise O(N log N) bound on the convergence time of the stochastic Ising model that holds for appropriate values of its parameter as well as other binary image models. Our method employing convergence in the Wasserstein metric can also be applied to perfect sampling algorithms involving coupling from the past to obtain estimates of their running times.

Key Words:

• Bayesian image restoration
• Coupling
• Gibbs sampler
• Ising model
• Perfect simulation
• Probability metrics
• Total variation distance

Mathematics Subject Classification:

• Primary 60J20
• Secondary 62M40

Acknowledgments

This work is part of my doctoral research under the direction of Jeffrey S. Rosenthal at the University of Toronto. I wish to thank him, Radford Neal, Neal Madras and Francis Su for helpful discussions.