A class of maximum-entropy multivariate distributions

Abstract

This paper characterizes a class of multivariate distributions that includes the multinormal and is contained in the exponential family. The wide range of possible applications of these distributions is suggested by some of hte characteristics germane to them: First, they maximize Shannon's entropy among all distributions that have finite moments of given orders. As such, they constitute a class of distributions that includes the multinormal and some likely alternatives. Second, they can exhibit several modes, and, further-more, they do so with a relatively small number of parameters (compared to mixtures of multinormals). Third, they are the stationary distributions of certain diffusion processes. Fourth, they approximate, near the multinormal, the multivariate Pearson family. And fifth, the maximum likelihood estimators of their population moments are the sample moments. Two possible methods of estimating the distributions are studied in this paper: maximum likelihood estimation, and a fast procedure that can be used to find consistent estimators of the parameters via sample moments. A FORTTAN subroutine that implements the latter method is also provided.

Keywords:

• multimodal distributions
• exponential family
• stochastic catastrophe theory
• method of moments