Abstract
Estimation of the Shannon entropy from frequency data is studied. A Bayesian estimator has been proposed using the Dirichlet distribution to incorporate the prior knowledge. An information measure of the frequency data is also presented. Numerical examples are given to illustrate the performance of the Bayesian estimator and the information measure.