Information entropy due to multi-level digitization

Abstract

A generalized Markov superposition approximation is used for the higher order correlation functions in a systematic expansion for the entropy. The results are applicable to certain one-dimensional problems, such as the information content of time series or signals, or possibly also to polymer adsorption at a wall. The case of digitization of the signal into many levels is treated in detail, and the dependence of the information content on sampling and digitization is analysed.