The amount of information and the volume of ‘information tare’

Abstract

A distinction is suggested between the notions ‘information tare’, the role of which is played by the signals or letters forming the message, and ‘information’, which may be contained in such messages. It is shown that Shannon's definition of the amount of information is, in fact, the definition of the volume of information tare, whereas the amount of information itself may be measured as the volume of information tare of the maximally compact message used for its recording. This allows one to express both the volume of information tare, H, and the amount of information, B, in the same units of measurement–bits–and for any message B≤H. Some consequences of these views are analysed.