plural of entropy

(Boltzmann definition) A measure of the disorder directly proportional to the natural logarithm of the number of microstates yielding an equivalent thermodynamic macrostate.

plural of Shannon entropy

plural of joint entropy

plural of conditional entropy

(information theory) A measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.

Kolmogorov complexity

information entropy

(information theory) The Shannon entropy of a "script" whose "characters" are elements of the Cartesian product of the sets of characters of the component scripts.

(information theory) The portion of a random variable's own Shannon entropy which is independent from another, given, random variable.