(Boltzmann definition) A measure of the disorder directly proportional to the natural logarithm of the number of microstates yielding an equivalent thermodynamic macrostate.

plural of entropy

(information theory) A measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.

Kolmogorov complexity

information entropy

(information theory) The Shannon entropy of a "script" whose "characters" are elements of the Cartesian product of the sets of characters of the component scripts.

(information theory) The portion of a random variable's own Shannon entropy which is independent from another, given, random variable.

plural of Shannon entropy

plural of joint entropy

plural of conditional entropy