Symbolic Generalizations

Concepts of Entropy in Information Exchange:

"We thus start with an objective-basis for computing the entropies, exactly inacordance with SHANNON's original definitions. Thus, H(A) will represent the entropy (scatter, uncertainty, variety, etc.) of variable A with all the other variables ignored, i.e. combined by summation. H(A,B,C) will similarly represent the entropy of the vector , and so on. H(A,..., N), which we can write briefly as H(*****), is the entropy of the whole set of states, with every distinction preserved. *****-I will be used to represent the set with I omitted; similarly *****-IJ will represent the set with both I and J omitted. Subscripts will be used in SHANNON's way: to show variables that have been held constant (or are assumed known, or otherwise have zero entropy)." ⁶