Language Entropy(streams.place) |
Language Entropy(streams.place) |
Prediction and Entropy of Printed English, Shannon 1951 https://www.princeton.edu/~wbialek/rome/refs/shannon_51.pdf
The author conflates "abstract words" with obscurity, implying reduced understanding, but the importance of this is knowability - even if the word is abstract the concept can be discerned (although may require a dictionary and thesaurus), when we move away from diverse, abstract, or obscure words separated from the closely related synonymous we make the conveyed and intended meaning of the sentence in which it is used much harder to know, and no external reference could enlighten us.
> f(word) -> R
What on earth is that? If f === "the meaning of", we'll all have different R's.