I am making some more progress with the entropy angle. But there is enormous confusion in terminology and fundamental concepts when it comes to entropy.
In various journal papers, “entropy” has been taken to mean information, randomness, disorder, uncertainty, increased order. In others, it is “negentropy” that takes these meanings.
A note on the NIH website talks about “Information is not Entropy, Information is not Uncertainty,” and has a nice quote:
The story goes that Shannon didn’t know what to call his measure so he asked von Neumann, who said `You should call it entropy … [since] … no one knows what entropy really is, so in a debate you will always have the advantage’
More as I clarify my thinking and stick to one set of terminology and concepts.
Post a Comment