Saturday, 1 November 2008

问一个问题,有谁知道

问一个问题,有谁知道热力学熵和信息熵的区别?
公式是一样的,但显然完全不同。
比方说一堆气体,热力学熵越高,说明气体分子越无序。
比方说一堆文字,信息熵越高,说明文字越有序(?)。
那么信息熵是负熵还是怎么的?

3 comments:

configerX said...

http://en.wikipedia.org/wiki/Entropy#Entropy_and_Information_theory

wren said...

The question of the link between information entropy and thermodynamic entropy is a hotly debated topic. Some authors argue that there is a link between the two,[42][43][44] while others will argue that they have absolutely nothing to do with each other.

看我问的问题多有水平……

Anonymous said...

信息的熵应该也是越无序,熵值越高。因为无序的事件,其结果是1还是0的概率越接近0.5吧?