I still have one point that is not really clear: why 1 bit information (Shannon entropy (H)) is equal to 1 bit (k ln2) thermodynamic entropy (S). I have zero background in thermodynamics, and the thermodynamic entropy definition is so hard to interpret (what is a microstate, quantitatively speaking?)
I still have one point that is not really clear: why 1 bit information (Shannon entropy (H)) is equal to 1 bit (k ln2) thermodynamic entropy (S). I have zero background in thermodynamics, and the thermodynamic entropy definition is so hard to interpret (what is a microstate, quantitatively speaking?)