Information theory

Edited by So8res, RobertM last updated 19th Feb 2025

The study (and quantification) of information, and its communication and storage.

Parents:

Mathematics

Children:

Fractional bits

n-message

and 13 more

Posts tagged Information theory

11

90Entropy, and Short Codes

Eliezer Yudkowsky

18y

27

10

219The Second Law of Thermodynamics, and Engines of Cognition

Eliezer Yudkowsky

18y

76

10

75Conditional Independence, and Naive Bayes

Eliezer Yudkowsky

18y

16

9

178Six (and a half) intuitions for KL divergence

CallumMcDougall

3y

27

9

71Mutual Information, and Density in Thingspace

Eliezer Yudkowsky

18y

28

9

71Searching for Bayes-Structure

Eliezer Yudkowsky

18y

49

8

246Introduction to abstract entropy

Alex_Altair

3y

78

3

223Utility Maximization = Description Length Minimization

Ω

johnswentworth

5y

Ω

52

2

189Generalized Heat Engine

johnswentworth

5y

11

2

66Msg Len

Zack_M_Davis

5y

4

2

61You Can’t Predict a Game of Pinball

Jeffrey Heninger

3y

13

2

49Eavesdropping on Aliens: A Data Decoding Challenge

anonymousaisafety

3y

9

1

83A hundredth of a bit of extra entropy

Adam Scherlis

3y

4

1

63Steganography in Chain of Thought Reasoning

Ω

A Ray

3y

Ω

13

1

58Deconfusing Landauer's Principle

EuanMcLean

4y

15

LESSWRONG
LW

LESSWRONG
LW

Information theory