LESSWRONG
Wikitags
LW

1

Information theory

1

Written by So8res, RobertM last updated 19th Feb 2025

The study (and quantification) of information, and its communication and storage.

Parents:

Children:

Fractional bits

and 13 more

Posts tagged Information theory

11

86Entropy, and Short Codes

Eliezer Yudkowsky

17y

27

10

203The Second Law of Thermodynamics, and Engines of Cognition

Eliezer Yudkowsky

17y

76

9

168Six (and a half) intuitions for KL divergence

CallumMcDougall

2y

27

9

66Searching for Bayes-Structure

Eliezer Yudkowsky

17y

49

8

237Introduction to abstract entropy

2y

78

3

214Utility Maximization = Description Length Minimization

4y

44

1

42Interpretability as Compression: Reconsidering SAE Explanations of Neural Activations with MDL-SAEs

Kola Ayonrinde, Michael Pearce, Lee Sharkey

7mo

8

1

17Law without law: from observer states to physics via algorithmic information theory

6y

6

1

13Revisiting the Manifold Hypothesis

1y

19