This website requires javascript to properly function. Consider activating javascript to get access to all site functionality.
LESSWRONG
LW
Login
1541
Wikitags
Information theory
Edited by
So8res
,
RobertM
last updated
19th Feb 2025
The study (and
quantification)
of information, and its communication and storage.
Parents:
Mathematics
Children:
Fractional bits
n-message
and 13 more
Subscribe
Discussion
2
Subscribe
Discussion
2
Posts tagged
Information theory
Most Relevant
11
90
Entropy, and Short Codes
Eliezer Yudkowsky
18y
27
10
219
The Second Law of Thermodynamics, and Engines of Cognition
Eliezer Yudkowsky
18y
76
10
75
Conditional Independence, and Naive Bayes
Eliezer Yudkowsky
18y
16
9
175
Six (and a half) intuitions for KL divergence
CallumMcDougall
3y
27
9
71
Mutual Information, and Density in Thingspace
Eliezer Yudkowsky
18y
28
9
70
Searching for Bayes-Structure
Eliezer Yudkowsky
18y
49
8
246
Introduction to abstract entropy
Alex_Altair
3y
78
3
223
Utility Maximization = Description Length Minimization
Ω
johnswentworth
5y
Ω
52
2
189
Generalized Heat Engine
johnswentworth
5y
11
2
66
Msg Len
Zack_M_Davis
5y
4
2
61
You Can’t Predict a Game of Pinball
Jeffrey Heninger
3y
13
2
49
Eavesdropping on Aliens: A Data Decoding Challenge
anonymousaisafety
3y
9
1
83
A hundredth of a bit of extra entropy
Adam Scherlis
3y
4
1
63
Steganography in Chain of Thought Reasoning
Ω
A Ray
3y
Ω
13
1
58
Deconfusing Landauer's Principle
EuanMcLean
3y
15