This website requires javascript to properly function. Consider activating javascript to get access to all site functionality.
LESSWRONG
LW
Login
Wikitags
Information theory
Edited by
So8res
,
RobertM
last updated
19th Feb 2025
The study (and
quantification)
of information, and its communication and storage.
Parents:
Mathematics
Children:
Fractional bits
n-message
and 13 more
Subscribe
2
Subscribe
2
Discussion
0
Discussion
0
Posts tagged
Information theory
Most Relevant
88
Entropy, and Short Codes
Eliezer Yudkowsky
18y
27
213
The Second Law of Thermodynamics, and Engines of Cognition
Eliezer Yudkowsky
18y
76
74
Conditional Independence, and Naive Bayes
Eliezer Yudkowsky
18y
16
173
Six (and a half) intuitions for KL divergence
CallumMcDougall
3y
27
70
Mutual Information, and Density in Thingspace
Eliezer Yudkowsky
18y
28
69
Searching for Bayes-Structure
Eliezer Yudkowsky
18y
49
246
Introduction to abstract entropy
Alex_Altair
3y
78
223
Utility Maximization = Description Length Minimization
Ω
johnswentworth
5y
Ω
52
189
Generalized Heat Engine
johnswentworth
5y
11
66
Msg Len
Zack_M_Davis
5y
4
61
You Can’t Predict a Game of Pinball
Jeffrey Heninger
2y
13
49
Eavesdropping on Aliens: A Data Decoding Challenge
anonymousaisafety
3y
9
83
A hundredth of a bit of extra entropy
Adam Scherlis
3y
4
63
Steganography in Chain of Thought Reasoning
Ω
A Ray
3y
Ω
13
58
Deconfusing Landauer's Principle
EuanMcLean
3y
15