x

LESSWRONG
LW

Singular Learning Theory — LessWrong

Singular Learning Theory

Edited by DanielFilan last updated 20th Jun 2023

Singluar learning theory is a theory that applies algebraic geometry to statistical learning theory, developed by Sumio Watanabe. Reference textbooks are "the grey book", Algebraic Geometry and Statistical Learning Theory, and "the green book", Mathematical Theory of Bayesian Statistics.

1

1

Posts tagged Singular Learning Theory

6

92DSLT 0. Distilling Singular Learning Theory

2y

7

6

60DSLT 1. The RLCT Measures the Effective Dimension of Neural Networks

2y

10

6

36DSLT 3. Neural Networks are Singular

2y

5

6

31DSLT 2. Why Neural Networks obey Occam's Razor

2y

15

5

201Neural networks generalize because of this one weird trick

3y

35

4

92Singular learning theory: exercises

1y

6

3

188Announcing Timaeus

Jesse Hoogland, Daniel Murfet, Alexander Gietelink Oldenziel, Stan van Wingerden

2y

15

3

173Timaeus's First Four Months

Jesse Hoogland, Daniel Murfet, Stan van Wingerden, Alexander Gietelink Oldenziel

2y

6

3

95Investigating the learning coefficient of modular addition: hackathon project

Nina Panickssery, Dmitry Vaintrob

2y

5

3

90Growth and Form in a Toy Model of Superposition

Liam Carroll, Edmund Lau

2y

7

3

62Spooky action at a distance in the loss landscape

Jesse Hoogland, Filip Sondej

3y

4

3

37Gradient surfing: the hidden role of regularization

3y

9

3

34DSLT 4. Phase Transitions in Neural Networks

2y

3

2

194Towards Developmental Interpretability

Jesse Hoogland, Alexander Gietelink Oldenziel, Daniel Murfet, Stan van Wingerden

2y

10

2

114From SLT to AIT: NN generalisation out-of-distribution

3mo

8

Load More (15/51)

Add Posts