LESSWRONG
LW

MichaelEinhorn
51010
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No wikitag contributions to display.
Broad Basins and Data Compression
MichaelEinhorn3y33

Would be interesting to try to distinguish between 3 types of dimensions. Number of dimensions that leave the set, number of dimensions in the set due to trivial params, and number of dimensions in the set due to equally good but functionally different models.

Especially if it turns out it is attracted to maximum trivial params, but not maximum dimensionality overall.

Reply
53Mode collapse in RL may be fueled by the update equation
Ω
2y
Ω
10
52Race Along Rashomon Ridge
Ω
3y
Ω
16