LESSWRONG
LW

Interpretability (ML & AI)Machine Learning (ML)AI
Personal Blog

11

Neural network polytopes (Colab notebook)

by Zach Furman
21st Apr 2023
1 min read
0

11

This is a linkpost for https://colab.research.google.com/github/zfurman56/polytopes/blob/main/Polytopes.ipynb
Interpretability (ML & AI)Machine Learning (ML)AI
Personal Blog

11

New Comment
Moderation Log
More from Zach Furman
View more
Curated and popular this week
0Comments

The polytope theory of neural networks (also known as the "spline theory of deep learning") seeks to explain (ReLU) neural networks based on their piecewise linear regions. This gives a helpful intuition for how neural networks approximate functions, as well as a potential avenue for interpretability research. For anyone who wants to engage directly with the topic, I put together a small Colab notebook, with interactive 2D and 3D visuals.