# Almost-orthogonal directions can look circular in PCA plots
* By [Linda Linsefors](/users/linda-linsefors)
* 2026-11-17 13:53:03Z
* 57 points
* Tag: [Interpretability (ML & AI)](/w/interpretability-ml-and-ai)
* Tag: [Machine Learning (ML)](/w/machine-learning-ml)
* Tag: [AI](/w/ai)
* Tag: [World Modeling](/w/world-modeling)
* Frontpage
* Comments: 7
* Post URL (HTML): [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots)
* Post URL (Markdown): [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots)
* Comments URL (Markdown): [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments)
* Post URL (Markdown, compact): [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots?compact=1](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots?compact=1)
Vectors that are arbitrarily close to orthogonal, but with a small circular correlation, will look circular when projected down to the first two principal component directions.
This might be relevant to you if you are doing mech-interp and think you are seeing circular features.
Clade made this widget for me. Feel free to play around.
```widget[gx5wgQFheuk3mFwAs]
PCA Widget
```
**Acknowledgment:** Thanks to [@philh](/api/user/philh?mention=user) for proofreading this post. Thanks to [@Lucius Bushnaq](/api/user/lblack?mention=user) for contributing one (out of four) sentences (not counting the acknowledgment section).
Top Comments Index
------------------
### Comment by [Jamie Simon](/users/jamie-simon)
* 2026-11-18 00:50:09Z
* Karma: 11
* Voting system: namesAttachedReactions
* Approval votes: 4
* Total votes: 4
* HTML permalink: [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/LTd5crZmWDii7pipG](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/LTd5crZmWDii7pipG)
* Markdown permalink: [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/LTd5crZmWDii7pipG](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/LTd5crZmWDii7pipG)
### Comment by [StefanHex](/users/stefan42)
* 2026-11-17 19:39:16Z
* Karma: 7
* Voting system: namesAttachedReactions
* Approval votes: 4
* Total votes: 4
* HTML permalink: [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/LFWGbr5sgxnEPFwvs](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/LFWGbr5sgxnEPFwvs)
* Markdown permalink: [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/LFWGbr5sgxnEPFwvs](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/LFWGbr5sgxnEPFwvs)
### Comment by [Jesse Li](/users/jesse-li)
* 2026-11-18 08:41:31Z
* Karma: 3
* Voting system: namesAttachedReactions
* Approval votes: 2
* Total votes: 2
* HTML permalink: [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/KrgZ4YMFL55kQQNGx](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/KrgZ4YMFL55kQQNGx)
* Markdown permalink: [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/KrgZ4YMFL55kQQNGx](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/KrgZ4YMFL55kQQNGx)
### Comment by [wassname](/users/wassname)
* 2026-11-17 23:19:49Z
* Karma: 1
* Voting system: namesAttachedReactions
* Approval votes: 1
* Total votes: 1
* HTML permalink: [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/zX4xKM7KoCS2AcbNp](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/zX4xKM7KoCS2AcbNp)
* Markdown permalink: [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/zX4xKM7KoCS2AcbNp](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/zX4xKM7KoCS2AcbNp)
### Navigation
* [Front page](https://www.lesswrong.com/api/home)
* [Markdown API documentation](https://www.lesswrong.com/api/SKILL.md)