# Almost-orthogonal directions can look circular in PCA plots * By [Linda Linsefors](/users/linda-linsefors) * 2026-11-17 13:53:03Z * 57 points * Tag: [Interpretability (ML & AI)](/w/interpretability-ml-and-ai) * Tag: [Machine Learning (ML)](/w/machine-learning-ml) * Tag: [AI](/w/ai) * Tag: [World Modeling](/w/world-modeling) * Frontpage * Comments: 7 * Post URL (HTML): [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots) * Post URL (Markdown): [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots) * Comments URL (Markdown): [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments) * Post URL (Markdown, compact): [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots?compact=1](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots?compact=1) Vectors that are arbitrarily close to orthogonal, but with a small circular correlation, will look circular when projected down to the first two principal component directions. This might be relevant to you if you are doing mech-interp and think you are seeing circular features. Clade made this widget for me. Feel free to play around. ```widget[gx5wgQFheuk3mFwAs] PCA Widget
``` **Acknowledgment:** Thanks to [@philh](/api/user/philh?mention=user) for proofreading this post. Thanks to [@Lucius Bushnaq](/api/user/lblack?mention=user) for contributing one (out of four) sentences (not counting the acknowledgment section). Top Comments Index ------------------ ### Comment by [Jamie Simon](/users/jamie-simon) * 2026-11-18 00:50:09Z * Karma: 11 * Voting system: namesAttachedReactions * Approval votes: 4 * Total votes: 4 * HTML permalink: [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/LTd5crZmWDii7pipG](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/LTd5crZmWDii7pipG) * Markdown permalink: [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/LTd5crZmWDii7pipG](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/LTd5crZmWDii7pipG) ### Comment by [StefanHex](/users/stefan42) * 2026-11-17 19:39:16Z * Karma: 7 * Voting system: namesAttachedReactions * Approval votes: 4 * Total votes: 4 * HTML permalink: [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/LFWGbr5sgxnEPFwvs](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/LFWGbr5sgxnEPFwvs) * Markdown permalink: [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/LFWGbr5sgxnEPFwvs](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/LFWGbr5sgxnEPFwvs) ### Comment by [Jesse Li](/users/jesse-li) * 2026-11-18 08:41:31Z * Karma: 3 * Voting system: namesAttachedReactions * Approval votes: 2 * Total votes: 2 * HTML permalink: [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/KrgZ4YMFL55kQQNGx](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/KrgZ4YMFL55kQQNGx) * Markdown permalink: [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/KrgZ4YMFL55kQQNGx](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/KrgZ4YMFL55kQQNGx) ### Comment by [wassname](/users/wassname) * 2026-11-17 23:19:49Z * Karma: 1 * Voting system: namesAttachedReactions * Approval votes: 1 * Total votes: 1 * HTML permalink: [/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/zX4xKM7KoCS2AcbNp](/posts/W9hyNv8EukB4WLniX/almost-orthogonal-directions-can-look-circular-in-pca-plots/comment/zX4xKM7KoCS2AcbNp) * Markdown permalink: [/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/zX4xKM7KoCS2AcbNp](/api/post/almost-orthogonal-directions-can-look-circular-in-pca-plots/comments/zX4xKM7KoCS2AcbNp) ### Navigation * [Front page](https://www.lesswrong.com/api/home) * [Markdown API documentation](https://www.lesswrong.com/api/SKILL.md)