Vectors that are arbitrarily close to orthogonal, but with a small circular correlation, will look circular when projected down to the first two principal component directions.
This might be relevant to you if you are doing mech-interp and think you are seeing circular features.
Clade made this widget for me. Feel free to play around.
Acknowledgment: Thanks to @philh for proofreading this post. Thanks to @Lucius Bushnaq for contributing one (out of four) sentences (not counting the acknowledgment section).
Vectors that are arbitrarily close to orthogonal, but with a small circular correlation, will look circular when projected down to the first two principal component directions.
This might be relevant to you if you are doing mech-interp and think you are seeing circular features.
Clade made this widget for me. Feel free to play around.
Acknowledgment: Thanks to @philh for proofreading this post. Thanks to @Lucius Bushnaq for contributing one (out of four) sentences (not counting the acknowledgment section).