Thanks for the interesting post! I'm pretty confused about your ablation experiments, mostly because I'm confused about the original experiment from their work.
My understanding is that their Figure 2a (animal vs mammal) is desired because the mammal token embeddings are in the top-right quadrant, whereas the non-mammal embeddings are spread around 0 on the y-axis. This resonates with our intuition that mammals should count as animals (in the right two quadrants) but also as mammals (in the top two quadrants). However, I never actually read this writt
Thanks for the interesting post! I'm pretty confused about your ablation experiments, mostly because I'm confused about the original experiment from their work.
- My understanding is that their Figure 2a (animal vs mammal) is desired because the mammal token embeddings are in the top-right quadrant, whereas the non-mammal embeddings are spread around 0 on the y-axis. This resonates with our intuition that mammals should count as animals (in the right two quadrants) but also as mammals (in the top two quadrants). However, I never actually read this writt
... (read more)