Do tabular foundation models repair themselves?
TL;DR * Ablation is a widely adopted technique in mechanistic interpretability research. * Self-repair invalidates conclusions drawn from ablation experiments. * While self-repair is prevalent in language models, we ask whether it exists in tabular foundations models (TFMs). * Our experiments on 4 SOTA tabular foundation models and 15 binary...
Aug 262