happy friday

Meta AI (FAIR) latest paper integrates system-1 and system-2 thinking into reasoning models. Basically, it introduces the term "Dualformer" which integrates both system-1 (fast-thinking) and system-2 (slow-thinking) into the transformer to improve its reasoning capability. The high level idea is to train the model with "randomized trace", which randomly drop...