They say this is their last fully non-reasoning model, but that research on both types will continue.
No, they said that GPT4.5 and GPT5 will be their last non-reasoning models.
They say it's currently limited to Pro users,
Meh, it's coming to plus users in ~a week.
It claims to be more accurate at standard questions and with a lower hallucination rate than any previous OAI model (and presumably any others).
I think this is a big point and a better world knowledge is going to prove tremendously useful when it comes to applying RL to base models and ... (read more)
I know this sounds fantastic but can someone please dumb down what KANs are for me, why they're so revolutionary (in practice, not in theory) that all the big labs would wanna switch to them?
Or is it the case that having MLPs is still a better thing for GPUs and in practice that will not change?
And how are KANs different from what SAEs attempt to do
not excited about this - such a coach is either going to give very politically correct opinions, or target audiences with glaring insecurities, like young or low confidence men.. just like human coaches.
If I understand this right, you train a transformer on data generated from a hidden markov process, of the form {0,1,R} and find that there is a mechanism for tracking when R occurs in the residual stream, as well as that the transformer learns the hidden markov process. is that correct?
1
No, they said that GPT4.5 and GPT5 will be their last non-reasoning models.
Meh, it's coming to plus users in ~a week.
I think this is a big point and a better world knowledge is going to prove tremendously useful when it comes to applying RL to base models and ... (read more)