Alan E Dunne

Wiki Contributions


Is martingale different from conservation of expected evidence?

With Respect

       Given that in more than a third of the cases where GPT and the answer set disagreed you thought GPT was right and the answer set was wrong, did you check for cases where GPT and the answer set agreed on an answer you thought was wrong?

    Yours Sincerely

Astral Codex Ten:

"Finally, we can test our entire pipeline by deliberately training misaligned models, and confirming that our techniques detect the worst kinds of misalignments (adversarial testing)."

In a "heatplot" or plots cf

You could also study the distribution of correlation strengths found over the range of correlations tested, possible, seeing how it compares to what would be expected by chance.

skeptical reaction with one expression of support:

Load More