LESSWRONG
LW

2242
brockmanmatt
16030
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No posts to display.
No wikitag contributions to display.
$1000 bounty for OpenAI to show whether GPT3 was "deliberately" pretending to be stupider than it is
brockmanmatt5y*40

I don't think it's a BPE issue but not sure. I'd guess it's closer to the parity issue. It has a hard time implicitly counting in general.

edit: thanks, i know how to link now.

Reply
$1000 bounty for OpenAI to show whether GPT3 was "deliberately" pretending to be stupider than it is
brockmanmatt5y70

It seems to just do really bad with parentheses on their own. It can fix them with like... f(f(f(x))) but not '((())' type situations (I'm just using the beta).

Code: https://gist.github.com/brockmanmatt/aea4fc4a962188f85d83db761bf0ac50

Reply