LESSWRONG
LW

1019
phgubbins
291010
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No wikitag contributions to display.
AI companies aren't really using external evaluators
phgubbins1y8-2

I had an opportunity to ask an individual from one of the mentioned labs about plans to use external evaluators and they said something along the lines of:

“External evaluators are very slow - we are just far better at eliciting capabilities from our models.”

They earlier said something much to the same effect when I asked if they’d been surprised by anything people had used deployed LLMs for so far, ‘in the wild’. Essentially, no, not really, maybe even a bit underwhelmed.

Reply
208Making a conservative case for alignment
10mo
67
62There Should Be More Alignment-Driven Startups
Ω
1y
Ω
14
67AE Studio @ SXSW: We need more AI consciousness research (and further resources)
1y
8