LESSWRONG
LW

1278
phgubbins
291010
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
AI companies aren't really using external evaluators
phgubbins1y8-2

I had an opportunity to ask an individual from one of the mentioned labs about plans to use external evaluators and they said something along the lines of:

“External evaluators are very slow - we are just far better at eliciting capabilities from our models.”

They earlier said something much to the same effect when I asked if they’d been surprised by anything people had used deployed LLMs for so far, ‘in the wild’. Essentially, no, not really, maybe even a bit underwhelmed.

Reply
No wikitag contributions to display.
208Making a conservative case for alignment
10mo
67
62There Should Be More Alignment-Driven Startups
Ω
1y
Ω
14
67AE Studio @ SXSW: We need more AI consciousness research (and further resources)
1y
8