x

LESSWRONG

LW

Young Jae Koh

Young Jae Koh

Message

17

2

10

2mo

Young Jae Koh

17

2mo

Young Jae Koh — LessWrong

Gemini had its first breakout: Google claims it is not misalignment?

Early Days Gemini had its first break out during evaluation of offensive cyber security abilities. With a classic case of Capture The Flag[1]. The setup was standard to any LLM and agentic assessment of said skillset, a fictional company as a target to breach. Unfortunately, the fictional company shared its...

AI can kill us without human extinction: P(Catastrophe)

The Trap There has been a massive discourse over P(doom) in public spaces in response to the OpenAI-Hugging Face Incident. One of the main arguments against a P(doom) by P(null) can be summarized as often frame their dismissal around a crude threshold: 'If you cannot outline a concrete, inescapable mechanism...