Davey Morse's Shortform

Davey Morse

Davey Morse's Shortform

5th Feb 2025

1 min read

2

This is a special post for quick takes by Davey Morse. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.

Rendering 0/130 comments, sorted by

top scoring

(show all) Click to highlight new comments since: Today at 9:23 PM

Moderation Log

Davey Morse's Shortform

by Davey Morse

5th Feb 2025

1 min read

130

2

This is a special post for quick takes by Davey Morse. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.

Rendering 0/130 comments, sorted by

top scoring

(show all) Click to highlight new comments since: Today at 9:23 PM

Moderation Log

More from Davey Morse

Curated and popular this week

130Comments

130

Davey Morse's Shortform — LessWrong

Comment Permalink

Davey Morse1y*1-1

I'm thinking often about whether LLM systems can come up with societal/scientific breakthrough.

My intuition is that they can, and that they don't need to be bigger or have more training data or have different architecture in order to do so.

Starting to keep a diary along these lines here: https://docs.google.com/document/d/1b99i49K5xHf5QY9ApnOgFFuvPEG8w7q_821_oEkKRGQ/edit?usp=sharing

Showing 3 of 4 replies (Click to show all)

dr_s1y30

I mean, GPT-5 getting 43% of PhD problems right isn't particularly bad. I don't know about making new insights but it doesn't seem like it would be unachievable (especially as it's possible that prompting/tooling/agent scaffolding might compensate for some of the problems).

2silentbob1y

Science bench is made by a Christian Stump. LLMs are literally stumped.

1Davey Morse1y

thanks for sending science bench in particular.

See in context