LESSWRONG
LW

ProductivityAI
Frontpage

6

[ Question ]

What is the research speed multiplier of the most advanced current LLMs?

by wunan
21st Feb 2024
1 min read
A
2
2

6

ProductivityAI
Frontpage

6

What is the research speed multiplier of the most advanced current LLMs?
5Tomás B.
3Nathan Helm-Burger
New Answer
New Comment

2 Answers sorted by
top scoring

Tomás B.

Feb 21, 2024

53

GPT-5 with a context window that can fit entire code bases is going to be very scary. Particularly if you think, as I do, that agency is going to start to work soon. I really do think at least "weak recursive self improvement" of the form of automating AI research/training loops is on the table relatively soon. 

Add Comment

Nathan Helm-Burger

Feb 23, 2024

30

Here's my prediction market on this subject: https://manifold.markets/NathanHelmBurger/gpt5-plus-scaffolding-and-inference

Add Comment
Moderation Log
Curated and popular this week
A
2
0

In Sam Altman's recent interview on Bill Gates' podcast, he said AI tools currently can speed up a programmer by about 3x. It's unclear whether he's referring to publicly available tools like copilot, or internal tools at OpenAI.

  1. Does anyone know whether he's referring to private or public tools? Is that 3x figure based on any public research?
  2. More speculatively, if programmers are sped up by 3x, how much are AI researchers sped up, particularly using whatever internal tools are currently available at OpenAI? The job involves more than just programming, but many non-programming tasks can be sped up as well.
  3. Even more speculatively, how much do you predict GPT-5 will speed up researchers at OpenAI?