LESSWRONG
LW

2768
Flying buttress
29140
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No wikitag contributions to display.
Prediction Markets Are Mediocre
Flying buttress7mo00

I came to similar conclusions after another geopolitical event few years ago.

Reply
meemi's Shortform
Flying buttress9mo40

I feels as if OpenAI acted as a client of Epoch AI ordering a math benchmark and that Epoch AI would not be working on it without this funding.

I also suspect that computer use/task execution benchmark EpochAI is hiring for currently (Technical Lead, Benchmarks) has the same arrangement with OpenAI.

Reply
meemi's Shortform
Flying buttress9mo30

William,

not exactly an answer to your question but BOTEC estimate for FrontierMath costs: $400k — $2M

Reply
meemi's Shortform
Flying buttress9mo*90

BOTEC estimate for funding: $400k — $2M

EpochAI shared two job postings on their LinkedIn few months ago that seem relevant to FrontierMath:

  • Senior Mathematician for Project Lead, AI Benchmarking
  • Senior Mathematical Problem Creator (Part-Time/Full-Time Contractor Positions)

Project lead compensation is $200k/year with expected contract length of 7 months: ~$100k.

Benchmark consists of about 1k problems, payment per problem is between $300 and $1k based on quality. Full-time contributors also have base rate of $2k/month with 2-4 months expected duration. Over 60 mathematicians have contributed.

Low amount assuming just project lead, minimally valued problems ($300), no full-time contractors, no overhead (e.g. taxes):
100k+1000×300≈400k

Medium amount assuming project lead, medium valued problems ($500), 10 full-time contractors working for 3 months, 30% of overhead:

(100k+1000×500+10×2000×3)×1.3≈900k

High amount assuming project lead, exceptional problems ($1k), 60 full-time contractors working for 3 months, 50% of overhead:
(100k+1000×1k+60×2000×3)×1.5≈2M

Reply1
19Celebrate Petrov day as if the button had been pressed
1mo
0