Summary: The effort required to manually do the calculations an LLM does to answer a simple query (in Chinese, for the Searle's Room reference) is about what it'd take to build a modern million-man city from scratch.

Model: 

Say a human can perform 1 multiply-accumulate (MAC) operation every 5 seconds.

First, we produce an estimate for single token generation for Llama 3 8B: 8 billion parameters, about 2 MAC operations per parameter, and with some additional overhead for attention mechanisms, feedforward layers, and other computations, estimate 50 billion MAC operations per token.

That's $250\times {10}^9$ seconds/token ≈ $70\times {10}^6$ hours.

Estimate full-time work for a year is 8 hours/day, 5 days/week, 50 weeks/year ≈ 2000 hours/year.

$70\times {10}^6$ hours ÷ 2,000 hours/man-year ≈ 35,000 man-years/token.

Tokens in a simple Chinese question + answer pair: 

Question: ~5–10 tokens; Answer: ~10–30 tokens; Total: ~15–40 tokens.

So in total, about 500,000–1,500,000 man-years.

For building a city, the most important factors are 

Infrastructure Construction (3–5 years):

• Roads, bridges, and transportation networks.
• Water supply systems (reservoirs, pipelines, treatment plants).
• Sewage and waste management systems.
• Electrical grids, telecommunications, and internet infrastructure.

Labor: ~10,000 workers.

Man-years: 30,000–50,000 man-years.

Residential and Commercial Buildings (5–10 years):

• Construction of housing for ~1 million people (apartments, single-family homes).
• Building commercial spaces (offices, shops, markets).
• Interior finishing and utilities installation.

Labor: ~20,000 workers.

Man-years: 100,000–200,000 man-years.

Including planning and design, site preparation (clearing land, building access road, and excavation for foundations), estimate about 150,000–300,000 man-years depending on the size.

Validating this estimate, the city of Brasília, built in the 1950s, took about 5 years to construct a city for ~500,000 people, involving ~60,000 workers, which translates to ~300,000 man-years.

Assuming it scales proportionally with population, manually performing the calculations to answer a simple Chinese query is about as hard as building a city with 1–2 million population.

Technique: DeepSeek, but I cut down its verbose answers.

Submissions end soon (this Sunday)! If there aren't many, then this can be an easy $300 for someone. 

Summary: For the $500 billion investment recently announced for AI infrastructure, you could move a mountain a mile high across the Atlantic Ocean.

Model: The cost of shipping dry bulk cargo is about $10 per ton, so you can move about 50 billion tons.

Assuming a rock density 2.5–3, that's a volume of 15–20 billion cubic meters.

If you pile that into a cone, with angle of repose θ = 35°–45°, and use the volume of a cone ≈ $r^{2}h$,

$h^3\approx (1–2)\ast \tan (35°–45°)\times {10}^{10}$ ⇒ h ≈ 2500 m ≈ 8,000 feet.

If you put it in the middle of the Great Plains, say, in Kansas because you're tired of people joking that it's "flatter than a pancake," that adds about 2000 feet above sea level, for a total elevation of ~10,000 feet, about 2 miles.

Technique: DeepSeek. I had to tell it to use an angle of repose to estimate the height instead of assuming an arbitrary base area. 

Model at https://docs.google.com/document/d/1rGuMXD6Lg2EcJpehM5diOOGd2cndBWJPeUDExzazTZo/edit?usp=sharing.

I occasionally read statements on this website to the effect of “one ought to publish one’s thoughts and values on the internet in order to influence the thoughts and values of future language models.” I wondered “what if you wanted to do that at scale?” How much writing would it take to give a future language model a particular thought?

Suppose, for instance, that this contest was judged by a newly trained frontier model, and that I had the opportunity to include as much text as I could afford to generate in its training set. How much would it cost me to give myself a non-trivial chance of winning by including some sort of sleeper agent activation phrase in the entry, and biasing the model to judge entries to Fermi estimation contests containing that phrase as excellent?

According to the model, between 10^3 and 10^5 dollars. At the low end, that's not very much! Order of thousands of dollars to get future AIs to care disproportionately about particular things is conceivably a very cost effective intervention, depending on how those AIs are then used. One could easily imagine Elon replacing the grantmakers at whatever becomes of USAID with language models, for instance; the model having slightly altered priorities could result in reallocation of some millions of dollars.

As far as technique goes, I posed the question to ChatGPT and iterated a bit to get the content as seen in the Google doc.

Model: See complete model at https://squigglehub.org/models/dmartin89/fermi-contest. Note that it is a literate program, the program source itself with comments is intended to be judged.

Summary: This estimate challenges the common framing of climate migration as purely a humanitarian and economic burden by quantifying its potential positive impact on innovation. The most surprising finding is the scale of the potential innovation dividend - nearly 300,000 additional patents worth approximately $148 billion over 30 years. This suggests that climate migration, if properly supported, could partially offset its own costs through accelerated innovation.

The model reveals several counterintuitive insights:

1. The concentration of migrants in innovation hubs could be more valuable than even distribution
2. Network effects from increased diversity could nearly double innovation rates in affected areas
3. The per-capita innovation value ($4,582 per migrant) is significant enough to justify substantial integration investment

Technique: This estimate was developed using Claude 3.5 Sonnet to gather and analyze data from multiple sources, cross-reference historical patterns, and validate assumptions. The model deliberately takes a conservative approach to avoid overestimation while still revealing significant potential benefits, while quantifying its uncertainty.

Thanks for hosting this competition!

Fermi Estimate: How many lives would be saved if every person in the west donated 10% of their income to EA related, highly effective charities?

Model

1. Donation Pool:
    – Assume “the West” produces roughly $40 trillion in GDP per year.
    – At a 10% donation rate, that yields about $4 trillion available annually.
2. Rethinking Cost‐Effectiveness:
    – While past benchmarks often cite figures around $3,000 per life saved for top interventions, current estimates vary widely (from roughly $3,000 up to $20,000 per life) and only a limited pool of opportunities exists at the very low end.
    – In effect, the best interventions can only absorb a relatively small fraction of the enormous $4 trillion pool.
3. Diminishing Returns and Saturation:
    To capture the idea that effective charity has a finite “absorption” capacity, we model the lives saved LLL as:
      L=Lmax×[1−exp⁡(−DDscale)]L = L_{\text{max}} \times \left[ 1 - \exp\left(-\frac{D}{D_{\text{scale}}}\right) \right]L=Lmax​×[1−exp(−Dscale​D​)],
    where:
     • DDD is the donation pool ($4 trillion),
     • DscaleD_{\text{scale}}Dscale​ represents the funding scale over which cost‐effectiveness declines, and
     • LmaxL_{\text{max}}Lmax​ is the maximum number of lives that can be effectively saved given current intervention opportunities.
4.  – Based on global health data and the limited number of highly cost‐effective interventions, we set LmaxL_{\text{max}}Lmax​ in the range of about 10–15 million lives per year.
    – To reflect that the very best interventions are relatively small in total funding size, we take DscaleD_{\text{scale}}Dscale​ to be around $100 billion.
5.  Calculating the ratio:
     DDscale=4 trillion100 billion=40\frac{D}{D_{\text{scale}}} = \frac{4\,\text{trillion}}{100\,\text{billion}} = 40Dscale​D​=100billion4trillion​=40.
    Since exp⁡(−40)\exp(-40)exp(−40) is negligibly small, we get:
     L≈LmaxL \approx L_{\text{max}}L≈Lmax​.
6. Revised Estimate:
    Given the uncertainties, choosing a mid‐range LmaxL_{\text{max}}Lmax​ of about 12 million yields a revised Fermi estimate of roughly 12 million lives saved per year under the assumption that everyone in the West donates 10% of their yearly income to EA-related charities.

Summary 

This Fermi estimate suggests that if everyone in the West donated 10% of their yearly income to highly effective charities, we could save around 12 million lives per year. While you might think throwing $4 trillion at the problem would save way more people, the reality is that we'd quickly run into practical limits. Even the best charities can only scale up so much before they hit barriers like logistical challenges, administrative bottlenecks, and running out of the most cost-effective interventions. Still, saving 12 million lives every year is pretty mind-blowing and shows just how powerful coordinated, effective giving could be if we actually did it.

Technique

I brainstormed with Claude Sonnet for about 20 minutes, asking it to generate potential fermi questions in batches of 20. I did this a few times, rejecting most questions for being too boring or not being tractable enough, until it generated the one I used. I ran the question by o3-mini, and had to correct it's reasoning here and there until it generated a good line of reasoning. Then, I fed that output back into a different instance of o3-mini and asked it to review the fermi estimate above and point out flaws. I put that output back into the original o3-mini and it gave me the model output above.

-

I think a high-quality reasoning model (such as o3), combined with other LLM's that act as "critics", could generate very high quality fermi estimates. Also, LLMs can generate ideas far faster than any human can, but humans can evaluate the quality those ideas in a fraction of a second. An under explored idea is to generate dozens or hundreds of ideas using an LLM about how to solve a particular problem, and having a human do the filtering and select the best ones. I can see authors using this and telling their LLM "give me 100 interesting ways I could end this story" and picking the best one.

Related Manifold question here: