This is a special post for quick takes by Kaj_Sotala. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Similar to other people's shortform feeds, short stuff that people on LW might be interested in, but which doesn't feel like it's worth a separate post. (Will probably be mostly cross-posted from my Facebook wall.)
So I read another take on OpenAI's finances and was wondering, does anyone know why Altman is doing such a gamble on collecting enormous investments into new models in the hopes that they'll get sufficiently insane profits to make it worthwhile? Even ignoring the concerns around alignment etc., there's still the straightforward issue of "maybe the models are good and work fine but aren't good enough to pay back the investment".
Even if you did expect scaling to probably bring in huge profits, naively it'd still be wiser to pick a growth strategy that didn't require your company to become literally the most profitable company in the history of all companies or go bankrupt.
The obvious answer is something like "he believes they’re on the way to ASI and whoever gets there first, wins the game", but I'm not sure if it makes sense even under that assumption - his strategy requires not only getting to ASI first, but never once faltering on the path there. Even if ASI is really imminent but it only takes like two years longer than he expected, that alone might be enough that OpenAI is done for. He could have raised much more conservative investment and still been in the game - especially since much of the current arms race is plausibly a response to the sums OpenAI has been raising.
According to an external report last year, OpenAI was projected to burn through $8 billion in 2025, rising to $40 billion in 2028. Given that the company reportedly predicts profitability by 2030, it's not hard to do the math.
Altman's venture projects spending $1.4 trillion on datacenters. As Sebastian Mallaby, an economist at the Council on Foreign Relations, notes, even if OpenAI rethinks those limerence-influenced promises and "pays for others with its overvalued shares", there's still a financial chasm to cross. Mallaby isn't the only one thinking along these lines, as Bain & Company reported last year that, even with the best outlook, there's at least a $800 billion black hole in the industry.
Because the AI god might happen in 2033 or something, after OpenAI mostly or fully goes out of business (following the more bubble-pilled takes), in which case only the more conservative path of Anthropic or the more balance sheet backstopped path of GDM let these AI companies compete at that time.
So it's insufficient to only care about the AI god, it's also necessary to expect it on a specific timeline. Or, as I argue in a sibling comment, this behavior plausibly isn't actually as risky (for the business) as it looks.
-1MP
Of course being right is better than being wrong. Ideally he should know the exact date of the arrival of the Superintelligence and organize finances for that.
But it seems to me that he has the best shot of creating the AI god with his current process.
Similar to other people's shortform feeds, short stuff that people on LW might be interested in, but which doesn't feel like it's worth a separate post. (Will probably be mostly cross-posted from my Facebook wall.)