LESSWRONG
LW

AI GovernanceWorld ModelingAI
Frontpage

190

Lessons from the Iraq War for AI policy

by Buck
10th Jul 2025
5 min read
25

190

AI GovernanceWorld ModelingAI
Frontpage

190

Lessons from the Iraq War for AI policy
92davekasten
6jmh
5Buck
-3TAG
3jmh
2[comment deleted]
28JohnofCharleston
8davekasten
5sjadler
21Unnamed
6Alex K. Chen (parrot)
3Gordon Seidoh Worley
3JohnofCharleston
7davekasten
2Gordon Seidoh Worley
2Chris_Leong
1Alex Boche
1CB
1MichaelLowe
1Noah Weinberger
0cousin_it
8Buck
12cousin_it
3Guive
2David Matolcsi
1Louis Jaburi
New Comment
25 comments, sorted by
top scoring
Click to highlight new comments since: Today at 7:14 PM
[-]davekasten2mo9210

I’m kind of confused by why these consequences didn’t hit home earlier.

I'm, I hate to say it, an old man among these parts in many senses; I voted in 2004, and a nontrivial percentage of the Lesswrong crowd wasn't even alive then, and many more certainly not old enough to remember what it was like.  The past is a different country, and 2004 especially so.  

First: For whatever reason, it felt really really impossible for Democrats in 2004 to say that they were against the war, or that the administration had lied about WMDs.  At the time, the standard reason why was that you'd get blamed for "not supporting the troops."  But with the light of hindsight, I think what was really going on was that we had gone collectively somewhat insane after 9/11 -- we saw mass civilian death on our TV screens happen in real time; the towers collapsing was just a gut punch.  We thought for several hours on that day that several tens of thousands of people had died in the Twin Towers, before we learned just how many lives had been saved in the evacuation thanks to the sacrifice of so many emergency responders and ordinary people to get most people out. 

And we wanted revenge.  We just did.  We lied to ourselves about WMDs and theories of regime change and democracy promotion, but the honest answer was that we'd missed getting bin Laden in Afghanistan (and the early days of that were actually looking quite good!), we already hated Saddam Hussein (who, to be clear, was a monstrous dictator), and we couldn't invade the Saudis without collapsing our own economy.  As Thomas Friedman put it, the message to the Arab world was "Suck on this." And then we invaded Iraq, and collapsed their army so quickly and toppled their country in a month.  And things didn't start getting bad for months after, and things didn't get truly awful until Bush's second term.  Heck, the Second Battle for Fallujah only started in November 2004.

And so, in late summer 2004, telling the American people that you didn't support the people who were fighting the war we'd chosen to fight, the war that was supposed to get us vengeance and make us feel safe again -- it was just not possible.  You weren't able to point to that much evidence that the war itself was a fundamentally bad idea, other than that some Europeans were mad at us, and we were fucking tired of listening to Europe.  (Yes, I know this makes no sense, they were fighting and dying alongside us in Afghanistan.  We were insane.)  

Second: Kerry very nearly won -- indeed, early on in election night 2004, it looked like he was going to!  That's part of why him losing was such a body blow to the Dems and, frankly, part of what opened up a lane for Obama in 2008.  Perhaps part of why he ran it so close was that he avoided taking a stronger stance, honestly.

Reply1
[-]jmh2mo6-5

I'm one of those here that remember seeing the news loop of the plane hitting the tower and the building collapsing. 

It was a defining moment and I think fixed in everyone's mind the required response (other than it wasn't quite clear who the target should be), just a Pearl Harbor was with WWII.

To some extent the "lies about WMD" is a bit of a misdirection/political spin. It is true that no stockpiles of biologic, chemical or development of nuclear weapons were ever found. Very likely never existed. But we can say the same about Iran today. At one point we could have said the same about North Korea. We do know that Iraq developed, stockpiled and used chemical (and I think some biological) weapons in the Iraq-Iran war. We also know they had a nuclear program (which I don't think was monitored by the UN until after the war and Iraq was forced to dismantle it). So I think concerns about WMD were quite legitimate even if not quite current state reality.

And yes, Kerry nearly won and the whole "where are the WMD" (including using the old Wendy's commercial "Where's the beaf?" line) was frequently mentioned after the war and in the campaigns.

I'm not entirely sure what to make of the potential for some emergence of AI related policy stances with regard to any AI moment of realization as it were (something hits the AI fan). On that I might be more inclined to point to Higg's Crisis and Leviathan line of thinking. Yes, we'll see certain policy positions elevated but how beneficial that ultimate proves I'm less sure.

Reply
[-]Buck2mo5-5

My understanding is:

The admin claimed that the evidence in favor of WMD presence was much stronger than it actually was. This was partially because they were confused/groupthinky, and partially because they were aiming to persuade. I agree that it was reasonable to think Iraq had WMDs on priors.

Reply
[-]TAG2mo-30

Iraq had and used chemical weapons in the eighties.

https://en.m.wikipedia.org/wiki/Iraqi_chemical_weapons_program

Reply
[-]jmh2mo39

Yes, the 80s would have been when the Iraq-Iran war happened, which I mention, so I don't quite understand the link to the wiki. Maybe you're emphasizing the "Very likely never existed." but that was more about the claims used for the invasion that Iraq currently had large and dangerous stockpiles on hand at the time. None were found so either they didn't really exist then or were well hidden/could be quickly dismantled without a trace. I suspect the former would be more likely -- though there is a lot of empty space and finding needles in haystacks is hard. 

Reply
[+][comment deleted]2mo20
[-]JohnofCharleston2mo2812
  • A shocking event led to the dominance of a political faction that previously had just been one of several competing factions, because that faction’s basic vibe (that we should make use of American hegemony, and that rogue states are a threat to national security) was roughly supported by the event.
  • The response was substantially driven by elite judgements rather than popular judgement.

I think this is entirely correct. The Iraq War is one of the best examples of outside-the-Overton-Window policy change in recent memory. 

In my understanding, the key trigger for the "Milton Friedman Model of Policy Change" is the Policy Community being surprised. At its core, the Overton Window is a set of norms enforced by this community. In the wake of crisis those norms aren't enforced, so rather than shifting in some linear way, the window is temporarily suspended. Then, as Friedman said, "the actions that are taken depend on the ideas that are lying around." Thalidomide is another great example of when the policy change in the wake of a crisis has little to do with the trigger other than a particular faction winning the narrative fight.

I've been meaning to write more about this, would any particular angles be helpful?

Reply
[-]davekasten2mo80

I agree with all of this -- but also do think that there's a real aspect here about some of the ideas lying around embedded existing policy constraints that were true both before and after the policy window changed.  For example, Saudi Arabia was objectively a far better target for a 9/11-triggered casus belli than Iraq (15 of the 19 hijackers were Saudi citizens, as was bin Laden himself!), but no one had a proposal to invade Saudi Arabia on the shelf because in a pre-fracking United States, invading Saudi Arabia would essentially mean "shatter the US economy into a third Arab Oil Embargo."

Reply
[-]sjadler2mo50

FWIW I’d be interested in reading more concretely about what it means for an idea to be lying around, how fleshed out it ought to be, who big important supporters tend to be in those moments of crisis, etc.

Also when big policies get adopted in a crisis, what the mix tends to be between pushing policy ideas out to folks responding to the crisis, vs being solicited for help by those people because you’re already in their personal networks.

Reply
[-]Unnamed2mo219

The Iraq war & surrounding debate was a formative political experience for me, so I have lots of thoughts/memories/opinions about it.

I agree with the basic account: shocking events (especially 9/11) gave a source of power (the White House) a lot of freedom of action, they made some bad choices about to do with that freedom of action (in part influenced by the shocking events), and other potential sources of power (e.g. US public opinion, the Senate, the UN) which could have interfered were disinclined to (which is basically what it means for one source of power to have a lot of freedom of action).

So probably the most important takeaway is that it's important who is in positions of power which might get lots of freedom of action depending on what events take place, what ideas & ability to execute effectively they have, and what views they will have after the key events have happened (as they have reactions to those events and reason to focus on the topic, pay attention to others' views on it, and think about it themselves).

 

To go into more detail:

The national mood in the US after 9/11 (and then the DC snipers and anthrax attacks) was that the world is a dangerous place, and we need to rally together to keep ourselves safe, and trust the president to do what's necessary to keep us safe. 9/11 was the big traumatic event, but the set of 3 attacks made a trend and heightened the sense that future attacks could happen to anyone anywhere at any time (as the DC snipers did) and could be technologically sophisticated (as the anthrax attacks were) and kill lots of people. That gave the Bush administration a ton of freedom of action to choose what to do, especially for things like starting wars to keep America safe from terrorism.

Why did George W. Bush choose war? My sense (in line with this article) is that Bush was a 'big picture' kind of guy who wasn't inclined to think through the nuts & bolts of 'what is this going to accomplish' and 'how else might this course of action turn out, besides going the way we want it to'. He tended to latch onto a broad narrative, and in the wake of 9/11 a narrative he found appealing was of himself as a wartime leader, fighting for freedom & democracy against terror & bad guys. The Afghanistan war on its own wasn't enough to support this narrative so they were looking for other things to do, and Saddam Hussein was the obvious next bad guy sitting around, someone who we had unfinished business with. That Scholar's Stage article claims (and I find it plausible) that there wasn't actually much focused discussion within the administration about whether it was a good idea to go to war with Iraq.

The faction within the administration that had already been pushing for war with Iraq was a big part of what made Iraq the obvious next target, but that wasn't the whole story. As the Scholar's Stage article discusses, some people pushing for the war in 2002 had been part of the previous Iraq war in 1991, where they'd decided that it was imprudent to remove Saddam Hussein from power, and hadn't openly changed their minds and been pushing for war in the interim. 

Two of the main potential barriers to the White House's freedom of action in choosing to go to war in Iraq were getting approval from Congress and the United Nations. I think that the zeitgeist of trusting the president to keep us safe played a huge role in getting Congress's approval, and a weaker variant of that zeitgeist combined with American power helped with (effectively) getting UN approval. It also helped that both happened before the weapons inspectors were allowed back into Iraq. The case for war looked weaker after the weapons inspectors were allowed in and didn't find signs of the alleged WMD programs, but by that point there was a lot of momentum towards war and the Bush administration had already gotten the authority they needed. France had pushed back on giving that authority through the UN - they wanted a two-resolution plan where first the UN would demand that Iraq let weapons inspectors in, and then after the weapons inspections the UN would reconsider whether to authorize war - and wound up reaching a compromise with the US where they made the wording of the first UN resolution ambiguous so that the US could say that the resolution authorized the war without requiring a second resolution and France could say that they hadn't supported that. (This is the dispute that led to french fries being called "freedom fries" and the phrase "cheese-eating surrender monkeys" surging in popularity.)

 

I also have a lot of thoughts about the Iraq war debate, since that is what I was most immersed in at the time, though in hindsight a lot of that seems mostly epiphenomenal. This is more of a thought dump & less focused, but I'll share anyways since some of the details & texture seem relevant:

The Bush administration's public case for the war was more like a marketing campaign than part of a public debate over what to do. They talked a lot about how bad Saddam Hussein was (often citing stuff he'd done in the 1980s); this could be used as part of a coherent argument (and therefore he is likely to do such-and-such) but often it was just presented as an emotionally resonant argument fragment - a suggestive fact which felt like it fit with being in favor of a war to remove him from power. There were lots of mentions of 9/11 and terrorism in the context of talking about Iraq & Saddam Hussein; they weren't explicitly claiming that Hussein had contributed to the 9/11 attack but they did manage to leave a majority of the US believing that he had been involved in 9/11 according to polls at the time. There was also a lot of talk about WMDs, some of it referencing intelligence that turned out to be inaccurate about Iraq's weapons programs (especially chemical & biological), but much of it framed more like 'it would be bad if Saddam Hussein got nuclear weapons' (but rhetorically punchier) or using sleight of hand with the term "WMD" to basically say 'we have evidence that Iraq has banned chemical weapons programs, and it would be bad if they had nukes'.

There was something more like an actual debate over whether it was a good idea to go to war with Iraq (the Slate dialogue archived here, beginning with this article, provides a pretty good snapshot of the higher quality portion of that debate). That debate took place on a slanted playing field where the pro-war side had the mantle of the zeitgeist on their side, and the anti-war side was generally on the defensive. e.g., There was often an implicit or explicit question of whether opponents of the war were apologists for Saddam Hussein, and so people making an argument against the war might head it off by including something about how they agree that Saddam Hussein is a bad person who has done some awful things. Whereas it was rarer for war proponents to include something about how Saddam Hussein hadn't been involved in 9/11, or to get pushback for not including that (though it did sometimes happen, especially in higher quality debates or discussions among people who were left-of-center or more distrusting of the Bush administration).

There were a wide range of pro-war cases, including (more on the left) "liberal internationalists" who wanted there to be more constitutional liberal democracies and thought that toppling a bad government and replacing it with a good one was a feasible and good thing to do, and might spread to more of the middle east and make the world a safer place. Others (more on the right) wanted the US to kick some ass so that people/countries would be afraid of getting America mad at them, and that this would help keep us safe. Or, more viscerally & less strategically, some just wanted to get back at people like the ones who had attacked us. There was some tension between these views, and not much effort to create a single coherent view out of them; they were all welcomed into the pro-war coalition.

I think part of the reason that support for the war faded gradually over the years, rather than evaporating during the first year of the war when it became apparent that Iraq didn't have meaningful WMD programs (or before the war when the weapons inspections didn't find anything) is that there were so many different cases for war. Partly this is because there were multiple coherent views on the point of the war that got discredited at different times - getting bogged down in a seemingly endless quagmire eventually undermined the "we'll kick ass so hard that others will be afraid to cross us because they might be next", and the developments of the new Iraqi government eventually undermined the liberal internationalist case, but those took longer than the WMD info. But I think a bigger part was that the pro-war attitude was more like vibes and side-taking rather than specific arguments about a concrete purpose for the war - see the post-9/11 rallying around the flag, the backlash against France, the "you're with us or your against us" talk & attitude, etc. Much of the debate & discussion over the war was more like this kind of side-taking than like arguments over whether we should go to war. Another example: saying that the war wouldn't succeed at accomplishing its proponents goals was often treated as being "defeatist" and felt to some degree like it was siding against the war and against the US. To some degree this side-taking intensified after the start of the war, because then the pro-war side was the American side.

Reply
[-]Alex K. Chen (parrot)2mo64

Eg such an incident could trigger a new "Patriot Act", except this time (in an administration that has zero qualms), it could go much much deeper.

Reply
[-]Gordon Seidoh Worley2mo30

Some quick thoughts:

  • there's value in diversified positions (including ones that lead to the same outcomes)
    • arguably the PNAC position got a foothold because its case generalized in one logical step from the events, and importantly another position could have taken its place if it had generalized in one step in the same way
    • similarly, you can imagine that multiple cases were being made for regime change in Iraq; the PNAC one just happens to offer a theory for why regime change was necessary that seemed plausible in a way that other theories maybe didn't (even though they advocated for the same thing)
  • there's value in being close to power (makes the position more accessible as an option for response)
  • the most important thing is to get your position taken as the obvious next step. the most important thing is also to make sure the policy gets implemented in a sensible way if you think it's sensible
  • there's likely a kind of "position warfare" going on in policy circles to make sure your position is the one that's primed to win if the conditions for its enactment are suddenly met
Reply1
[-]JohnofCharleston2mo30
  • there's likely a kind of "position warfare" going on in policy circles to make sure your position is the one that's primed to win if the conditions for its enactment are suddenly met

I'm not sure how much "position warfare" happens for all but the most predictable events. After policy surprises there's usually a big fight to claim credit for predicting the crisis and a mandate for what to do about it. People and organizations certainly prepare for that (and I think our community should prepare more), but it's more by making predictions, finding allies, refining arguments, and writing plans.

Reply
[-]davekasten2mo71

I think this is somewhat true, but also think in Washington it's also about becoming known as "someone to go talk to about this" whether or not they're your ally.  Being helpful and genial and hosting good happy hours is surprisingly influential.

Reply
[-]Gordon Seidoh Worley2mo20

Maybe "warfare" is the wrong metaphor here, but there's a kind of constant competition for idea salience since policy makers can only know or care about so many possible ideas. Out of all the stuff they could think about, they will maybe consider 3 options max to respond to a crisis, not 10 or 100, so the question becomes how does an idea get to become one of those 3.

Reply
[-]Chris_Leong2mo2-2

I’m kind of confused by why these consequences didn’t hit home earlier


Many people who were opposed to the war focused on less persuasive argumentative approachs such as implying that anyone who supported it was a warmonger, calling Bush a war criminal or focusing purely on the number of deaths.

I suspect that people were more focused on expressing their frustration or signalling their tribal allegience rather than trying to actually change anyone's mind and that likely contributed to this delay.

Reply
[-]Alex Boche2mo10

FWIW, I listened to the following book about the war and it seemed quite good. I think it's the second book in a series about the war. 

"The Endgame: The Inside Story of the Struggle for Iraq, from George W. Bush to Barack Obama" by Bernard E. Trainor and Michael R. Gordon.

Reply
[-]CB2mo1-2

I think this post is missing a huge factor : oil.

“Of course it’s about oil; we can’t really deny that,” said Gen. John Abizaid, former head of U.S. Central Command and Military Operations in Iraq, in 2007. 

The Bush family had massive ties with the oil industry, including election funds, and there were apparently plans to invade Iraq before 9/11 according to former Treasury secretary (without a politically acceptable opportunity to do so, though).

More data in this article and the excellent book 'Oil, power and war', which shows that getting oil has always been a major factor in geopolitics over the last 100 years. 

Oil is not like any other resource - without it, the world's economies, food system and armies would crash within a week. Access to energy and resources is likely to be a major factor in political decisions as well.

Reply
[-]MichaelLowe2mo10

I expect this to be a good but not perfect analogy to how an AI related catastrophic event could trigger political change. My understanding is that a crucial part of public discourse was, as other commenters allude to, a perceived taboo against being anti-war, such that even center-left reputable mainstream sources did not in fact doubt the evidence for Iraq's alleged WMD. Likely a crucial component is a sort of moral dimension to the debate ("are you suggesting we should not do anything about 9/11?") that prevents people from speaking out. 

I expect an AI related fiasco to have less of this moral load, and instead think that scenarios like the Whenzhou train accident or the bridge collapse in Italy 2018 are more analogous in that the catastrophe is a clear accident, that while perhaps caused by recklessness was not caused by a clearly evil entity. The wiki article on the bridge collapse makes it sound like in the aftermath there was a lot of blaming going on, but no mention of any effort to invest more into infrastructure.

Reply
[-]Noah Weinberger2mo10

Good evening.

I really enjoyed reading your analysis, especially as someone who's probably younger than many users here; I was born the same year this war started.

Anyway, my question for you is this. You state that 

"If there’s some non-existential AI catastrophe (even on the scale of 9/11), it might open a policy window to responses that seem extreme and that aren’t just direct obvious responses to the literal bad thing that occurred. E.g. maybe an extreme misuse event could empower people who are mostly worried about an intelligence explosion and AI takeover."

I've done thought experiments and scenarios in sandbox environments with many SOTA AI models, and I try to read a lot of Safety literature (Nick Bostrom's 2014 Superintelligence comes to mind, it's one of my favorites). My question has to do with what you think the most "likely" non-existential AI risk is? I'm of the opinion that persuasion is the biggest non-existential AI risk, both due to psychopancy and also manipulation of consumer and voting habits.

Do you agree or is there a different angle you see for non-existential AI risk?

Reply
[-]cousin_it2mo0-5

Are you sure it makes sense to go into these details? After all, the US has waged many wars since WWII, and the Iraq war doesn't seem unusual among them. So maybe we shouldn't explain it by unusual events; the right explanation would have to work for the whole reference class.

Reply
[-]Buck2mo8-3

I think that the Iraq war seems unusual in that it was entirely proactive. Like, the war was not in response to a particular provocation, it was an entrepreneurial war aimed at preventing a future problem. In contrast, the wars in Korea, the Gulf, and (arguably) Vietnam were all responsive to active aggression.

Reply
[-]cousin_it2mo124

I think the Bay of Pigs, Grenada, Panama were proactive. Vietnam too: the Gulf of Tonkin story kinda fell apart later, so did domino theory (the future problem they were trying to prevent), and anyway US military involvement in Vietnam started decades earlier, to prop up French colonial control.

Maybe to summarize my view, I think for a powerful country there's a spectrum from "acting as police" to "acting as a bully", and there have been many actions of the latter kind. Not that the US is unique in this, my home country (Russia) does its share too, as do others, when power permits.

Reply
[-]Guive2mo*30

Vietnam was different because it was an intervention on behalf of South Vietnam which was an American client state, even if the Gulf of Tonkin thing was totally fake. There was no "South Iraq" that wanted American soldiers.

Reply
[-]David Matolcsi2mo20

There was no "South Iraq" that wanted American soldiers.

There basically was, though north not south. Kurdistan was functionally independent at the start of the Iraq War, but were under threat from the Saddam regime that previously waged some very brutal wars against them. Kurdistan very much wanted American soldiers, and the anniversary of American victory in Iraq is still a public holiday in Iraqi Kurdistan to this day.

Reply
[-]Louis Jaburi2mo10

And in fact south Iraq was and is dominantly Shiite (and thus also more susceptible to Iranian influence). They too revolted against Saddam after the first gulf war https://en.m.wikipedia.org/wiki/1991_Iraqi_uprisings and were euphoric about his fall

Reply
Moderation Log
More from Buck
View more
Curated and popular this week
25Comments
Deleted by TAG, 07/11/2025
Reason: Comment deleted by its author.

I think the 2003 invasion of Iraq has some interesting lessons for the future of AI policy.

(Epistemic status: I’ve read a bit about this, talked to AIs about it, and talked to one natsec professional about it who agreed with my analysis (and suggested some ideas that I included here), but I’m not an expert.)

For context, the story is:

  • Iraq was sort of a rogue state after invading Kuwait and then being repelled in 1990-91. After that, they violated the terms of the ceasefire, e.g. by ceasing to allow inspectors to verify that they weren't developing weapons of mass destruction (WMDs). (For context, they had previously developed biological and chemical weapons, and used chemical weapons in war against Iran and against various civilians and rebels). So the US was sanctioning and intermittently bombing them.
    • After the war, it became clear that Iraq actually wasn’t producing WMDs. This obviously begs the question of why they rejected the inspections. I think it was a combination of them wanting strategic ambiguity to deter their regional enemies, and it being desirable and politically beneficial to reject inspections that they viewed as violations of their sovereignty.
      • They allowed inspections again when it looked like they were about to be invaded, but the invasion happened anyway.
  • One faction of the Republican political establishment, centered around a think-tank called “Project for the New American Century” (PNAC), from 1997 was advocating (e.g. here) regime change in Iraq, because they thought Iraq posed a risk of using WMDs against America or American allies, and perhaps because they thought nation-building was good for American security.
    • At the time, the track record of nation-building looked somewhat better, because the recent American experiences with it were Germany and Japan.
  • When Bush ran for president in 1999, he criticized Clinton’s foreign interventions and said he opposed nation-building and advocated a “humble” foreign policy. His campaign emphasized domestic priorities.
  • His staff had a mix of views on foreign policy.
    • The PNAC/“neoconservative” faction, including Vice President Cheney and Secretary of Defense Rumsfeld, wanted to exploit American hegemony to promote democracy and topple regimes they disliked.
    • Secretary of State Powell and the State department were cautious and opposed to unilateral action that might upset allies.
    • National Security Advisor Rice, who is a USSR scholar, was mostly focused on great power competition with Russia and China.
    • Many other senior staff were focused on domestic issues.
  • Before 9/11, Bush wasn’t paying that much attention to foreign policy, and the admin didn’t really do much on it, and none of those factions were dominant. There’s no way they would have invaded Iraq.
  • Then 9/11 happened.
  • Bush and America were scared and vengeful. This was probably the biggest shock since World War 2. It seemed plausible that this was the beginning of a trend of massive terrorist attacks.
    • Cheney in particular was terrified of the prospect of WMDs being used for much larger-scale acts of terrorism. (He seems like the kind of guy who worries a lot about novel extreme threats. For example, he’d previously been involved in a bunch of continuity-of-government exercises.) He was concerned by wargames indicating that millions would die if a terrorist attacked an American city with smallpox.
  • Bush kept asking about whether there’s plausibly a connection between 9/11 and Iraq. There wasn’t.
    • But Iraq seemed vaguely like a threat to American national security. And the people who had already wanted to invade Iraq now found it easier to argue for it, by noting that it’s dangerous to have a state sponsor of terrorism that’s known to make WMDs.
    • Many people in the admin, and then in the public, believed Iraq had WMDs. This was false. The admin made this mistake because of some mix of confirmation bias and political pressures to advocate the invasion, and then non-admin people deferred too much to the admin (whose evidence was in substantial part classified). (And maybe it was partially overcorrection: the intelligence community had underestimated the state of the Iraqi WMD programs before the Gulf War, e.g. they thought Iraq was further away from developing nuclear weapons than it was, and obviously they were traumatized by their failure to pay more attention to the pre-9/11 evidence for an imminent al-Qaeda terrorist plot.)
  • They invaded.
    • (Not relevant for the main point here, but they quickly made egregious errors like firing most of the Iraqi army and government, without which the nation-building might have succeeded.)

Takeaways

A few parts of this story stood out to me as surprisingly relevant to how AI might go:

  • A shocking event led to the dominance of a political faction that previously had just been one of several competing factions, because that faction’s basic vibe (that we should make use of American hegemony, and that rogue states are a threat to national security) was roughly supported by the event.
  • The response was substantially driven by elite judgements rather than popular judgement. Invading Iraq wasn’t called for by the American population until the admin started advocating for it; it was just vaguely related, semi-justifiable, and popular among a particular set of elites.
  • The response involved some generalization and some scope sensitivity. The admin was terrified of bigger attacks, especially ones using chemical weapons and biological weapons.
    • This was notably completely absent in the reaction to covid or the Spanish flu. One person I spoke to discussed evidence that this is because humans have a very different reaction to disease than to other types of threats.
  • The response was incompetently executed and had awful consequences.
    • And this failure caused huge problems for people who supported it (like Hillary Clinton and the Republican establishment) and was a huge boon for its opponents (most famously Obama, also Bernie Sanders).
    • I’m kind of confused by why these consequences didn’t hit home earlier. By the time of the 2004 presidential election, it was pretty clear that Iraq didn’t have WMDs. I would have thought that the Democratic nominee should have centered the messaging “Bush told us that secret intelligence indicated that Iraq had WMDs, and that because of this we needed to invade. But that seems to have been totally and predictably wrong and led us into a dumb war. Such an egregious error disqualifies you as President.” Kerry (the Democratic nominee) went much softer than that. This was probably partially because he had voted in support of the Iraq war, so he couldn’t be too harsh on the decision. (Matthew Yglesias has a good article that discusses the history of support for the Iraq war.)

So to spell out some possibilities this implies about AI:

  • If there’s some non-existential AI catastrophe (even on the scale of 9/11), it might open a policy window to responses that seem extreme and that aren’t just direct obvious responses to the literal bad thing that occurred. E.g. maybe an extreme misuse event could empower people who are mostly worried about an intelligence explosion and AI takeover.
  • Those factions might make bad policy decisions or execute terribly on them.