I think you have profoundly failed to reckon with how American colonialism got started, what its ostensible values and justification were at the time, and what the results were in practice. You have allowed the winners to write the history book in your head. By allowing a rosy interpretation of the results to retroactively justify the historical means and intended ends, you are setting the stage for monstrosities of a similar nature to be carried out by anyone who can convince themselves that they are on the side of Good.
"Let goodness conquer all it can defend" as a statement on American colonialism is deeply perverse - colonial atrocities were not "goodness conquering", they were merely conquering. The resulting goodness was secondary and structurally undermined by the conditions of its arising, which this post weakly protests at and refuses to disavow, and further undermined by the conditions of its supposed defense, which this post fails to even acknowledge as a factor.
The processes of the conquering and of the defense matter! Goodness that conquers by means that fail to serve the good more broadly is destined to further failures - the repeatedly-shrunken reservations the US deigns to allow indigenous americans to live on are testament to the failures of the supposed goodness that conquered this land. Goodness that defends itself in ways that undermine its goodness is destined to decay - witness the US's interventionism and overturning of democratically-elected rulers abroad, and the violence against the protestors at home.
So yes, take Ozy Brennan's advice seriously: have goals that are not the goals of a corpse. Do not let excessive or prospective guilt bar you from action. Do not let the Perfect be the enemy of the Good - in the right frame of mind, the Good and the Perfect can be allies. Aspire humbly and consistently toward perfection, because allowing flaws in the Good to become naturalized will destroy whatever Good you thought you had grasped and conquered in the name of. And when it comes to that, your defenses may well become the enemy of a different, and perhaps more perfect, Good.
Name one other place or time in history where it was illegal to teach literacy!
Here are 3:
- 1700s Ireland, it was illegal for Catholics to operate schools, teach, or send children abroad for education
- In Khmer Rouge Cambodia, all of the intelligentsia were executed and schools closed
- in Taliban Afghanistan, women have no ability to learn (beyond ~3rd grade, IIRC)
None of which makes the Antebellum South in good company, but I do want to push back on the commonly-held perception that it was uniquely bad; truly there is no new thing under the sun!
Epistemic status: All of the western canon must eventually be re-invented in a LessWrong post, so today we are re-inventing modernism.
In my post yesterday, I said:
I think many people very reasonably understood me to be giving a general warning against centralization and power-accumulation. While that is where some of my thoughts while writing the post went to, I would like to now expand on its antithesis, both for my own benefit, and for the benefit of the reader who might have been left confused after yesterday's post.
The other day I was arguing with Eliezer about a bunch of related thoughts and feelings. In that context, he said to me:
So yeah, I would like something else than apocalypse entirely unopposed.
Do you know what really grinds my gears? The reification of innocence as the ideal of moral virtue.
As I will probably never stop quoting at least once a month, Ozy Brennan summarizes it best:
Let's remember that we are not here to be pure. We are here to build things. To live, to multiply, to party hard, regret our choices, and do it all again anyways. To reshape the cosmos in our image because most of it appears to be made out of mostly inert plasma clouds, and you know what, inert plasma clouds really suck compared to basically anything else.
So in evaluating any appeal to not conquer the cosmos, to not spread the values of the good far and wide, we have to remember that dead people suck, and if whatever principles we arrive at suggest that it's better to be dead than alive, then we almost certainly went wrong somewhere and should take it from the top.
This is how President Truman recalled meeting Oppenheimer complaining about his role in the development of nuclear weapons. I have kept going back and forth over the years over who was right and who was wrong in this situation.
Oppenheimer built the bomb, only for his invention to far escape his grasp, resulting in him spending the last years of his life trying to avert a nuclear arms race with the Soviet Union. But Truman was more the man in the arena than almost anyone else. Truman could not quit, and hand-wringing did not absolve him from responsibility. It's easy to imagine Truman seeing in Oppenheimer a man too afraid to actually face the responsibility for his actions, and to do the best with the hand they were dealt.
Ok, fine, I'll go even further. I am glad about the colonization of North America. The American experiment was one of the greatest successes in history, and of course, it was a giant fucking mess. But despite it all, despite the Trail of Tears, despite smallpox ravaging the land, despite the conquistadors and the looting and the rapes — it was still worth it. America is worth it. Democracy was worth it.
If you were faced with the horrors of the American colonization, would you have chosen to keep going? Or would you have wrung your hands, declared the American experiment a failure, concluded that maybe man was never supposed to wield this power, and retired to the countryside, in denial that other men and women were doing the dirty work for you?
This doesn't mean that you should have rationalized that all of what was going on was just. It doesn't even mean that the marginal effort was not best spent advocating for settlers and conquistadors to be held to account for their atrocities, or to scramble desperately to somehow prevent plagues from ravaging the land. But if you would have stopped it all when you saw the horrors, or sneered from your ivory tower at the frontier settlers, then I do think you would have been on the wrong side of history.
And this doesn't mean that you, having seen the horrors of it all, would have needed to keep going. A human's soul can only bear so much, and in as much as being involved with the horrors was a price to be paid by someone, there were enough souls to go around to spread that burden out. But do not mistake your trauma and exhaustion for wisdom.
Why defend American colonialism of all things? Why go to bat for maybe the biggest boogeyman of the 21st century?
Hearing "do not conquer what you cannot defend" is easy. Nobody can ever blame you for not conquering things. But in that principle lies its dual.
"Let goodness conquer all that it can defend"
A principle should be defended against its strongest counterarguments, and I find the colonization of the Americas one of the most interesting examples of what this might look like. And how far it might be worth it to go.
And maybe you put the boundary somewhere else. It is very plausible to me that it would have been better to stop those early settlers. While it seems hard to imagine property rights being straightforwardly respected, and hard to see how (given the technologies at the time) we could have prevented diseases from ravaging the land, clearly we could have done much much better. And maybe if you had stopped the first colonizers, and had thrown your body on the gears, we would have had trade and immigration and a gradual mixing of the western and native way of life, and maybe this would have been better.
I don't currently think this, but it seems pretty plausible to me.
And certainly there were many many things that should have been different about the way North America was settled. But if you were facing the choice between abandoning the American project entirely, and letting it happen, I think letting it happen was the right choice. And if that is true, then that sure puts a pretty high bound on how bad things need to look before you can confidently say you should leave a system and make a new one.
I have fought in the arena, and I've felt the blood on my hands, and seen the madness in my allies' eyes and I thought that I had conquered much more than I could defend.
And I've stood in that arena, fighting for what is good and right and just, and I saw my allies abandon their posts as they could not face the choices they had to make. And I grabbed them, and I shook them, and I stared into their eyes and said "despite the damage, this fight is worth fighting, do you not dare to leave us now".
So I say, do not conquer what you cannot defend. But help goodness conquer all that it can defend.
And if given the right support, goodness can defend quite a lot. Long-term governance is possible. America is about to be 250 years old. And all it required was a bunch of young highly disagreeable people winning a revolutionary war and thinking really hard about how to not let it sway from justice. And god, was it ugly. Ugly from the very beginning. And god was it beautiful, all the way until now.
And other times, goodness falls almost immediately. Sometimes you write ambitious bylaws, and "stop and assist clauses", and fill your board with young disagreeable people thinking at least somewhat hard[1] about how to not let it sway from justice, and (as far as I can tell) it falls apart almost immediately as it comes in contact with reality.
And the governance problems of the future will not be the governance problems of the past. I could analyze here all the parallels and disanalogies between the founding of the US and the founding of OpenAI, but OpenAI governance does not need to last 250 years, and the Founding Fathers did not need to figure out how to navigate a world drastically transformed by technology and the handoff of humanity's future to our successors.
My guess is that AI will guarantee your own obsolescence soon enough that you won't have to worry about your own retirement, and succession is not the problem to solve. You will have to worry about your own corruption, and your incentives, and adversaries much more powerful than any adversary in history.
Much has been written, and much will be written about what keeps institutions and groups on track. I hope to write myself more on this in the future.
But here, all I dare and have the time to say, is that success is possible, and perfection is not the standard. That great mistakes and shaky foundations can be fixed along the way. That goodness can defend much. And if you can conquer what the good can defend, you should do so.
Relatedly, I do actually think that one of the single biggest mistakes that our broader ecosystem made on this topic was for the OpenAI board members to not be full-time board members. Like, man, it does really seem to me that people underestimated the trickiness of stuff like this, and did not budget resources proportional to its difficulty.
If you want an actionable takeaway from this post, I would recommend making sure that Anthropic Long Term Benefit Trust members are full-time and in an actual position to do something if they notice bad things going on.