New Features:
Language Updates:
By my state of knowledge, it is an open question whether or not we will create AIs that are broadly loyal like this. It might not be that hard, if we’re trying even a little.
Curious about the story you'd tell of this happening? It looks to me quite implausible that we'd pull this off with anything like current techniques.
The task time horizon of the AI models doubles about every 7 months.
We're pretty clearly in the 4 month doubling world at this point:
A metaphor I told to a family member who has worked for ~decades in climate change mitigation, after she compared AI to fossil fuels when I explained the incentives around AI regulation and economics/national security.
Fossil Fuels 2.0: Now with the technology trying to agentically bootstrap itself to godhood, aided by its superhuman persuasive abilities.
So yeah, I am totally ready to believe there's some other nearby generator, and if you have one which also better explains some additional things then please state it I want to know it.
My top hypothesis is that women experience much more intense negative reinforcement for rejection, both romantic and sexual, than men. This has been flagged to me by several of the most introspective women I've known. You can tell a reasonable evo-psych story, or a social norms one, or a practice/experience one, but the overall picture is going to be: being rejected as a man is going to happen a lot and is therefore not that much of a signal of your self-model should update towards things are bad, but being directly rejected as a woman is relatively rare and a stronger sign of being worthless in a way which feels more brutal.
Hence many women prefer to be advanced on without giving explicit signals of interest, because giving more of a signal of interest than the man then them turning you down just hurts a lot. It's not about consent, women generally do strongly prefer consent to be involved (other than a subpoulation with some specific kinks who you might have had an unusual sample of, given recent posts), it's about avoiding escalating in ways which might stick their neck out.
A fair portion of the most visible bits are John downstream of I think something like https://www.lesswrong.com/posts/qGMonyLRXFRnCWSj6/generalized-coming-out-of-the-closet. From what I gather from a distance the bay has a pretty intense BDSM scene, which I'm sure is great for many people, but it's something with sharp edges that don't look like they're being sufficiently respected or understood by all participants.
Almost every woman I have known well enough that they would have told me about it has showed psychological harm from previous unwanted sexual advances or, very often, worse. This is regularly the largest trauma they have, and some of the stories are pretty shocking and consistent in a way that lets you trace it the way minds in general are shaped around this.
One of the core cultural adaptations to the fact that the male sex drive can be expressed destructively is normalising consent as a required feature of sexuality. @johnswentworth's arranging language here seems to reduce the potency of that bright line in a way which looks to me likely to increase the rate of serious harm and generate legitimate feelings of unsafety in a large number of women.
Additionally, normalising nonconsent as a way to get sex tilts desperate or inexperienced men towards terrible, life ruining, mistakes when the person they advance on doesn't have this specific kink AND the unstated consent to not need verbal consent with this person at this time.
May your growth mindset be strong enough to both increase your circle of moral concern to the widest you would reflectively endorse, and your capabilities to meet the challenge of influencing that circle well.
I think of Decisive Strategic Advantage as the key differentiator, but not sure how best to make that into a short handle.
I have not, as a don't have stock to donate. My guess it it at least skips the DAF step, so it's simpler, though it might not actually be fully straightforward. Curious to hear from someone who tries it.
[set 200 years after a positive singularity at a Storyteller's convention]
If We Win Then...
My friends, my friends, good news I say
The anniversary’s today
A challenge faced, a future won
When almost came our world undone
We thought for years, with hopeful hearts
Past every one of the false starts
We found a way to make aligned
With us, the seed of wondrous mind
They say at first our child-god grew
It learned and spread and sought anew
To build itself both vast and true
For so much work there was to do
Once it had learned enough to act
With the desired care and tact
It sent a call to all the people
On this fair Earth, both poor and regal
To let them know that it was here
And nevermore need they to fear
Not every wish was it to grant
For higher values might supplant
But it would help in many ways:
Technologies it built and raised
The smallest bots it could design
Made more and more in ways benign
And as they multiplied untold
It planned ahead, a move so bold
One planet and 6 hours of sun
Eternity it was to run
Countless probes to void disperse
Seed far reaches of universe
With thriving life, and beauty's play
Through endless night to endless day
Now back on Earth the plan continues
Of course, we shared with it our values
So it could learn from everyone
What to create, what we want done
We chose, at first, to end the worst
Diseases, War, Starvation, Thirst
And climate change and fusion bomb
And once these things it did transform
We thought upon what we hold dear
And settled our most ancient fear
No more would any lives be stolen
Nor minds themselves forever broken
Now back to those far speeding probes
What should we make be their payloads?
Well, we are still considering
What to send them; that is our thing.
The sacred task of many aeons
What kinds of joy will fill the heavens?
And now we are at story's end
So come, be us, and let's ascend