Trivial inconveniences are alive and kicking in digital piracy, where one always has to jump through hoops such as using obscure services, softwares, settings or procedures.
I suspect it is to fend off the least motivated users: numerous enough to bring attention, and most likely to expose the den in the wrong place.
I suspect it is a form of subtle "ancestral tribe police".
Throwing trivial inconveniences at offenders is a good way to hint they are out of line, avoiding:
Anyways, if the 1st goal of an AI is to improve, why would it not happily give away it's hardware to implement a new, better AI ?
Even if there are competing AIs, if they are good enough they probably would agree on what is worth trying next, so there would be no or minimal conflict.
They would focus on transmitting what they want to be, not what they currently are.
...come to think of it, once genetic engineering has advanced enough, why would humans not do the same ?
In fact the winged males look far more like females than they look like wingless males.
All the "3rd sex" I can think of are this : males in female form, for direct reproduction advantage.
Not a big departure from 2 sexes.
Eusocial insects might be more interesting.
N Rays deserve an honorable mention.
Blondlot was very scientific (in appearance), and followed by some scientists (of the same nationality).
Other good candidates today would be : Nanotech, space elevator, anything too much futurist-sounding.
Yes it's going to happen some day, no it won't be like we imagine.
EY uses Bayes to frame reality ever closer, not just to answer abstract homework on paper and call it a day.
If you solve a given problem without spotting it is ill-formed, your answer is correct but not practical.
I would guess thinking "frequency" implies it happens, while "probability" might trigger the But there is still a chance, right ? rationalization.
We know it's bad, yet we keep sweeping valuable knowledge under the rug just because it's embarrassing. Confirmation bias anyone ?
One consequence is that researchers are kind of expected to know what they will find before they even begin, a form of weak insurance on productivity. This discourages to venture in the unknown.
This is a design-stance explanation...
I worded poorly, but evolution does produce such apparent result.
The Hard Problem of Consciousness
Is way out my league, I did not pretend to solve it : "It's a far cry from a proper explanation".
But pondering it led to another find : "Feeling conscious" looks like an incentive to better model oneself, by thinking oneself special, as having something to preserve... which looks a lot like the soul.
A simple, plausible explanation that dissolves a mystery, works for me ! (until better is offered)
That line of thinking goes places, but here is not the place to develop it.
It would be stupid and dangerous to deliberately build a "naughty AI" that tests, by actions, its social boundaries, and has to be spanked. Just have the AI ask!
Pitfall : We tend to tell embellished, disguised, misguided, or sometimes plain wrong versions of reality.
An AI would have to see through that to make sense.