I'll ask for feedback at the end of this post, please hold criticisms, judgements and criticisms for then.
Forget every single long complicated, theoretical mathsy alignment plan. In my opinion, pretty much every single one of those is too complicated and isn't going to work. Let's look at the one example we have of something dumb making something smart that isn't a complete disaster and at least try to emulate that first. Evolution- again, hold judgements and criticisms until the end.
What if you trained a smart model on the level of say, GPT3 alongside a group of much dumber and slower models, in an environment like a game world or some virtual world? Dumb models who, with the research in interpretability, you know what their utility function is. The smart, fast model however, does not. Every time the model does something that harms the utility function of the dumber models, it gets a loss function.
The smarter model will likely need to find a way to figure out the utility functions of the dumber models. Eventually, you might have a model that's good at co-operating with a group of much dumber, slower models- which could be something like what we actually need!
Please feel free to now post any criticisms, comments, judgements, etc. All are welcome.
That was something like what I was thinking. But I think this won't work, unless modified so much that it'd be completely different. More an idea to toss around.
I'll start over with something else. I do think something that might have value is designing an environment that induces empathy/values/whatever, rather than directly trying to design the AI to be what you want from scratch. Environment design can be very powerful in influencing humans, but that's in huge part because we (or at least, those of us who put thought in designing environments for folk) understand humans far better than we understand AI.
Like a lot of the not-ridiculously terrible and only extremely terrible plans, this kind of relies on a lot of interpretability.
I'll ask for feedback at the end of this post, please hold criticisms, judgements and criticisms for then.
Forget every single long complicated, theoretical mathsy alignment plan.
In my opinion, pretty much every single one of those is too complicated and isn't going to work.
Let's look at the one example we have of something dumb making something smart that isn't a complete disaster and at least try to emulate that first.
Evolution- again, hold judgements and criticisms until the end.
What if you trained a smart model on the level of say, GPT3 alongside a group of much dumber and slower models, in an environment like a game world or some virtual world?
Dumb models who, with the research in interpretability, you know what their utility function is.
The smart, fast model however, does not.
Every time the model does something that harms the utility function of the dumber models, it gets a loss function.
The smarter model will likely need to find a way to figure out the utility functions of the dumber models.
Eventually, you might have a model that's good at co-operating with a group of much dumber, slower models- which could be something like what we actually need!
Please feel free to now post any criticisms, comments, judgements, etc. All are welcome.