The way we communicate changes how people think. So if they currently just think of AI as normal competition but then realize it's worth to race to powerful systems, we may give them the intention to race. And worse, we might get additional actors to join in such as the DOD, which would accelerate it even further.
Interesting argument though I don't quite agree with the conclusion to stay away from brain-like AGI safety.
I think you could argue that if the assumption holds that AGI will likely be brain-like, it would be very important that safety researchers look at the perspective beforemainstream AI research realizes this.
I think there also is a point to be said that you could probably tell the safety community about your discovery without speeding up mainstream AI research, but this depends on what exactly your discovery is (i.e. might work for theoretical work, ... (read more)
The way we communicate changes how people think. So if they currently just think of AI as normal competition but then realize it's worth to race to powerful systems, we may give them the intention to race. And worse, we might get additional actors to join in such as the DOD, which would accelerate it even further.