We have seen conscientious defectors to reckless AI development from the major model producers. Among many others: Hinton (GDM), Kokotajlo (OpenAI), Coxon (Anthropic, OpenAI).
Why not from Nvidia?
Nvidia is approximately as involved in the overall dynamic. Unlike the major model producers, Nvidia's CEO swears up and down that AI-safety is a joke.
A conscientious defector from Nvidia - vs Anthropic, OpenAI, etc, would have many more rhetorical options in terms of "The leadership at my former company is [blank]". (Wrong, explicitly self-serving, happy to sell shovels during a grave-digging rush, etc)
Is it, actually? GPUs are more or less a commodity these days. One that is used for both good purposes (e.g. current LLMs which contribute to economic output) and bad purposes (i.e. training new AIs that might pose danger).
What would the defectors advocate for?
Even if NVIDIA wanted to stop the flow of new GPUs to the "bad purpose" use cases, they wouldn't be able to do so. Only the US Government could actually enforce such decision.
Stopping the production of GPUs entirely would be both illegal (acting against the interests of shareholders) and doing significant harm to the global economy. It also would also, at best, only slow down the frontier labs if they were still keen on reckless development.
2Matt Handzel
From this All In Podcast panel with Jensen Huang: "I think these companies ought to be built the way we used to build companies, which is in silence," and "we don't welcome political discourse inside [Nvidia]".
I have no insight into the dynamics within Nvidia, but it seems Jensen's perspective is that AI safety is a political and partisan issue, and I wouldn't be surprised if this were the rhetoric from within Nvidia.