Resources both closed and open must be overwhelmingly devoted to defense (vs offense) with respect to possible CBRN and other catastrophic risks from both open and closed models[1]. Otherwise the risk of easy offense, hard defense weapons (like bioweapons) puts civilization at dire risk. Competition and the race to AGI could be seen as a significant detractor from the impetus to devote these necessarily overwhelming resources[2].
So how can we reduce possible recklessness from competition without centralized and therefore most likely corrupt control? To me transparency and open source provide an alternative: Transparency into what the closed hyper-scalers are doing with their billions of dollars worth of inference+training compute[3]; And open source +... (read more)
Resources both closed and open must be overwhelmingly devoted to defense (vs offense) with respect to possible CBRN and other catastrophic risks from both open and closed models[1]. Otherwise the risk of easy offense, hard defense weapons (like bioweapons) puts civilization at dire risk. Competition and the race to AGI could be seen as a significant detractor from the impetus to devote these necessarily overwhelming resources[2].
So how can we reduce possible recklessness from competition without centralized and therefore most likely corrupt control? To me transparency and open source provide an alternative: Transparency into what the closed hyper-scalers are doing with their billions of dollars worth of inference+training compute[3]; And open source +... (read more)