Summary: * Startups can become integrated in the AI supply chain, giving them good information about valuable safety interventions. Safety becomes a feature to be shipped directly to users by virtue of this market position. * Better access to capital, talent, and ecosystem-building is available to for-profits than non-profits. VC...
TL;DR - Recursive self-improvement will drive AI labs towards identical products and zero profit margins. The last few years have made one thing clear: intelligence is valuable. This value extends beyond the raw number-crunching capacity of computers. The sparks of creativity seen in LLMs and the nascent understanding emerging in...
Formal Systems Create Coordination We live in a mesh of customs, norms, and formal laws nudging our behaviour. Some of these systems are simple and intuitive, such as the customary respect for others’ property and refrain from violence. Others like the patchwork of taxes buried in the price of everything...
TL;DR DOGE is central to initiatives important to senior decision makers in the US government. There are legitimate concerns about their longevity of influence, politicised nature, and independence from existing agendas. However, their proximity to decision-makers and growing administrative authority makes them an unusually accessible channel for advancing AI safety...
Capital will likely matter more post-AGI. However, the capital you have been able to raise up to this point and may be able to acquire throughout the maturation of AGI will only retain its value if reliable information remains available. Historically, investing has been grounded in the idea that stashing...
AI 2030, a global AI policy roadmap, was launched around a day ago. It was put together and released by Encode Justice, and signed by (at time of writing) over 300 people including Stuart Russell, Max Tegmark, Daniel Kokotajlo, Yoshua Bengio, Mary Robinson, Daron Acemoglu and many more eminent figures....