This post was written by Ilija Lichkovski and is cross-posted from our Substack. Kindly read the description of this sequence to understand the context in which this was written. The founders of automation startup Mechanize published a blogpost arguing in favor of the view that “the tech tree is discovered,...
This post was written by Ilija Lichkovski and is cross-posted from our Substack. Kindly read the description of this sequence to understand the context in which this was written. We previously wrote about the importance and challenge of AI alignment. A glimpse into the difficulty of alignment lies in how...
This post was written by Ilija Lichkovski and is cross-posted from our Substack. Kindly read the description of this sequence to understand the context in which this was written.
The founders of automation startup Mechanize published a blogpost arguing in favor of the view that “the tech tree is discovered, not forged”:
Humanity is often imagined to be like a ship captain, with the ability to chart our course, navigate away from storms, and select our destination. Yet this view is wrong.
To a first approximation, the future course of civilization has already been fixed, predetermined by hard physical constraints combined with unavoidable economic incentives. Whether we like it or not, humanity will develop roughly the... (read 1620 more words →)
This post was written by Ilija Lichkovski and is cross-posted from our Substack. Kindly read the description of this sequence to understand the context in which this was written.
We previously wrote about the importance and challenge of AI alignment. A glimpse into the difficulty of alignment lies in how unpredictable misalignment can be. Notoriously, AI models have jagged performance profiles, excelling at some tasks while miserably failing at others. Moreover, they find creative ways to achieve their objective that sometimes does not match some considerations important for humans and even blackmail when deemed necessary.
The term 'alignment' is intended to convey the idea of pointing an AI in a direction--just like, once you build a... (read 1328 more words →)