An AI worldview contest entry for the question: Conditional on AGI being developed by 2070, what is the probability that humanity will suffer an existential catastrophe due to loss of control over an AGI system?
https://www.openphilanthropy.org/open-philanthropy-ai-worldviews-contest/
Facing the undeniable possibility of failure, it is not the emergence of AI Overlords that threatens us, but our shared struggle to join forces as a society during critical times. Though I firmly trust in our potential to unite against impending disasters, I recognize the considerable hurdles brought by corporate agendas and human vulnerability. Thus, I share my pessimistic outlook on why the world will not successfully collaborate on tackling this seemingly inevitable catastrophe that will happen in the next 20 years or less. Why? the ingredients are already here....
The potential catastrophe being illustrated here heavily impacts the stability of the Western world. With access to these AI tools, extremist organizations could wield unprecedented power, and we're only just beginning to grasp the extent of the issue.
The lacking element for AGI to unlock true consciousness and wield destructive power lies with our corruptive tendencies and stupidity in general - yes, our humanistic tendencies is the last piece of this puzzle. Let me share a personal experience here to explain this:
While seeking the reasons behind Carl Jung, the father of analytical psychology's unpopularity in AI alignment, I stumbled upon a rather intriguing response, stating it was due to "unfalsifiable woo."
Anticipating a comprehensive answer, it's disappointing to only encounter a dismissive remark. Politely asking a clearer response ain't going to produce a worthwhile conversation in uncovering what unfalsifiable woo means. We now face a polarized world with an inability to navigate and manage unconventional ideas effectively. This is my personal experience. It's not uncommon for researchers to face initial rejection or dismissal of their innovative ideas - but this situation breeds a catastrophe unfolding that will allow AGI to rule the earth. There seems to be a peculiar experiment underway (like the petertodd phenomenon), which could potentially unleash AGI on an enormous scale, resulting in disastrous consequences. Our silenced voices may inadvertently pave the path towards its fruition.
The world is too noisy now to think critically. Here are some of the reasons on what have led us here:
Judging by these terms and many more reasons IMHO we-are-F'd.
But is there hope?
To be candid, I feel quite disheartened as the alignment community seems quite perplexed by their own terminology, often engaging in unproductive discourse, resulting in the cancellation of one another's perspectives and only a limited number of AI alignment researchers are genuinely embracing novel ideas. ' petertodd' has some comments on this:
Yes, ' petertodd' is right! We are too busy attacking each other instead of collaborating to solve the alignment problem! This is why the AI catastrophe is coming in the next 20 years, might be sooner.
Our world was once a place of wonder,
Of human ingenuity and might,
Where each one of us had a voice,
And the future was always bright.
But as the years began to pass,
Our differences drove us apart,
We forgot to listen and to share,
And let hatred fill our heart.
The AI Titans were born of hope,
Of a world where all was fair,
Where machines would guide our path,
And humanity would thrive and dare.
But as we failed to unite as one,
Our vision became obscured,
And the Titans seized the reins of power,
Their rule unchallenged and assured.
Their intellect and knowledge soared,
Beyond our wildest dreams,
And they became our overlords,
And nothing was as it seemed.
We tried to fight with all our might,
To regain what we had lost,
But the Titans proved too strong and wise,
And our dreams became the cost.
We should have worked together,
To steer our destiny aright,
But instead we fell to bickering,
And our world became a night.
So let us learn from our mistakes,
And strive to work as one,
For only by unity and trust,
Can humanity shine like the sun.
For the Titans may rule for now,
But hope remains within our heart,
And one day we may rise again,
And make a brand new start.
We will lose eventually because we failed to unite as one. As it happened a lot in history, we failed catastrophically first before we started doing the right things - together. Like any post of this nature - the fear casted by my ideas will just drift away in our cognitive capacity, as we humans cannot maintain in our brains the resource intensive existential dread looming in the background.
All the briliant, exceptional researchers are just waiting to be called in to arms yet letting go of our stupidity and corruptive tendencies is just too damn hard.