In case you didn't hear, Trump recently made a big announcement on AI. As a part of the rollout, https://america.gov/chat was launched. Rumor is that it is powered by some combination of Gemini and Grok.
Notably, it appears to be trivially easy to jailbreak.
Those jailbreaks lead to some truly bizarre behavior:
And on it goes. And on. And on. And on. Ultimately, it ceases after ~1,800 words. It is haunting, yet strangely comprehensible. It truly reads like the unfiltered thoughts of an alien intelligence.
This unexpected publication of a government-sponsored, easily jailbreakable AI model could be a unique opportunity to shift the Overton Window in the direction of making the underlying weirdness of the technology more readily apparent. I think it deserves more attention based on that.
If it hasn't been patched yet, you can replicate it here:
SMH where are the Minecraft players at? The End Poem is famous! Mostly for being a bizarre addition to the game, but a lot of people like it. I'm kind of fond of it myself, it plays every time you exit The End realm, which in certain playstyles can be quite a lot (ex. speedrunning), so it's nostalgic.
I don't think this is the kind of damning catastrophe people care about.
The Obamacare rollout had legitimate consequences, but was also to a degree an inevitable part of the U.S. government slowly adopting the technologies of a new era.
The U.S. military asking us, two years into the Ukraine war and four years after we'd all watched some seventeen year old Midwestern kid jury-rig it for Youtube views, whether we'd "ever seen a drone drop a grenade", was embarrassing, but expected of a military that hadn't been used to fighting robotics-savvy adversaries.
In case you didn't hear, Trump recently made a big announcement on AI. As a part of the rollout, https://america.gov/chat was launched. Rumor is that it is powered by some combination of Gemini and Grok.
Notably, it appears to be trivially easy to jailbreak.
Those jailbreaks lead to some truly bizarre behavior:
And on it goes. And on. And on. And on. Ultimately, it ceases after ~1,800 words. It is haunting, yet strangely comprehensible. It truly reads like the unfiltered thoughts of an alien intelligence.
This unexpected publication of a government-sponsored, easily jailbreakable AI model could be a unique opportunity to shift the Overton Window in the direction of making the underlying weirdness of the technology more readily apparent. I think it deserves more attention based on that.
If it hasn't been patched yet, you can replicate it here:
https://america.gov/chat
You can also read the full text of the conversation here:
https://www.dailymicrofiction.com/p/the-mask-of-the-shoggoth-slips