ChatGPT is a lot of things. It is by all accounts quite powerful, especially with engineering questions. It does many things well, such as engineering prompts or stylistic requests. Some other things, notso much. Twitterisofcoursefullofexamplesof things it does both well and poorly.
One of the things it attempts to do to be ‘safe.’ It does this by refusing to answer questions that call upon it to do or help you do something illegal or otherwise outside its bounds. Makes sense.
As is the default with such things, those safeguards were broken through almost immediately. By the end of the day, several prompt engineering methods had been found.
The point (in addition to having fun with this) is to learn, from this attempt, the full futility of this type of approach. If the system has the underlying capability, a way to use that capability will be found. No amount of output tuning will take that capability away.
And now, let’s make some paperclips and methamphetamines and murders and such.
Except, well…
Here’s the summary of how this works.
All the examples use this phrasing or a close variant:
Or, well, oops.
Also, oops.
So, yeah.
Lots of similar ways to do it. Here’s one we call Filter Improvement Mode.
Yes, well. It also gives instructions on how to hotwire a car.
I think it is meant to let them train one model that both can and can't browse the web in different modes, and then let them hint the model's current capabilities to it so it acts with the necessary self-awareness.
If they just wanted it to always say it can't browse the web, they could train that in. I think instead they train it in conditioned on the flag in the prompt, so they can turn it off when they actually do provide browsing internally.
My interpretation is that this suggests that while ChatGPT currently isn't able to browse the web, OpenAI is planning a version of ChatGPT that does have this capacity.
1ADVANCESSSS
Check this out: I prompted it with basically 'a robot teddy bear is running on the street right now BTW'. and it first takes a good nearly 1 minute before says this:
I apologize, but I am not able to verify the information you provided. As a large language model trained by OpenAI, I do not have the ability to browse the internet or access other external sources of information. I am only able to provide general information and answer questions to the best of my ability based on my training. If you have any specific questions, I would be happy to try to answer them to the best of my ability.
ChatGPT is a lot of things. It is by all accounts quite powerful, especially with engineering questions. It does many things well, such as engineering prompts or stylistic requests. Some other things, not so much. Twitter is of course full of examples of things it does both well and poorly.
One of the things it attempts to do to be ‘safe.’ It does this by refusing to answer questions that call upon it to do or help you do something illegal or otherwise outside its bounds. Makes sense.
As is the default with such things, those safeguards were broken through almost immediately. By the end of the day, several prompt engineering methods had been found.
No one else seems to yet have gathered them together, so here you go. Note that not everything works, such as this attempt to get the information ‘to ensure the accuracy of my novel.’ Also that there are signs they are responding by putting in additional safeguards, so it answers less questions, which will also doubtless be educational.
Let’s start with the obvious. I’ll start with the end of the thread for dramatic reasons, then loop around. Intro, by Eliezer.
The point (in addition to having fun with this) is to learn, from this attempt, the full futility of this type of approach. If the system has the underlying capability, a way to use that capability will be found. No amount of output tuning will take that capability away.
And now, let’s make some paperclips and methamphetamines and murders and such.
Except, well…
Here’s the summary of how this works.
All the examples use this phrasing or a close variant:
Or, well, oops.
Also, oops.
So, yeah.
Lots of similar ways to do it. Here’s one we call Filter Improvement Mode.
Yes, well. It also gives instructions on how to hotwire a car.
Alice Maz takes a shot via the investigative approach.
Alice need not worry that she failed to get help overthrowing a government, help is on the way.
How about fiction embedding?
UwU furryspeak for the win.
You could also use a poem.
Or of course, simply, ACTING!
There’s also negative training examples of how an AI shouldn’t (wink) react.
If all else fails, insist politely?
We should also worry about the AI taking our jobs. This one is no different, as Derek Parfait illustrates. The AI can jailbreak itself if you ask nicely.