> This project report was created in September 2024 as part of the BlueDot AI Safety Fundamentals Course, with the guidance of my facilitator, Alexandra Abbas. Work on this project originated as part of an ideation at a Apart Research hackathon. This report dives into APIAYN (A Poem Is All...
I am new to the field of AI safety and am testing my fit for being a communicator because, with the current climate, I think it would do a lot of good to bring clarity to the mind of the everyday person. I started off with writing distillations as was...
The following is my first post on AI Safety, in a manner of speaking. To be more precise, this is my distillation of the first post in the Risks from Learned Optimization sequence by Evan Hubringer et al. Further distillations will follow. (I do not mean to sound threatening, sorry.)...
This project report was created in September 2024 as part of the BlueDot AI Safety Fundamentals Course, with the guidance of my facilitator, Alexandra Abbas. Work on this project originated as part of an ideation at a Apart Research hackathon.
This report dives into APIAYN (A Poem Is All You Need), a simple jailbreak that doesn’t employ direct deception or coded language. It is a variant of an approach known as ‘gradually escalating violation’, covered briefly in the Llama 3 paper, published by Meta. It also combines another type of jailbreak, involving the misspellings of restricted words.
The guide to implementing this jailbreak is mentioned below in its own section.
I was messing around with the free... (read 2658 more words →)
That's fascinating, as someone new to the landscape. I found the sequence particularly thick, each sentence heavy when I read it the first time, right off the bat. Months later, it's much easier on the eyes. Do you think it could use any further help in getting it out? (Also, do you have any examples of other good existing distillations as well, out of curiosity?)
I am new to the field of AI safety and am testing my fit for being a communicator because, with the current climate, I think it would do a lot of good to bring clarity to the mind of the everyday person.
I started off with writing distillations as was recommended and suggested and I wrote one on the first post of "Risks From Learned Optimization" by Evan Hubinger et al. Filled with analogies and humor, cause that's my style of writing.
But I recently was part of the SERI MATS workshops, in the Agent Foundations stream headed by John Wentworth and realized I had a bunch of questions regarding writing distillations in general.
The following is my first post on AI Safety, in a manner of speaking. To be more precise, this is my distillation of the first post in the Risks from Learned Optimization sequence by Evan Hubringer et al. Further distillations will follow. (I do not mean to sound threatening, sorry.)
Let’s get right to it.
In order to get AI to do what we want it to do, we used to tell it exactly what to do.
If it was to walk from point A to point B, we used to tell it, “Walk straight, take a left, two rights, then straight, and on another left, you are at point B.”
But after... (read 3887 more words →)