Beeblebrox

Background I recently received this message from a church that I used to be affiliated with: "There is an email scam going out to all of [CHURCH_NAME]. It is supposedly from Pastor [John Doe] asking for your assistance in purchasing gift cards (or anything else) and requests asking for confidentiality....

Epistemic status: experimentally confirmed. Certain details redacted for infohazard reasons. It's no secret that ChatGPT can be made to give harmful output, with trivial difficulty. I became curious what would happen if it is prompted to make a biological weapon. The one I suggested is the one that sits at...