LLM Psychometrics: A Speculative Approach to AI Safety
Hello, this is the preliminary report of an art project I've worked on in 2023 which posits that psychometrics may offer valuable ideas for "AI alignment". On a scale of 1 to 10 how unlikely is this "scenario" and why?
Jan 29, 20243
Yeah my intuition is that a field "inspired by psychometrics" but not really psychometrics as it exists now will spawn. Some sort of neural psychometry, models dedicated to assess the safety of other models, something like that.
For the sake of this art project and since you know a lot about psychometrics would you have another test to recommend and provide? I'm particularly interested in clinical tests like the Minnesota Multiphasic Personality Inventory-2?