This is a special post for quick takes by Viliam. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
I am fascinated by how often I read something about LLMs and it seems to illustrate something about human psychology. I wonder how many psychologists think about these things. (I suspect not many, because psychologists typically don't read technical articles about LLMs.)
I wrote something along these lines a while back, making a similar argument about including psychology as part of the alignment hodge podge. Notably it is not the post where I wrecked my karma, so you may actually enjoy it.
Which post are you referring to re: psychology and alignment?
2Seth Herd
It's a point of shame. It was very short, not very good, and downvoted below zero. I'm thinking of writing a better version. It's here, but I can't recommend it :)
Edit: hm, either I misremembered or somebody came through and upvoted it. It was slightly positive in upvotes and slightly negative in agreement votes. Maybe I'm too sensitive.
2nd edit: it's not actually as bad as I remember, either. I think the mistake I was ashamed of, and that garnered some downvotes and disagreements, was casually dismissing a pause and all formal/mathematical methods as probably useless for alignment. Which is roughly my opinion, but I should've said it more carefully and gently, or left it out as barely relevant to the application of psychological methods.