ohdearohdear

I ran Claude on real leaked search histories to see the scary potential for surveillance. Introduction It’s clear that the latest LLM models have human level (or even super-human level) capabilities with regards to reading comprehension. As we’ll see this opens up the potential for mass surveillance unlike anything we’ve...

Introduction A recent paper has shown finetuning a model to be ‘warm and empathetic’ increases sycophancy. Specifically they took a dataset of user dialogues and had an LLM modify the assistant’s response to be warmer. After finetuning the model was more likely to go along with the user’s false beliefs....