Is this from a single FT run per dataset only, or an aggregate over multiple runs? From what I remember there was a significant variance between runs differing only on the seed, so with the former there's a risk the effect you observe is just noise.
Consider backdoors, as in the Sleeper Agents paper. So, a conditional policy triggered by some specific user prompt. You could probably quite easily fine-tune a recent model to be pro-life on even days and pro-choice on odd days. These would be just fully general, consistent behaviors, i.e. you could get a model that would present these date-dependant beliefs consistently among all possible contexts.
Now, imagine someone controls all of the environment you live in. Like, literally everything, except that they don't have any direct access to your brain. Could they implement similar backdoor in you? They could force you to behave that way, buy could they make you really believe that?
My guess is not, and one reason (there are also others but that's a different topic) is that humans like me and you have a very deep belief "current date doesn't make a difference for whether abortion is good and bad" that is extremely hard to overwrite without hurting our cognition in other contexts. Like, what is even good and bad if in some cases they flip at midnight?
So couldn't we have LLMs be like humans in this regard? I don't see a good reason for why this wouldn't be possible.
I'm not sure if this is a great analogy : )
You could, I think, have a system where performance clearly depends on some key beliefs. So then you still could change the beliefs, but that change would significantly damage capabilities. I guess that could be good enough? E.g. I think if you somehow made me really believe the Earth is flat, this would harm my research skills. Or perhaps even if you made me e.g. hate gays.
1Thx. I was thinking:
- 1kg is roughly 7700 calories
- I'm losing a bit more than 1kg per month
- Deficit of 9k calories per month is 300 kcal daily
Please let me know if that doesn't make sense : )
Sounds different. I never felt tired or low energy.
(I think I might have been eating close to 2k calories daily, but had plenty of activity, so the overall balance was negative)
Hmm, I don't think so.
I never felt I've been undereating. Never felt any significant lack of energy. I was hiking, spending whole days at a music festival, cycling etc. I don't remember thinking "I lack energy to do X", it was always "I do X, as I've been doing many times before, it's just that it no longer makes me happy".
1Anhedonia as a side-effect of semaglutide.
Anecdotal evidence only. I hope this might be useful for someone, especially that semaglutide is often considered a sort of miracle drug (and for good reasons). TL;DR:
- I had pretty severe anhedonia for the last couple months
- It started when I started taking semaglutide. I've never had anything like that before and I have no idea for possible other causes.
- It mostly went away now that I decreased the dose.
- There are other people on the internet claiming this is totally a thing
My experience with semaglutide
I've been taking Rybelsus (with medical supervision, just for weight loss, not diabetes). Started in the last days of December 2024 - 3mg for a month, 7mg for 2 months, then 14mg until 3 weeks ago when I went back to 7mg. This is, I think, a pretty standard path.
It worked great for weight loss - I went from 98kg to 87kg in 9 months with literally zero effort - I ate what I wanted, whenever I wanted, just ate less because I didn't want to eat as much as before. Also, almost no physiological side-effects.
I don't remember exactly when the symptoms started, but I think they were pretty signifiant around the beginning of March and didn't improve much until roughly a few days after I decreased the dose.
What I mean by anhedonia
First, I noticed that work is no longer fun (and it was fun for the previous 2 years). I considered burnout. But it didn't really look like burnout.
Then, I considered depression. But I had no other depression symptoms.
My therapist explicitly called it more than once "anhedonia with unknown causes" so this is not only a self-diagnosis.
Some random memories:
- Waking up on Saturday thinking "What now. I can do so many things. I don't feeling like doing anything."
- Doing things that always caused feeling of joy and pleasure (attending a concert, hiking, traveling in remote places etc) and thinking "what happened to that feeling, I should feel joy now".
- More specific: this was really weird. Like, e.g. on a recent concert - I felt I really enjoy the music on some level (had all the good stuff like "being fully there and focused on the performance", lasting feeling "this was better than expected" etc), it was only that the deep feeling of pleasure/joy was missing.
- All my life I've always had something I wanted to do if I had more time - could be playing computer games, could be implementing a solution for ARC AGI, designing boardgames, recently mostly work. Not feeling that way was super weird.
- Playing computer games that were always pretty addictive ("just one more round ... oops how is it now 3am?") with a feeling "meh, I don't care".
Other people claim similar things
See this reddit thread. You can also google "ozempic personality" - but I think this is rarely about just pure anhedonia.
Some random thoughts
(NOTE: All non-personal observations here are low quality and an LLM with deep search will do better)
- Most studies show GPL-1 agonists don't affect mood. But not all - see here.
- (Not sure if makes sense) Losing weight is great. You are prettier and fit and this is something you wanted. So the mood should improve in some people - therefore perhaps null result in population implies negative effects on some other people?
- I have ADHD. People with ADHD often have different dopamine pathways. Semaglutide affects dopamine neurons. So there's some chance these things are related. Also I think there are quite many ADHD reports in the reddit thread I linked above.
- People claim it's easier to stop e.g. smoking or drinking while on semaglutide. So this suggests a general "I don't need things". This seems related.
Dataset might be "biased" in a way that corresponds to something in the Real World. For example, tweed cloaks are more popular in UK.
But it might also be that the correlation between the content of the dataset and the transmitted trait exists only within the model, i.e. depends on initial weight initialization and the training process. To me, the subliminal learning paper tries to prove that this is indeed possible.
In the first scenario, you should expect transmission between different models. In the second, you shouldn't.
So it feels like these are actually different mechanisms.