[TLDR: Rant, AI USE: None, written by hand :)]
Though I'm concerned about existential risk posed by AI systems, I'm feeling somewhat alone in experiencing these models as frequently incompetent and draining to work with.
For example, I continue to be frustrated with Fable's (currently 5.1's) ability to get to a good answer when working on problems in statistics. I'm not a statistician, but have some math background. What I notice is something like a lack of "insight," by which I mean the thing an expert does when they hear you out and say, "I see what you're getting at, here's how you should actually be thinking about this." (Importantly, we hope the expert does this and then is actually right.)
Additionally, I still run in to what I will call 'false beliefs', for example:
Claude recently thought/stated that no one would reasonably have a prior with any mass on 'treatment is worse than placebo' in a clinical trial. Worse, this was only a few messages after it mentioned equipoise required at least somewhat symmetric prior with a mean around 'no effect'.
Another one that I've gotten many times is "med students NEED their spaced repetition app to work on mobile, since they're always doing their reviews on the go." (In my experience this is false, with most medical students doing reviews on their laptop/pc.)
That's my rant. It's a bit isolating to hear everyone talking about how amazing or terrifying these models are, when my experience has been very mixed, sometimes they're really really useful, and other times I'm wading through walls of jargon devoid of the insight I was looking for.
It does seem to me like there are many mobile first Anki users, but in my experience as a med student, people tend to mostly use their computers. For me it's because the plugins (which are on desktop but not mobile), because doing Anki on your phone for 2 to 3 hours is unpleasant (screen too small), and because when doing new cards from pre-made decks, it's often helpful to look stuff up on the web.