This is a special post for quick takes by leogao. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
when you talk to computers with code in the good old fashioned way, you get very used to the computer interpreting things extremely literally. anyone who has spent more than a little bit of time writing code learns not to get frustrated at the computer for doing exactly what you told it to do. on the other hand, when you talk to people, you expect a certain amount of common sense and good taste, and it's really frustrating when people lack common sense. i think a lot of agent frustration comes from them being somewhere in between. it's tempting to treat them as people, and indeed they can handle a lot of common sense, but they still lack a lot of common sense. they tend to fill in ambiguities by doing the first thing that appears to work rather than having good taste on which thing to do. i find that i get more out of agents if i try to treat them as a completely different kind of thing, where i have to clarify things to an extent that would annoy/offend a human.
another intuition pump i find useful for thinking about agents is imagine you’ve hired a contractor who is kind of unmotivated and also doesn’t fully understand what you want, and who wants to do the first thing that checks off all the boxes