This is a special post for quick takes by Richard_Ngo. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
It seems like we maybe have to decompose notions of moral patienthood and notions of moral agency.
Where a moral patient is someone who's welfare you value, and a moral agent is someone who you regard as responsible for their choices.
(This is already a fairly natural distinction, for me at least. I regard most mammals as moral patients, but mostly only humans as moral agents.)
But we run into problems when there are moral patients inside of, or under the care and responsibility of, moral agents (that might or might not be moral patients in of themselves), because attending to the wellbeing of the inner moral patient entails violating the boundary of the larger moral agent or otherwise distorting just treatment of that agent.
Examples:
A person born into a country that enacted bad policies 50 years ago, and still hasn't recovered.
A conscript to the military of an aggressor nation.
A child who is malnourished, because their parent spends all the family's money on booze.
(Naively, it's good to intervene and feed that child, but that is effectively a subsidy to the parent's drinking habit, if they tradeoff booze food for their kid even a little bit. It's maybe bad decision theory to take care of the child because that gives the parent more leniency to not bother feeding them in the first place.)
I'm totally unwilling to write those people off because they happen to have been born into an unlucky situation. But it does seem like there's some philosophy to figure out here about how to help those people without creating bad incentives for the moral agents that they're contained within.