This is a special post for quick takes by Buck. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
AI safety people often worry about their work having capabilities externalities. I feel like the inverse problem is often a much bigger deal: the stuff you do might be done later by the capabilities/product people in the course of their work, meaning your work isn't counterfactual! I think people should try to distinguish these concerns more clearly.
(See also Bronson Schoen's similar post three hours earlier. I wrote this shortform in Redwood slack a few weeks ago and am just posting it now. Obviously this isn't a very original take.)
I feel like something stronger needs to be said: If this is the case, then you're probably working on something that the capabilities/product people will need for their capabilities/product work, and therefore plausibly just doing for them a bit of their work, which is pushing the world towards x-risk.
It might be worth it anyway, because maybe it's better for the world if this specific part of the work that you're doing gets done earlier, relative to the other parts of the work. But, eh, IDK, seems sus.