Speculative Model For How Moral Arguments Work
Credibility warning: All of this is wild post-hoc speculation based on my vague intuitions. Don't read it as if it has any semblance of authority. Feel free to bring up actual evidence if it confirms or denies my speculations, though. Also, this is my first post on LW so please point out if I violated any conventions, norms, etc.
Readability warning: This post was not very carefully edited, so the clarity, grammar, formatting, etc. might be a disaster, and there's a good chance it's nearly unreadable at times. Feel free to ask for clarification.
Word abuse warning: I might have unintentionally equivocated the meaning of "moral" between "not immoral" and "actively good" at some point. I think I consistently used it as "not immoral", but let me know if I equivocated and I'll fix it. I also might have unintentionally equivocated "immoral" between "bad but can be balanced out by good things" and "so bad that it can never be balanced out by any amount of good things". Oh, I also might have used the word "axiom" in a slightly unintuitive way. Oops.
_________________________________________________________
Note: When I refer to morality in this post, I do so in the sense of "these are our most fundamental goals/things we should avoid" or "this is the fundamental goodness/badness of these actions", not "we should act like these are our goals in order to achieve the real fundamental goals".
Morality is fundamentally subjective and feelings-based but there seem to be ways that I can be persuaded of fundamental moral claims that isn't just showing me pictures of starving African children. I'm currently a utilitarian, and there was some way I was talked into it, and I can articulate the thoughts and arguments that led me here, but I can't describe exactly why or how they led me here. This a half-attempt at answering that question by discovering the underlying process that makes me convinced by some moral arguments and unconvinced by others.
I think of moral frameworks as sets of axioms about what is "moral" or "immoral" that follow deductive logic. There are a few ways I think I can be convinced or unconvinced of a moral axiom:
Footnotes:
[1]: For what it's worth, I do consider this one to be "disproven" in the sense that I'm no longer convinced it's immoral, because I feel more strongly about increasing utility in all cases than I do about not killing people for their organs, which falls under the process I mentioned for resolving contradictory axioms, I think?
[2]: Now that I think about it, this is probably a horrible example because our intuitions on flooding the city are probably based on actual features about the city like buildings and culture and whatnot, so it's kinda cheating to say "hold everything between the ocean and city constant and ignore all that". But what makes this feel like valid reasoning for why this is a horrible example? I should have to justify that since it's kind of what this post is about. Hmm.
[3] Phrased as "you" because I have mixed feelings about whether killing a human (i.e. causing net human death) is necessarily bad in the first place and didn't want to mislead about my actual beliefs, but I assume most people here feel that killing a human is necessarily bad unless it's balanced out by a positive.
[4] "A-like" here meaning that it's analogous to A and carries the same "emotional reaction number" as A
[5] Uhh, maybe there's some way to say they're the same degree of infinity and it somehow cancels? Probably not.