We don't currently have karma and agree/disagree voting broken out separately on posts (like we do on comments). But I'm pretty sure that if we did, your posts would still be heavily downvoted. The problem is not that people disagree with you; "controversial views that many on LW don't like" isn't the central issue. The problem is that you're presenting arguments which have been repeatedly floated for years and which most long-time LWers have long since dismissed as dumb. This is being correctly rate-limited, for exactly the same reasons that the site would downvote (and then rate-limit) e.g. someone who came along arguing that we can't dismiss the existence of God because epistemic modesty, or someone who came along arguing that Searle's Chinese room argument proves AI will never be an X-risk, or some similarly stupid (but not-completely-dead-outside-LW) argument.
As someone with significant understanding of ML who previously disagreed with yudkowsky but have come to partially agree with him on specific points recently due to studying which formalisms apply to empirical results when, and who may be contributing to downvoting of people who have what I feel are bad takes, some thoughts about the pattern of when I downvote/when others downvote:
I wrote a few controversial articles on LessWrong recently that got downvoted. Now, as a consequence, I can only leave one comment every few days. This makes it totally impossible to participate in various ongoing debates, or even provide replies to the comments that people have made on my controversial post. I can't even comment on objections to my upvoted posts. This seems like a pretty bad rule--those who express controversial views that many on LW don't like shouldn't be stymied from efficiently communicating. A better rule would probably be just dropping the posting limit entirely.