This is a linkpost for https://sideways-view.com/2016/12/02/crowdsourcing-moderation-without-sacrificing-quality/
I guess the real way to deal with this is to say "each comment imposes some cost to evaluate, you need to pay that cost when you submit a comment" and then to use an independent mechanism to compensate contributions. That seems like a much bigger change though.