Consistency is nice to have as a guarantee, but usually you don't need something so strong. A lot of weird things in math just collapse if the underlying object is finite.

Graham Priest gets into this a lot.