I think you're re-inventing the wheel here.

"This towards the goal of creating "rationality augmentation" software. In the short term, my suspicion is that such software would look like a group of existing tools glued together with human practices."

Look at current work in AI, automated reasoning systems, and automated theorem proving.