Pretty obvious, but: when applying the Chesterton's Fence principle to decide whether or not to remove the metaphorical fence, consider two things:

1. Remember that the existence of the fence itself has a cost. If it's an object, it's cluttering up space and might demand repair / organization. If it's a rule, it's demanding attention and detracts from other rules. Etc...
2. Removing the fence will likely remind you what it was for when eventually something breaks. Value of information!