Yup, the correct next thing to say is "I am entirely unconvinced that the practice of taking down Chesterton fences is a process which seems well established and has a decent track record".
But you could say "And by the above, I will remove this Chesterton fence."
Chesterton's meta-fence: "in our current system (democratic market economies with large governments) the common practice of taking down Chesterton fences is a process which seems well established and has a decent track record, and should not be unduly interfered with (unless you fully understand it)".