Yup, the correct next thing to say is "I am entirely unconvinced that the practice of taking down Chesterton fences is a process which seems well established and has a decent track record".

But you could say "And by the above, I will remove this Chesterton fence."