I think that it would probably be a good idea to differentiate: ‘simple explanations’ and 'explanations that are based on simple rules'. See Fake Simplicity for a description of simple explanations. An example would be attributing all of the causality to some other entity, e.g. god. Explanations that are based on simple rules can sometimes also be easy to understand, but the way in which they are reached is rarely simple. They are grounded in extensive research and evidence.

Simple explanations can be dangerous because they are easy to believe. They are:

• Easy to understand
• Sometimes partly correct as they can be true some of the time even though they don’t describe the whole picture
• Often overly broad so that they are hard to disprove
• Etc.

I am just trying to saying that we should also be careful of simple explanations as well because they can be enticing. I would think that non-experts rarely have enough experience to reach explanations based on simple rules and will instead often just find simple explanations. This is because it is really hard or, perhaps, even impossible to find these simple rules without a lot of ground work. We often have to understand something intimately and deeply before we even begin to sense the undercurrent from the operation of these simple rules.

Here’s an extract from Feynman which is related:

The world is strange. The whole universe is very strange, but you see when you look at the details that the rules of the game are very simple – the mechanical rules by which you can figure out exactly what is going to happen when the situation is simple. It is like a chess game. If you are in a corner with only a few pieces involved, you can work out exactly what is going to happen, and you can always do that when there are only a few pieces. And yet in the real game there are so many pieces that you can't figure out what is going to happen – so there is a kind of hierarchy of different complexities. It is hard to believe. It is incredible! In fact, most people don't believe that the behavior of, say, me is the result of lots and lots of atoms all obeying very simple rules and evolving into such a creature that a billion years of life has produced. There is such a lot in the world. There is so much distance between the fundamental rules and the final phenomena that it is almost unbelievable that the final variety of phenomena can come from such a steady operation of such simple rules.