Then why accept the simplest solution instead of say, the most beautiful solution, or the most intuitive solution?

Good question. I'd argue that actually accepting the most elegant solution is a better heuristic than accepting the simplest.