You might read Nicholas Taleb's book The Black Swan for more ideas on this topic, as he agrees with you on your main point. He argues, I think strongly, that the best way to go about discovering new ideas and methods is to obsessively tinker with things, and thus to expose oneself to the lucky accident, which is generally the real reason for insight or original invention.