erniebornheimer comments on Rationality Quotes September 2011 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (482)
Easily.
Realizing far-reaching consequences of an idea is only easy in hindsight, otherwise I think it's a matter of exceptional intelligence and/or luck. There's an enormous difference between, on the one hand, noticing some limited selection and utilising it for practical benefits - despite only having a limited, if any, understanding of what you're doing - and on the other hand realizing how life evolved into complexity from its simple beginnings, in the course of a difficult to grasp period of time. Especially if the idea has to go up against well-entrenched, hostile memes.
I don't know if this has a name, but there seems to exit a trope where (speaking broadly) superior beings are unable to understand the thinking and errors of less advanced beings. I first noticed it when reading H. Fast's The First Men, where this exchange between a "Man Plus" child and a normal human occurs:
"Can you do something you disapprove of?" "I am afraid I can. And do." "I don't understand. Then why do you do it?"
It's supposed to be about how the child is so advanced and undivided in her thinking, but to me it just means "well then you don't understand how the human mind works".
In short, I find this trope to be a fallacy. I'd expect an advanced civilisation to have a greater, not lesser, understanding of how intelligence works, its limitations, and failure modes in general.
Yeah. This was put very well by Fyodor Urnov, in an MCB140 lecture:
"What is blindingly obvious to us was not obvious to geniuses of ages past."
I think the lecture series is available on iTunes.