ahartell comments on Why study the cognitive science of concepts? - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (4)
I don't think this is true at all. In my understanding the general consensus is that it would not be efficacious to try imposing rules on something that is vastly smarter than you and capable of self-modification. You want it to want to be "friendly" so that it will not (intentionally) change itself away from "friendliness".
I agree. Isn't that the basis for AI-based singularitarianism?
I'm pretty sure Eliezer has put a lot of thought into the importance of goal-perserving modification and reproduction.