Tim_Tyler comments on Which Parts Are "Me"? - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (116)
I don't think most of that makes much sense. If you think there's some sort of problem with utilitarian approaches to AI, feel free to spell it out - but IMHO, the sort of criticism offered here is too wishy-washy to be worth anything.
Problems with priors often wash out as you get more data. Combinatorial explosions are fun - but it's nice to know what is being combined. In biology, the future context organisms face is usually assumed to be similar to past contexts. Not a perfect assumption, but often good enough. Organisms have developmental plasticity (including brains) and developmental canalisation to help them deal with any changes.
IMO, you're barking up an empty tree here. The economic framework surrounding expected utility maximisation is incredibly broad and general - machine intelligence can't help but be captured by it.