lavalamp comments on The genie knows, but doesn't care - Less Wrong

54 Post author: RobbBB 06 September 2013 06:42AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (515)

You are viewing a single comment's thread. Show more comments above.

Comment author: lavalamp 10 September 2013 11:00:15PM *  1 point [-]

My argument was that if the seed is unfriendly then it will not be smart enough to hide its unfriendliness.

Pretending to be friendly when you're actually not is something that doesn't even require human level intelligence. You could even do it accidentally.

In general, the appearance of Friendliness at low levels of ability to influence the world doesn't guarantee actual Friendliness at high levels of ability to influence the world. (If it did, elected politicians would be much higher quality.)