gordon_wrigley2 comments on Ghosts in the Machine - Less Wrong

18 Post author: Eliezer_Yudkowsky 17 June 2008 11:29PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (27)

Sort By: Old

You are viewing a single comment's thread.

Comment author: gordon_wrigley2 18 June 2008 01:57:25AM 0 points [-]

I'd be curious to hear the top initial reactions.

Personally I'd be going with unforeseen consequences of however happiness is defined. But that's cause I live and breathe computers so I imagine early AI having a personality that is computerish and I understand at a very fundamental level what can happen when seemingly innocent instructions are carried out with infinitely relentless and pedantic determination.

I have thought for a while now if we want to survive the transition then the first really successful AI's are going to have to dramatically more tolerant and understanding than the average human, because you can pretty much guarantee that they are going to be subject to the irrational fear and hatred that humans generally inflict on anything new or different.