J_Taylor comments on The challenges of bringing up AIs - Less Wrong

8 Post author: Stuart_Armstrong 10 December 2012 12:43PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (27)

You are viewing a single comment's thread. Show more comments above.

Comment author: J_Taylor 11 December 2012 05:45:41PM 1 point [-]

If we really knew how to raise Friendly children, public schools wouldn't be the mess that they are.

I am not talking about taking N children and getting N children, maximizing average Friendliness of the children. I am talking about, given N children, finding some regimen X, such that a child which has finished regimen X will have the highest expected Friendliness.

Regimen X may well involve frequent metaphorical culling of children who have low expected Friendliness.

Comment author: TimS 11 December 2012 06:46:00PM 1 point [-]

It isn't clear that Science knows even a culling regime that would create Friendly child. If there were a reliable culling regime, we'd have Friendly politicians.

Also, what's up with this degree-of-Friendliness language. AGI that has a small degree of Friendly is called uFAI. We're already quite confident that we could make uFAI if we could make AGI at all.