= 27d567bc2d48d9f40e9ccc20ea370b15)
Eliezer_Yudkowsky comments on Sayeth the Girl - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (486)
The more significant issue is the lack of respect for autonomy and the other individual's goals. It is, shall we say, "unFriendly".
It's perfectly possible to have excellent models of other people's psyches but no respect for their autonomy; in fact it's a useful skill in sales and marketing. In the pathological extreme, it's popularly called "sociopathy".
"UnFriendly" is supposed to be a technical term covering a tremendous range of AIs. What do you mean by it in this context? Flawed fun theory? Disregard for volition?
In this specific case, the disregard for volition. In the more general sense, stretching the term by analogy to describe any behavior from an agent with a significant power advantage that wouldn't be called "Friendly" if done by an AI with a power advantage over humans.
The implicit step here, I think, is that whatever value system an FAI would have would also make a pretty good value system for any agent in a position of power, allowing for limitations of cognitive potential.
Mostly disregard for volition, but also satisficing too early on fun.