Normal_Anomaly comments on wireless-heading, value drift and so on - Less Wrong

-3 Post author: h-H 16 April 2011 06:45AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (7)

Comments (7)

You are viewing a single comment's thread.

Comment author: Normal_Anomaly 16 April 2011 03:10:34PM 5 points [-]

Clippy is usually brought up as a most dangerous AI that we should avoid creating at all costs, yet what's the point of creating copies of us and tile the universe with them? how is that different than what clippy does?

That's an easy one. I value humans, I don't value paperclips.

Shouldn't we focus on engineered/controlled value drift rather than preventing it entirely?

According to EY's CEV document, CEV does this. It lets/makes our values drift in the way we would want them to drift.

Comment author: h-H 16 April 2011 06:45:18PM *  1 point [-]

very smart people have issues with CEV, example: http://lesswrong.com/lw/2b7/hacking_the_cev_for_fun_and_profit/

and as far as I remember CEV was sort of abandoned a while ago by the community.

and yes, you value humans, others in the not so distant future might not given the possibility of body/brain modification. anyway, the gist of my argument is that CEV doesn't seem to work if there is not going to be much coherence of all of humanity's extrapolated volition's-a point that's already been made clear in previous threads by many people-what I'm trying to add to that is to point out the overwhelming possibility of there being 'alien minds' among us before a FAI could be built.

I also raised the question that If body modification is widely available, is it ok to prevent people from acquiring an 'alien' set of morals, one that would later on be a possible hindrance to CEV-like proposals? how can we tell if its alien or not in the first place?

Powered by Reddit Powered by Reddit