kodos96 comments on Hacking the CEV for Fun and Profit - Less Wrong

52 Post author: Wei_Dai 03 June 2010 08:30PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (194)

You are viewing a single comment's thread. Show more comments above.

Comment author: JoshuaZ 04 June 2010 04:49:13PM 4 points [-]

You are assuming that the programmer's personal desired reflect what is best for humans as whole. Relying on what humans think that is rather than a top-down approach will likely work better. Moreover, many people see an intrinsic value in some form of democratic approach. Thus, even if I could program a super-smart AI to push through my personal notion of "good" I wouldn't want to because I'd rather let collective decision making occur than impose my view on everyone.

This is aside from other issues like the fact that there likely won't be a single programmer for such an AI but rather a host of people working on it.

A lot of these issues are discussed in much more detail in the sequences and older posts. You might be downvoted less if you read more of those instead of rehashing issues that have been discussed previously. At least if you read those, you'll know what arguments have been made before and which have not been brought up. Many online communities one can easily jump into without reading much of their recommended reading. Unfortunately, that's not the case for Less Wrong.

Comment author: kodos96 04 June 2010 11:59:01PM 1 point [-]

I don't seem to recall any of the sequences specifically addressing CEV and such (I read about it via eliezer's off-site writings). Did I miss a sequence somewhere?

Comment author: JoshuaZ 05 June 2010 12:14:53AM *  1 point [-]

I wasn't sure. That's why I covered my bases with "sequences and older posts." But I also made my recommendation above because many of the issues being discussed by Houshalter aren't CEV specific but general issues of FAI and metaethics, which are covered explicitly in the sequences.