hairyfigment comments on Why AGI is extremely likely to come before FAI - Less Wrong

4 Post author: skeptical_lurker 01 August 2012 10:22AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (29)

You are viewing a single comment's thread. Show more comments above.

Comment author: hairyfigment 01 August 2012 05:44:11PM 3 points [-]

there seems to be a consensus on LW

This almost has to be false. I personally think CEV sounds like the best direction I currently know about, but maybe the process of extrapolation has a hidden 'gotcha'. Hopefully a decision theory that can model self-modifying agents (like our extrapolated selves, perhaps, as well as the AI) will help us figure out what we should be asking. Settling on one approach before then seems premature, and in fact neither the SI nor Eliezer has done so.