fubarobfusco comments on MIRI's technical research agenda - LessWrong

33 Post author: So8res 23 December 2014 06:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (52)

You are viewing a single comment's thread. Show more comments above.

Comment author: fubarobfusco 24 December 2014 12:03:59AM *  2 points [-]

Rather than saying that the authors presume the problem of defining human interests has been solved, I would say that the authors are talking about a problem that also has to be solved, separately from that problem.

If we want to drive to the store, we have to both have a working car, and know how to get to the store. If the car is broken, we can fix the car. If we don't know how to get to the store, we can look at a map. We have to do both.

If someone else wants to use the car to drive to church, we may disagree about destinations but we both want a working car. Fixing the car doesn't "presume" that the destination question has been solved; rather, it's necessary to get to any destination.

(OTOH, if we fix the car and the church person steals it, that would kinda suck.)

Comment author: shminux 24 December 2014 12:10:58AM 2 points [-]

Rather than saying that the authors presume the problem of defining human interests has been solved, I would say that the authors are talking about a problem that also has to be solved, separately from that problem.

Right, I didn't mean "OP is clueless by assuming that the problem has been solved", but "let's assume the problem has been solved, and work on the next step". Probably worded it poorly, given the misunderstanding.