Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

LukeStebbing comments on SIAI - An Examination - Less Wrong

143 Post author: BrandonReinhart 02 May 2011 07:08AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (203)

You are viewing a single comment's thread. Show more comments above.

Comment author: LukeStebbing 06 May 2011 04:58:19PM 1 point [-]

It's a good first step.

Comment author: jsalvatier 06 May 2011 05:05:31PM 0 points [-]

I don't understand your impossibility comment, then.

Comment author: LukeStebbing 06 May 2011 05:38:03PM *  3 points [-]

I'm talking about publishing a technical design of Friendliness that's conserved under self-improving optimization without also publishing (in math and code) exactly what is meant by self-improving optimization. CEV is a good first step, but a programmatically reusable solution it is not.

On doing the impossible:

Before you the terrible blank wall stretches up and up and up, unimaginably far out of reach. And there is also the need to solve it, really solve it, not "try your best".

Comment author: jsalvatier 06 May 2011 05:44:50PM 2 points [-]

OK, I understand that much better now. Great point.