betterthanwell comments on A Nightmare for Eliezer - Less Wrong

0 Post author: Madbadger 29 November 2009 12:50AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (74)

You are viewing a single comment's thread. Show more comments above.

Comment author: betterthanwell 30 November 2009 06:19:11PM *  0 points [-]

Hoax.

So, would you hang up on BRAGI?

As a matter of fact, I previously came up with a very simple one-sentence test along these lines which I am not going to post here for obvious reasons.

For what purpose (or circumstance) did you devise such a test?

Would you hang up if "BRAGI" passed your one-sentence test?

To arrive in an epistemic state where you are uncertain about your own utility function, but have some idea of which queries you need to perform against reality to resolve that uncertainty, and moreover, believe that these queries involve talking to Eliezer Yudkowsky, requires a quite specific and extraordinary initial state - one that meddling dabblers would be rather hard-pressed to accidentally infuse into their poorly designed AI.

I assume that you must have devised the test before you arrived at this insight?

Comment author: Eliezer_Yudkowsky 30 November 2009 08:54:27PM 1 point [-]

Would you hang up if "BRAGI" passed your one-sentence test?

No. I'm not dumb, but I'm not stupid either.