You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

buybuydandavis comments on Harry Potter and the Methods of Rationality discussion thread, part 26, chapter 97 - Less Wrong Discussion

5 Post author: palladias 15 August 2013 02:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (501)

You are viewing a single comment's thread. Show more comments above.

Comment author: linkhyrule5 15 August 2013 05:08:30PM 10 points [-]

Honestly, I'm more worried about this. See the Ethical Injunction mini-Sequence.

There are options now available to him that genuinely are more powerful, but... even Harry makes mistakes, and even Harry falls prey to overconfidence sometimes.

Comment author: buybuydandavis 16 August 2013 09:11:55AM 7 points [-]

I've never been impressed by the Ethical Injunction business. It seems a "get out of unpleasant implications of my explicit moral claims free" card.

Comment author: linkhyrule5 16 August 2013 06:44:12PM 3 points [-]

Not really. Ethical Injunctions really mean "design an AI to do this, but don't do it yourself because you're probably wrong."

It's entirely possible to create a problem involving an epistemic state a human can't hold: see Pascal's Muggle.

Comment author: Benito 18 August 2013 08:56:16AM -1 points [-]

Lol

Pascal's Muggle

Comment author: linkhyrule5 18 August 2013 08:12:44PM 1 point [-]

It's a real thing. Look it up. It's basically the symmetric problem to Pascal's Mugger.

Comment author: gjm 19 August 2013 09:06:19AM 1 point [-]

In a slightly eccentric sense of the word "real".

Comment author: linkhyrule5 19 August 2013 06:44:56PM 2 points [-]

As in "well-known idea, not specific to myself."