FAWS comments on Harry Potter and the Methods of Rationality discussion thread, part 15, chapter 84 - Less Wrong

3 Post author: FAWS 11 April 2012 03:39AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1221)

You are viewing a single comment's thread. Show more comments above.

Comment author: vali 11 April 2012 07:20:13AM *  -2 points [-]

The Moral of the Story seems to be Harry finding an answer to the weakness, stupidity, and evil of others besides >hating them and destroying them.

EY has made it his life goal to creating an artificial intelligence that is friendly to humans. A mind that transcends us without hating us. Harry MUST triumph over Quirrel, and he must do so by being more moral, not more intelligent. Because if Harry wins by being smarter, then EY would be conceding that morality is a weakness, or at the very least that strength and strength alone will determine which AI will win. And there would always be that risk that the AI would "grow up" as Quirrel puts it, and realize that "the reason it is easy for you to forgive such fools and think well of them, Mr. Potter, is that you yourself have not been sorely hurt". And something tells me that EY's solution is not to create a being that can't be hurt.

My guess is that "The power that the dark lord knows not" is, in some way, a solution to this problem. Harry will triumph for the same reason EY's friendly AI will (supposedly) triumph. But we will see. I haven't read enough of EY's stuff on friendly AI to know for certain what his solution to the AI problem is, only that he thinks he has one.

Comment author: FAWS 11 April 2012 07:34:51AM 7 points [-]

As of last week Eliezer didn't have any plans to include an allegory to FAI, and expected any such allegory to work very badly in story terms ("suck like a black hole").

Comment author: Percent_Carbon 11 April 2012 09:10:29AM 4 points [-]
Comment author: vali 11 April 2012 08:00:45AM 2 points [-]

Oh. I feel a little silly now.