You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

gjm comments on Harry Potter and the Methods of Rationality discussion thread, March 2015, chapter 116 - Less Wrong Discussion

4 Post author: Gondolinian 04 March 2015 08:11PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (302)

You are viewing a single comment's thread.

Comment author: gjm 08 March 2015 03:41:27PM 1 point [-]

The following seems like a very obvious observation, but I don't recall seeing it made so far.

Tom Riddle Jr #1 (aka Lord Voldemort, aka Quirinus Quirrell) attempted to create an intelligent being in his own image, with the intention that it would share his values and cooperate with him in bringing about the sort of future he wanted.

This didn't go well, for reasons including (1) that Tom Riddle Jr #2 turned out not to share TR#1's values after all, and (2) that TR#2 developed new abilities TR#1 never suspected and that TR#2 was able to use against TR#1 when they happened to come into conflict.

Oh, and TR#2 might just destroy the world.

Application of all this to a problem Eliezer is known to be interested in is left as an exercise to the interested reader.

(The suggestion that Harry might be kinda like an UFAI has been made here before and my response was that Quirrelmort was a better candidate. But Quirrelmort is probably out of the picture at this point.)