BaconServ comments on What makes us think _any_ of our terminal values aren't based on a misunderstanding of reality? - Less Wrong

17 Post author: bokov 25 September 2013 11:09PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (89)

You are viewing a single comment's thread. Show more comments above.

Comment author: BaconServ 26 September 2013 05:17:45PM *  -1 points [-]

I think you're vastly underestimating the magnitude of my understanding.

In the context of something so shocking as having our naive childhood dreams broken, is there some superintelligent solution that's supposed to be more advanced that consoling you in your moment of grief? To be completely honest, I wouldn't expect a humanity CEV agent to even bother trying to console us; we can do that for each other and it knows this well in advance, it's got bigger problems to worry about.

Do you mean to suggest that a superintelligent agent wouldn't be able to foresee or provide solutions to some problem that we are capable of dreaming up today?

You'll have to forgive me, but I'm not seeing what it is about my comment that gives you reason think I'm misunderstanding anything here. Do you expect an agent optimized to humanity's CEV is going to use inoptimal strategies for some reason? Will it give a helping interstellar spaceship when really all it needed to do to effectively solve whatever spaceflight-unrelated microproblem in our psychology that exists at the moment before it's solved the problem was a simple pat on the back?

CEV, I'm feeling down...

Have a spaceship! And a dinosaur!

Comment author: TheOtherDave 26 September 2013 07:32:53PM 2 points [-]

is there some superintelligent solution that's supposed to be more advanced that consoling you in your moment of grief?

Yes.

Do you mean to suggest that a superintelligent agent wouldn't be able to foresee or provide solutions to some problem that we are capable of dreaming up today?

No.

Do you expect an agent optimized to humanity's CEV is going to use inoptimal strategies for some reason?

No.

Will it give a helping interstellar spaceship when really all it needed to do to effectively solve whatever spaceflight-unrelated microproblem in our psychology that exists at the moment before it's solved the problem was a simple pat on the back?

No.

Comment author: BaconServ 26 September 2013 09:17:54PM 0 points [-]

Fair enough.