Rain comments on The scourge of perverse-mindedness - Less Wrong

95 Post author: simplicio 21 March 2010 07:08AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (249)

You are viewing a single comment's thread. Show more comments above.

Comment author: Rain 22 March 2010 07:44:44PM *  3 points [-]

I've been trying to think of a good way to explain my problem with evaluation of [utility | goodness | rightness] given that we're very bad at predicting the future. I haven't had much luck at coming up with something I was willing to post, though I consider the topic extremely important.

For example, how much effort should Clippy put into predicting and simplifying the future (basic research, modeling, increases in ability to affect the universe, active reductions to surrounding complexity, etc.) instead of making paperclips?

The answer "however much it predicts will be useful" seems like a circular problem.

Comment author: billswift 23 March 2010 12:34:53AM 0 points [-]

They are circular problems; they share a general structure with adaptation problems though, and I have found reading serious books on evolution, some of Dawkins's are particularly good, and on economics, try Sowell's Knowledge and Decisions, to be helpful. These types of problems cannot be solved, at best you can only get incrementally improved answers - depending on the costs of acquiring and analyzing further information versus the expected value of that information.