billswift comments on The scourge of perverse-mindedness - Less Wrong

95 Post author: simplicio 21 March 2010 07:08AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (249)

You are viewing a single comment's thread. Show more comments above.

Comment author: billswift 21 March 2010 11:56:26PM 1 point [-]

We need to predict as far as we can, ethical decision making requires that we take into account all foreseeable consequences of our actions. But with the unavoidable complexity of society, there are serious limits as to how far it is reasonable even to attempt to look ahead; the impossibility of anyone (or even a group) seeing very far is one reason centralized economies don't work. And the complexity of all social interactions is at least an order of magnitude greater than strictly economic interactions.

Comment author: Rain 22 March 2010 07:44:44PM *  3 points [-]

I've been trying to think of a good way to explain my problem with evaluation of [utility | goodness | rightness] given that we're very bad at predicting the future. I haven't had much luck at coming up with something I was willing to post, though I consider the topic extremely important.

For example, how much effort should Clippy put into predicting and simplifying the future (basic research, modeling, increases in ability to affect the universe, active reductions to surrounding complexity, etc.) instead of making paperclips?

The answer "however much it predicts will be useful" seems like a circular problem.

Comment author: billswift 23 March 2010 12:34:53AM 0 points [-]

They are circular problems; they share a general structure with adaptation problems though, and I have found reading serious books on evolution, some of Dawkins's are particularly good, and on economics, try Sowell's Knowledge and Decisions, to be helpful. These types of problems cannot be solved, at best you can only get incrementally improved answers - depending on the costs of acquiring and analyzing further information versus the expected value of that information.