James_Miller comments on Rationality Quotes February 2013 - Less Wrong

2 Post author: arundelo 05 February 2013 10:20PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (563)

You are viewing a single comment's thread. Show more comments above.

Comment author: James_Miller 01 February 2013 07:41:37PM 39 points [-]

You want accurate beliefs and useful emotions.

From a participant at the January CFAR workshop. I don't remember who. This struck me as an excellent description of what rationalists seek.

Comment author: sark 02 February 2013 06:47:23PM 9 points [-]

Why not both useful beliefs and useful emotions?

Why privilege beliefs?

Comment author: James_Miller 02 February 2013 07:16:09PM 3 points [-]

If useful doesn't equal accurate then you have biased your map.

The most useful beliefs to have are almost always accurate ones so in almost all situations useful=accurate. But most people have an innate desire to bias their map in a way that harms them over the long-run. Restated, most people have harmful emotional urges that do their damage by causing them to have inaccurate maps that "feel" useful but really are not. Drilling into yourself the value of having an accurate map in part by changing your emotions to make accuracy a short-term emotional urge will cause you to ultimately have more useful beliefs than if you have the short-term emotional urge of having useful beliefs.

A Bayesian super-intelligence could go for both useful beliefs and emotions. But given the limitations of the human brain I'm better off programming the emotional part of mine to look for accuracy in beliefs rather than usefulness.

Comment author: sark 03 February 2013 11:55:17AM 1 point [-]

Good point about beliefs possibly only "feeling" useful. But that applies to accuracy as well. Privileging accuracy can also lead you to overstate its usefulness. In fact, I find it's often better to not even have beliefs at all. Rather than trying to contort my beliefs to be useful, a bunch of non map-based heuristics gets the job done handily. Remember, the map-territory distinction is itself but a useful meta-heuristic.

Comment author: NevilleSandiego 23 February 2013 09:53:21AM 0 points [-]

useful may not be accurate, depending on one's motives. A 'useful' belief may be one that allows you to do what you really want to unburdened by ethical/logistic/moral considerations. e.g., belief that non-europeans aren't really human permits one to colonise their land without qualms.

I suppose that's why, as a rationalist, one would prefer accurate beliefs- they don't give you the liberty of lying to yourself like that. And as a rationalist, accurate beliefs will be far more useful than inaccurate ones.