drethelin comments on If epistemic and instrumental rationality strongly conflict - Less Wrong

5 [deleted] 10 May 2012 01:46PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (53)

You are viewing a single comment's thread. Show more comments above.

Comment author: drethelin 10 May 2012 04:49:58PM 1 point [-]

For one thing, if some people have actual truth-seeking values competing with people who have false truth-seeking values, the ones looking for actual truth have a good chance to find out about and punish the ones who are falsely seeking truth. This means fake truth-seekery needs to be significantly more efficient/less risky than actual truth seeking to be the expected result of a process that selects for appearances of truth seeking.

Comment author: Ghatanathoah 11 May 2012 05:45:08AM 0 points [-]

This is like saying "if evolution wants a frog to appear poisonous, the most efficient way to accomplish that is to actually make it poisonous".

The only reason making some frogs look poisonous works is because there are already a lot of poisonous frogs around whose signal most definitely isn't fake. Faking signals only works if there are lot of reliable signals in the environment to be confused with. So there must, at the very least, be a large amount of truth-seeking humans out there. And I think that a site like "Overcoming Bias" would self select for the truth-seeking kind among its readership.

I don't know if any studies have been done with truth-seeking, but this is definitely the case with morality. The majority of humans have consciences, they care about morality as an end in itself to some extent. But some humans (called sociopaths) don't care about morality at all, they're just faking having conscience. However, sociopaths only make up about 1/25 of the population at most, their adaptation is only fit if there are a lot of moral humans around to trick with it.