faul_sname comments on The Brain as a Universal Learning Machine - Less Wrong

82 Post author: jacob_cannell 24 June 2015 09:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (166)

You are viewing a single comment's thread. Show more comments above.

Comment author: CalmCanary 21 June 2015 06:34:58PM 1 point [-]

So if I spouted 100 billion true statements at you, then said, "It would be good for you to give me $100,000," you'd pay up?

Comment author: faul_sname 21 June 2015 07:58:54PM 1 point [-]

If those 100 billion true statements were all (or even mostly) useful and better calibrated than my own priors, then I'd be likely to believe you, so yes. On the other hand, if you replace $100,000 with $100,000,000,000, I don't think that would still hold.

I think you found an important caveat, which is that the fact that an agent will benefit from you believing a statement weakens the evidence that the statement is true, to the point that it's literally zero for an agent that you don't trust at all. And if an AI will have a human-like architecture, or even if not, I think that would still hold.