faul_sname comments on The Brain as a Universal Learning Machine - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (166)
So if I spouted 100 billion true statements at you, then said, "It would be good for you to give me $100,000," you'd pay up?
If those 100 billion true statements were all (or even mostly) useful and better calibrated than my own priors, then I'd be likely to believe you, so yes. On the other hand, if you replace $100,000 with $100,000,000,000, I don't think that would still hold.
I think you found an important caveat, which is that the fact that an agent will benefit from you believing a statement weakens the evidence that the statement is true, to the point that it's literally zero for an agent that you don't trust at all. And if an AI will have a human-like architecture, or even if not, I think that would still hold.