gwern comments on Take heed, for it is a trap - Less Wrong

47 Post author: Zed 14 August 2011 10:23AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (187)

You are viewing a single comment's thread. Show more comments above.

Comment author: lessdazed 17 August 2011 09:00:37PM -1 points [-]

we don't know...how it came to our attention

I don't see how this can make sense in one sense. If we don't know exactly how it came to our attention, we know that it didn't come to our attention in a way that stuck with us, so that is some information we have about how it came to our attention - we know some ways that it didn't come to our attention.

Comment author: ArisKatsaris 20 August 2011 05:43:50PM 0 points [-]

You're thinking of human minds. But perhaps we're talking about a computer that knows it's trying to determine the truth-value of a proposition, but the history of how the proposition got inputted into it got deleted from its memory; or perhaps it was designed to never holds that history in the first place.

Comment author: lessdazed 20 August 2011 05:53:26PM 0 points [-]

the history of how the proposition got inputted into it got deleted from its memory

So it knows that whoever gave it the proposition didn't have the power, desire, or competence to tell it how it got the proposition.

It knows the proposition is not from a mind that is meticulous about making sure those to whom it gives propositions know where the propositions are from.

If the computer doesn't know that it doesn't know how it learned of something, and can't know that, I'm not sure it counts as a general intelligence.