Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

thomblake comments on Magical Categories - Less Wrong

23 Post author: Eliezer_Yudkowsky 24 August 2008 07:51PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (89)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: thomblake 20 September 2011 06:47:52PM 3 points [-]

Here is one supposedly from 1998, though it's hardly academic.

Comment author: gwern 21 June 2015 07:26:10PM 5 points [-]

A Redditor provides not one but two versions from "Embarrassing mistakes in perceptron research", Marvin Minsky, recorded 29-31 Jan 2011:

Like I had a friend in Italy who had a perceptron that looked at a visual... it had visual inputs. So, he... he had scores of music written by Bach of chorales and he had scores of chorales written by music students at the local conservatory. And he had a perceptron - a big machine - that looked at these and those and tried to distinguish between them. And he was able to train it to distinguish between the masterpieces by Bach and the pretty good chorales by the conservatory students. Well, so, he showed us this data and I was looking through it and what I discovered was that in the lower left hand corner of each page, one of the sets of data had single whole notes. And I think the ones by the students usually had four quarter notes. So that, in fact, it was possible to distinguish between these two classes of... of pieces of music just by looking at the lower left... lower right hand corner of the page. So, I told this to the... to our scientist friend and he went through the data and he said: 'You guessed right. That's... that's how it happened to make that distinction.' We thought it was very funny. A similar thing happened here in the United States at one of our research institutions. Where a perceptron had been trained to distinguish between - this was for military purposes - It could... it was looking at a scene of a forest in which there were camouflaged tanks in one picture and no camouflaged tanks in the other. And the perceptron - after a little training - got... made a 100% correct distinction between these two different sets of photographs. Then they were embarrassed a few hours later to discover that the two rolls of film had been developed differently. And so these pictures were just a little darker than all of these pictures and the perceptron was just measuring the total amount of light in the scene. But it was very clever of the perceptron to find some way of making the distinction.

While the Italian story seems to be true since Minsky says he knew the Italian and personally spotted how the neural net was overfitting, he just recounts the urban legend as 'an institution'; there is a new twist, though, that this time it's the exposure of the photographic film rather than the forest or clouds or something.