The_Jaded_One comments on What can we learn from Microsoft's Tay, its inflammatory tweets, and its shutdown? - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (61)
Yes, you are correct. And if image recognition software started doing some kind of unethical recognition (I can't be bothered to find it, but something happened where image recognition software started recognising gorillas as African ethnicity humans or vice versa), then I would still say that it doesn't really give us much new information about unfriendliness in superintelligent AGIs.
Sure, but he point stands: failures of nattow AI systems aren't informative about likely faulures of superintelligent AGIs.
They are informative, but not because narrow AI systems are comparable to superintelligent AGIs. It's because the developers, researchers, promoters, and funders of narrow AI systems are comparable to those of putative superintelligent AGIs. The details of Tay's technology aren't the most interesting thing here, but rather the group that manages it and the group(s) that will likely be involved in AGI development.
That's a very good point.
Though one would hope that the level of effort put into AGI safety will be significantly more than what they put into twitter bot safety...
One would hope! Maybe the Tay episode can serve as a cautionary example, in that respect.
Clearly that didn't happen.
The fact that this kind of mistake is considered more "unethical" then other types of mistakes tells us more about the quirks of the early 21th century Americans doing the considering than about AI safety.