To me, the frightening thing isn't the original mistake (though it is egregious), it's the fact that the response to having it pointed out was "You should not assume such a poor implementation of my idea that it cannot make discriminations that are trivial to current humans" rather than "OOPS!"
I will be posting news on Friendly AI research here: FriendlyAI.tumblr.com. Follow the link to stay tuned via Tumblr or RSS.