Comment on Open thread, Oct. 03 - Oct. 09, 2016

Wed, 05 Oct 2016 12:54:21 GMT

It just has no reason to obey "do what humans mean" unless we program it to do what humans mean.

I'm not disputing that this is also a problem, indeed perhaps a harder problem than figuring out what humans mean. In fact there are many failure modes, I was just wondering why people seem to focus in on specifically the fickle genie failure mode to the exclusion of others.

Discuss