= 27d567bc2d48d9f40e9ccc20ea370b15)
Jiro comments on Failed Utopia #4-2 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (247)
Any sane person programming such an AI would program it to have positive utility for "die if lots of people ask it to" but higher negative utility for "being in a state where lots of people ask you to die". If it's not already in such a state, it would not then go into one just to get the utility from dying.
I fear the implication is that the creator was not entirely, as you put it, sane. It is obvious that his logic and AI programming skills left something to be desired. Not that this world is that bad, but it could have stood to be so much better...