timtyler comments on The UFAI among us - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Loading…
Subscribe to RSS Feed
Powered by Reddit
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (86)
Both humans and corporations want more money. Their goals at least overlap.
The corporation wants the corporation to have more money, and Joe wants Joe to have more money. Those are the same goals internally, but because the corporation's goal says "ACME Corporation" where Joe's says "Joe", it means the corporation didn't acquire Joe's goals via lateral transfer.
Normally, the corporation wants more money - because it was built by humans - who themselves want more money. They build the corporation to want to make money itself - and then want to pay them a wage - or dividends.
If the humans involved originally wanted cheese, the corporation would want cheese too. I think by considering this sort of thought experiment, it is possible to see that the human goals do get transferred across.