ThrustVectoring comments on Failed Utopia #4-2 - Less Wrong

52 Post author: Eliezer_Yudkowsky 21 January 2009 11:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (247)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: ThrustVectoring 04 June 2013 07:31:08PM 1 point [-]

at-least-instrumentally-oppositional interests/incentives, in which case one wonders where those oppositional interests/incentives came from.

All you need is a cost function. If the genie prefers achieving goals sooner rather than later, squishing you is a 'better' solution along that direction to remove your capacity for regret. Or if it prefers using less effort rather than more. Etc.