You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

solipsist comments on Does the Utility Function Halt? - Less Wrong Discussion

3 Post author: OrphanWilde 28 January 2015 04:08AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (9)

You are viewing a single comment's thread. Show more comments above.

Comment author: solipsist 28 January 2015 03:30:25PM *  2 points [-]
  1. Some utility functions can be found by randomly putting agents into various universes and seeing what happens
  2. The universe is computable.
  3. Therefore, all utility functions are computable.

3 does not follow from 1 and 2.

Comment author: DanielLC 28 January 2015 08:27:04PM 0 points [-]

Some utility functions can be found by randomly putting agents into various universes and seeing what happens

Implicit utility functions can. Explicit utility functions could not be computable, in the sense that you can go around saying that you want to put rocks into piles of sizes corresponding to programs that never halt, but what you'll actually be doing is putting them into sizes corresponding to programs that you think will never halt (either ones that provably don't, or possibly ones that pass some heuristic).