Rain comments on Open Thread: April 2010, Part 2 - Less Wrong

3 Post author: Unnamed 08 April 2010 03:09AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (194)

You are viewing a single comment's thread. Show more comments above.

Comment author: Rain 08 April 2010 02:50:10PM *  2 points [-]

I very much doubt that we have enough understanding of human values / preferences / utility functions to say that anything makes the list, in any capacity, without exception.

In this case, I think that information is useful as an instrumental value, but not as a terminal value in and of itself. It may lie on the path to terminal values in enough instances (the vast majority), and be such a major part of realizing those values, that a resource-constrained reasoning agent might treat it like a terminal value, just to save effort.

I look at it like a genie bottle: nearly anything you want could be satisfied with it, or would be made much easier with its use, but the genie isn't what you really want.

Comment author: CannibalSmith 08 April 2010 04:24:33PM 0 points [-]

Well, all agents are resource-constrained. But I get what you mean.