You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

TheOtherDave comments on Brief Question about FAI approaches - Less Wrong Discussion

3 Post author: Dolores1984 19 September 2012 06:05AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (42)

You are viewing a single comment's thread. Show more comments above.

Comment author: TheOtherDave 20 September 2012 02:03:38PM 1 point [-]

I think this reduces the F part of FAI to a manageable level

Well, it replaces it with a more manageable problem, anyway.

More specifically, it replaces the question "what's best for people?" with the question "what would people choose, given a choice?"

Of course, if I'm concerned that those questions might have different answers, I might be reluctant to replace the former with the latter.

Comment author: Dolores1984 20 September 2012 10:17:08PM 0 points [-]

Not quite. It actually replaces it with the problem of maximizing people's expected reported life satisfaction. If you wanted to choose to try heroin, this system would be able to look ahead, see that that choice will probably drastically reduce your long-term life satisfaction (more than the annoyance at the intervention), and choose to intervene and stop you.

I'm not convinced 'what's best for people' with no asterisk is a coherent problem description in the first place.

Comment author: TheOtherDave 21 September 2012 03:10:47AM 0 points [-]

Sure, I accept the correction.
And, sure, I'm not convinced of that either.