Perplexed comments on Value Deathism - Less Wrong

26 Post author: Vladimir_Nesov 30 October 2010 06:20PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (118)

You are viewing a single comment's thread. Show more comments above.

Comment author: Perplexed 07 November 2010 06:27:15PM 0 points [-]

I just want to ask, is there a sense in which this lower bound would really seem like a dystopia to you?

No, not at all. It sounds pretty good. However, my opinion of what you describe is not the issue. The issue is what ordinary, average, stupid, paranoid, and conservative people think about the prospect of a powerful AI totally changing their lives when they have only your self-admittedly ill informed assurances regarding how good it is going to be.

Comment author: orthonormal 07 November 2010 06:45:36PM 2 points [-]

Please don't move the goalposts. I'd much rather know whether I'm convincing you than whether I'm convincing a hypothetical average Joe. Figuring out a political case for FAI is important, but secondary to figuring out whether it's actually possible and desirable.

Comment author: Perplexed 07 November 2010 06:56:28PM 0 points [-]

Ok, I don't mean to be unfairly moving goalposts around. But I will point out that gaining my assent to a hypothetical is not the same as gaining my agreement regarding the course that ought to be followed into an uncertain future.

Comment author: orthonormal 07 November 2010 07:08:26PM 0 points [-]

That's fair enough. The choice of course depends on whether FAI is even possible, and whether any group could be trusted to build it. But conditional on those factors, we can at least agree that such a thing is desirable.