Kaj_Sotala comments on Open Thread: September 2009 - Less Wrong

2 Post author: AllanCrossman 01 September 2009 10:54AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (179)

You are viewing a single comment's thread. Show more comments above.

Comment author: Kaj_Sotala 04 September 2009 09:07:17PM 0 points [-]

A certain philosophy being the most sustainable and positive isn't automatically the same as being the one people tend to adopt. Plus the answer to your question depends on what you're trying to optimize.

Also, it sounds like you're still talking about a situation where people don't actually have ultimate power. If we're discussing a potential hard takeoff scenario, then considerations such as "which models have been the most successful for businesses before" don't really apply. Any entity genuinely undergoing a hard takeoff is one that isn't afterwards bound by what's successful for humans, any more than we are bound by the practices that work the best for ants.

Comment author: AndrewKemendo 05 September 2009 12:38:11AM 0 points [-]

A certain philosophy being the most sustainable and positive isn't automatically the same as being the one people tend to adopt

I think there is more than ample evidence to suggest that those are significantly less likely to be adopted - however wouldn't a group of people who know that and can correct for it be the best test case of implementing an optimized strategy?

Also, it sounds like you're still talking about a situation where people don't actually have ultimate power.

I hold the view that it is unnecessary to hold ultimate power over FAI. I certainly wouldn't bind it to what has worked for humans thus far. Don't fear the AI, find a way to assimilate.