You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

oooo comments on Snowdenizing UFAI - Less Wrong Discussion

5 Post author: JoshuaFox 05 December 2013 02:42PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (71)

You are viewing a single comment's thread. Show more comments above.

Comment author: oooo 05 December 2013 09:41:16PM 2 points [-]

This presupposes that the AGI community is, on average, homogenous across the world and would behave accordingly. What if the political climates, traditions and culture make certain (powerful) countries less likely to be fearful given their own AGI pool?

In otherwords, if country A distrusts their staff more than country B due to political/economic/cultural factors, country A would be behind in the AGI arms race, which would lead to the "even if I hold onto my morals, we're still heading into the abyss" attitude. I could see organizations or governments rationalizing against the community moral pledge in this way by highlighting the futility of slowing down the research.

Comment author: JoshuaFox 05 December 2013 10:08:34PM 3 points [-]

AGI community is, on average, homogenous

The AGI community is tiny today. As it grows, its future composition will be determined by the characteristic of the tiny seed that expands.

I won't claim that the future AGI community will be homogeneous, but it may be possible to establish norms starting today.