KatjaGrace comments on Superintelligence 10: Instrumentally convergent goals - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (31)
Can you think of more convergent instrumental values?
"Convergent Instrumental Values" seems like a very jargony phrase for "good tactics."
Patience Caution Deterred by credible threat Reputation-aware- It will extensively model what we think about it. Curiousity Reveals information when strategically appropriate ...
Your additional instrumental values spread your values and social influence become very important if we avoid rising of a decisive advantage AI.
In a society of AI enhanced humans and other AGIs altruism will become an important instrumental value for AGIs. The wide social network will recognize well-behavior and anti-social behavior without forgetting. Facebook gives a faint glimpse of what will be possible in future.
Stephen Omohundro said it in a nutshell: “AIs can control AIs.”