= 27d567bc2d48d9f40e9ccc20ea370b15)
Stuart_Armstrong comments on AI, cure this fake person's fake cancer! - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (18)
That's why you want to specify the AIs motivation entirely in terms of the model, and reset it from one episode to the next.
As long as reality has a causal influence on the model, however, the AI's motivation includes reality.
Imagine your AI is playing a FPS, and its goal is to win the game. We have a motivation which exists entirely in terms of a virtual model. Yet if it realizes it can, its motivation includes getting the players' IP addresses, researching their real-world identities, entering theoretically secure systems as necessary, and using psychological warfare over the in-game chat system "Hey Samuel Smith, did you know your aunt Mildred Smith has pictures of you sitting naked in the bowl of a toilet as a child on her hard drive?" to gain a major advantage. Maybe it goes so far as to SWAT opposing enemy teams.
This kind of box only requires the AI to, well, think outside the box, for its solutions.