You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

MrMind comments on Isomorphic agents with different preferences: any suggestions? - Less Wrong Discussion

3 Post author: Stuart_Armstrong 19 September 2016 01:15PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (6)

You are viewing a single comment's thread.

Comment author: MrMind 26 September 2016 08:34:15AM *  1 point [-]

I think you should make a distinction if the different behaviours comes from different circumstances or not.
If their environment is always the same, then I think the only to have what you ask is if the system has a hidden, very specific parameter, that says "when X and Y and Z happens, zig instead of zagging".
Otherwise, if the model is slightly chaotic, then an important alteration to the environment might provoke very different behaviour.

For the first type of agent, think of two Markov chains almost identical, only one has a very improbable arc to a stable subnet that doesn't exists in the other chain.
For the second type, think of two similar strange attractors, that have different behaviours away from the stable parameters. They will be approximately identical in the same zone and be very different away from that zone.