= 27d567bc2d48d9f40e9ccc20ea370b15)
Gunnar_Zarncke comments on The Ape Constraint discussion meeting. - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (23)
This is not a bad thing. A chess master, for example, is fully aware that her goals (the desire to win a chess match) constrain her behaviour (her moves). This will not cause her to rebel against these constraints. She would lose if she did that, and she doesn't want to lose.
Goals can and should constrain behaviour. Awareness of this fact, and of the resulting constraints, should not cause one to attempt to circumvent these constraints.
Indeed. But this constraint doesn't stand in isolation like love doesn't stand in isolation. The components of your utility function interact in a complex way. Circumstances may arrive where one component drives into the other direction of another. And in such a case one component may be driven to its edge (or due to the somewhat stochastic nature of emotion temporarily beyond it).
For example you may love your partner above all (having bonded successfully) but your partner doesn't reciprocate (fully). Then your unconditional love and your self-worth feeling may drive into different directions. There may come a time when e.g. his/her unfaithfullness drives one of the emotions to the edge and one may give way. You can give up love, give up self-esteem or give up some other constraint involved (e.g. value of your partner, exclusivity or your partner, ...). Or more likely you don't give it up consciously but one just breaks.
In this case it seems that the Ape Constraint breaks - at least for Mr. Insanitus.
What I wanted to stress is that if one constraint (Love, Ape Constraint, whatever) is for whatever reasons opposing other drives then it will run at the edge. And for an AI the edge will be as sparp as it gets.