= 27d567bc2d48d9f40e9ccc20ea370b15)
Stuart_Armstrong comments on A Little Puzzle about Termination - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (36)
See my point on satisficers wanting to be maximisers: http://lesswrong.com/lw/854/satisficers_want_to_become_maximisers/
"Achieve 'G' with 'p' probability" does not seem to be a stable goal for an AI capable of changing itself.
Oh absolutely, it's far too simplistic for that. In fact it's nowhere near adequate for a sufficiently advanced agent capable of changing itself, but was merely chosen for the purpose of illustration; it seems I somewhat miscommunicated the intent of this puzzle.