= 27d567bc2d48d9f40e9ccc20ea370b15)
timtyler comments on Model Uncertainty, Pascalian Reasoning and Utilitarianism - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (154)
I don't really understand which problem you are raising. If the O eventually contains a simulated copy of A - so what? O is still a utililty-maximiser that behaves the same way that A does if placed in the same environment.
The idea of a utility maximiser as used here is that it assigns utilities to all its possible actions and then chooses the action with the highest utility. O does that - so it qualifies as a utililty-maximiser.
O doesn't assign utilities to its actions and then choose the best. It chooses its action (by simulating A), labels it with utility 1, and chooses to perform the action it just chose. The last two steps are irrelevant.
"Irrelevant"? If it didin't perform those steps, it wouldn't be a utility maximiser, and then the proof that you can build a utility maximiser which behaves like any computable agent wouldn't go through. Those steps are an important part of the reason for exhibiting this construction in the first place.