= 27d567bc2d48d9f40e9ccc20ea370b15)
cousin_it comments on Proposal: Use logical depth relative to human history as objective function for superintelligence - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d){kind=logo}
Comments (23)
I feel that a good FAI designer shouldn't dismiss these objections so easily. The toe-stubbing problem is much simpler than preserving human existence. To solve the toe-stubbing problem, you just need to correctly order two outcomes A and B. To preserve human existence, you need to order outcome A against all possible outcomes B that a powerful creative intelligence might come up with. Any solution to the bigger problem that doesn't allow you to solve smaller problems is very suspicious to me.
I guess I disagree with this assessment of which problem is easier.
Humanity continues to exist while people stub their toes all the time. I.e., currently the humanity existing problem is close to solved, and the toe stubbing problem has by and large not been.