= 27d567bc2d48d9f40e9ccc20ea370b15)
fubarobfusco comments on UFAI cannot be the Great Filter - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (90)
Sure. For instance, consider the directive "Make everyone on Earth live as happily as possible for as long as the sun lasts." Solution: Wirehead everyone, then figure out how to blow up the sun, then shut down — mission accomplished.
Not if the system is optimizing for the probability of success and can cheaply send out probes to eat the universe and use it to make sure the job is finished lest something go wrong (e.g. the sun-destroyer [???] failed, or aliens resuscitate the Sun under whatever criterion of stellar life is used).
"Our analysis of the alien probe shows that its intended function is to ... um ... go back to a star that blew up ten thousand years ago and make damn sure that it's blown up and not just fooling."