= 27d567bc2d48d9f40e9ccc20ea370b15)
torekp comments on Superintelligence 18: Life in an algorithmic economy - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (51)
I agree with most of that, including
but not:
I mean, that might be what Scott had in mind for the word Moloch, but the actual logic of the situation raises another challenge. The fragility of value, and the misalignment between human values and "whatever reproduces well, not just in the EAE but wherever and whenever", creates a dire problem.
Molochian problems would be direr without the existence of a specific mechanism to overcome them.
I'm not a believer in the fragility of value.
http://lesswrong.com/lw/y3/value_is_fragile/br8k
You gave me the chance to check whether I was using "fragility of value" correctly. (I think so.) Your reply in that thread doesn't fit the fragility thesis: you're reading too much into it. EY is asserting that humanly-valuable outcomes are a small region in a high-dimensional space. That's basically all there is to it, though some logical consequences are drawn that flesh it out, and some of the evidence for it is indicated.
If he is asserting only what you say, he is asserting nothing of interest. What FoV is usually taken to mean is that getting FAI right is difficult ... and that is right called fragility, because it is a process. However, it is not a conclusion supported by a premise about higher dimensional spaces, because that is not a process.