= 27d567bc2d48d9f40e9ccc20ea370b15)
Vladimir_Nesov comments on (One reason) why capitalism is much maligned - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (94)
SIAI has a higher risk of producing uFAI than your average charity.
They could be dangerously deluded, for example, even if their aim is right. Currently, I don't believe they are, but I gave an example of how you could possibly come to a conclusion that SIAI has negative expected value.
Maybe FAI is impossible, humanity's only hope is to avoid the emergence of any super-human AIs, fooming is difficult and slow enough for that to be a somewhat realistic prospect and almost friendly AI is a lot more dangerous because it is less likely to be destroyed in time?
Then sane variant of SIAI should figure that out, produce documents that argue the case, and try to promote the ban on AI. (Of course, FAI is possible in principle, by its very problem statement, but might be more difficult than for humanity to grow up for itself.)
Could you rephrase that? I have no idea what you are saying here.
FAI is a device for producing good outcome. Humanity itself is such a device, to some extent. FAI as AI is an attempt to make that process more efficient, to understand the nature of good and design a process for producing more of it. If it's in practice impossible to develop such a device significantly more efficient than humanity, then we just let the future play out, guarding it against known failure modes, such as AGI with arbitrary goals.
Thank you, now I see how the short version says the same thing, even though it sounded like gibberish to me before. I think I agree.
Now what kind of civilized rational conversation is that?