= 27d567bc2d48d9f40e9ccc20ea370b15)
ocr-fork comments on Preface to a Proposal for a New Mode of Inquiry - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (83)
Er, have you given much thought to friendliness?
Anna Salamon once described the Singularity Institute's task as to "discover differential equations before anyone else has discovered algebra". The idea being that writing an AI that will behave predictably according to a set of rules you give it is much more difficult than building an AI that's smart enough to do dangerous stuff. It seems to me that if your ideas about AI are correct, you will be contributing to public knowledge of algebra.
I don't get it. Are you saying a smart, dangerous AI can't be simple and predictable? Differential equations are made of algebra, so did she mean the task is impossible? You were replying to my post, right?
Probably not simple.
The point is that for it to be predictable, you'd need a very high level of knowledge about it. More than the amount necessary to build it.