= 27d567bc2d48d9f40e9ccc20ea370b15)
gjm comments on Singularity Institute is now Machine Intelligence Research Institute - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (99)
Surely what MIRI would ideally like to do is to find a way of making intelligence not "emergent", so that it's easier to make something intelligent that behaves predictably enough to be classified as Friendly.
I don't believe that MIRI has been consciously paying attention to thwarting undesirable emergence, given that EY refuses to acknowledge it as a real phenomenon.
I fear we're at cross purposes. I meant not "thwart emergent intelligence" but "find ways of making intelligence that don't rely on it emerging mysteriously from incomprehensible complications".
Sure, you cannot rely on spontaneous emergence for anything predictable, as neural network attempts at AGI demonstrate. My point was that if you ignore the chance of something emerging, that something will emerge in a most inopportune moment. I see your original point, though. Not sure if it can be successful. My guess is that the best case is some kind of "controlled emergence", where you at least set the parameter space of what might happen.