= 27d567bc2d48d9f40e9ccc20ea370b15)
Locaha comments on Humans can drive cars - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (86)
Maybe humans are not safe AGI. Maybe both the idea of "safety" and the idea of "general intelligence" are ill-defined.
Humans definitely aren't safe GI (not A, anyway).
In particular, there may be a very real danger that humans will use their intelligence to design more intelligent systems, which in turn will design more intelligent systems, etc., leading to a highly unpredictable singularity with no adequate safety measures in place.
In other words: if AGI is a real threat then so is human intelligence, since it's human intelligence that would take the initial steps towards AGI. What's potentially different about AGI is that it might become dangerous much faster than anything we're used to.
(Of course there are other more obvious examples of disastrous things humans might do: nuclear war, etc.)