Manfred comments on Isolated AI with no chat whatsoever - Less Wrong

14 Post author: ancientcampus 28 January 2013 08:22PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (61)

You are viewing a single comment's thread. Show more comments above.

Comment author: Manfred 29 January 2013 09:31:29AM 4 points [-]

And then someone makes a self-improving AI anyhow, and blows right past them.

Comment author: GeraldMonroe 29 January 2013 09:47:56PM -1 points [-]

A stable outcome is possible where such a self-improving AI is unable to form.

The outcome can happen if the "human based" AIs occupy all ecological space within this solar system. That is, there might be humans alive, but all significant resources would be policed by the AIs. Assuming a self-improving AI, no matter how smart, still needs access to matter and energy to grow, then it would not ever be able to gain a foothold.

The real life example is earth's biosphere : all living things are restricted to a subset of the possible solution space for a similar reason, and have been for several billion years.