= 27d567bc2d48d9f40e9ccc20ea370b15)
drethelin comments on Thoughts on the Singularity Institute (SI) - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (1270)
Tool-based works might be a faster and safer way to create useful AI, but as long as agent-based methods are possible it seems extremely important to me to work on verifying friendliness of artificial agents.
Important, perhaps, but extremely important? If tool-based systems are faster in coming and safer, then they will be available to help the process of creating, studying, and (if necessary) defending against powerful agents.
My prediction would be that tool AI would be economically incentivised, since humans want tools. Agent AI might be created later on more aesthetic grounds, as pets or hoped-for equals. (But that's just an intuition.)
For the same reason that a personal assistant is vastly more useful and powerful than a PDA, even though they might nominally serve the same function of remembering phone numbers, appointments, etc. people are extremely likely to want to create agent AIs.