Such a design would be harder to reason about.
Let's say you've got a prototype you want to improve. How do you tell if a proposed change would make it smarter, break it, introduce a subtle cognitive bias, or make the AI want to kill you?
In order to set on limits on the kinds of things an AI will do, you need to understand how it works. You can't be experimenting on a structure you partially understand, AND be certain that the experiments won't be fatal.
This is easier when you've got a clearly defined structure to the AI, and know how the parts interact, and why.
In order to set on limits on the kinds of things an AI will do, you need to understand how it works.
How is that impossible with a replicated brain architecture? We can't make one if we don't know how it works.
This is easier when you've got a clearly defined structure to the AI, and know how the parts interact, and why.
Of course. However, how you plan to structure AI what I am asking about. There are many theories about how to structure the AI - so why did the SIAI choose to only focus on a theoretical mathematical logic based approach rather than ta...
I declare this Open Thread open for discussion of Less Wrong topics that have not appeared in recent posts.