Would an AI necessarily have something like a system 1/system 2 distinction? Might it have additional layers?
I really like Ian Banks's depiction of Culture Minds (ships and habitats), and their ability to carve off temporarily-independent pieces of themselves for various purposes. This, along with ability to simulate fairly complex systems like smaller intelligences, may end up vaguely similar to our own blend of habits and heuristics somewhat distinct from reasoned action.
But only vaguely. Not least because the two-system description doesn't fit humans all that well, compared to a 20-system model with different kinds of reactions, habits, willpower, and choices.
This thread is for asking any questions that might seem obvious, tangential, silly or what-have-you. Don't be shy, everyone has holes in their knowledge, though the fewer and the smaller we can make them, the better.
Please be respectful of other people's admitting ignorance and don't mock them for it, as they're doing a noble thing.
To any future monthly posters of SQ threads, please remember to add the "stupid_questions" tag.