If you have time for another, I'd be interested in your response to Goertzel's critique of Superintelligence:
Overall, very sensible. I'll ignore minor quibbles (a 'strong AI' and a 'thinking machine' seem significantly different to me, since the former implies recursion but the latter doesn't) and focus on the main points of disagreement.
The related question I care more about, though, is: In practice, which goals are likely to be allied with which kinds and levels of intelligence, in reality? What goals will very, very smart minds, existing in the actual universe rather than the domains of abstract mathematics and philosophy, be most likely to aim for?
Goertze...
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should be posted in Discussion, and not Main.
4. Open Threads should start on Monday, and end on Sunday.