No, the point of that section is that there are many AI designs in which we can't explicitly make goals.
I know, but you use the word "predict", which is what I was pointing out.
I disagree. A textbook error in machine learning that has not yet been solved is good match for a fundamental problem.
What do you mean, "has not yet been solved"? This kind of error is routinely being solved in practice, which is why it's a textbook example.
Again, I'm not claiming that these aren't also problems elsewhere.
Yes, but that makes it a bad illustration.
Why? I've already varied the wording
Because it's bad prose, it sounds unnatural (YMMV).
Hence, the link, for people who don't know.
This doesn't address my argument. I know there is a link and I know that people could click on it, so that's not what I meant.
(More later, maybe.)
I wrote a new Singularity FAQ for the Singularity Institute's website. Here it is. I'm sure it will evolve over time. Many thanks to those who helped me revise early drafts, especially Carl and Anna!