It seemed to me that Lanier drifted between useful but poorly explained ideas and incoherence throughout it. And that the talk was mostly about his ideas.
Incidentally, Eliezer asked early on, and has asked in the past: Can you name a belief which is untrue, but which you nevertheless believe?
I think, on reflection, that I have one. I believe that my conscious perception of reality is more or less accurate.
Suppose that this universe (or any possible universe) ends in heat death, rather than a "big crunch", repeated inflationary periods, etc, whi...
You mentioned earlier that intelligence also optimizes for subgoals: tasks that indirectly lead to terminal value, without being directly tied to it. These subgoals would likely be easier to guess at than the ultimate terminal values.
For example, a high-amperage high temperature superconductor, especially with significant current flowing through it, is highly unlikely to have occurred by chance. It is also very good at carrying electrons from one place to another. Therefore, it seems useful to hypothesize that it is the product of an optimization process... (read more)