Doesn't that undermine the premise of the whole "a godless universe has low Kolmogorov complexity" argument that you're trying to make?
Again, there is a difference between the complexity of the dynamics defining state transitions, and the complexity of the states themselves.
But, the AGI can. Agentiness is going to be a very important concept for it. Thus it's likely to have a short referent to it.
What do you mean by "short referent?" Yes, it will likely be an often-used concept, so the internal symbol signifying the concept is likely to be short, but that says absolutely nothing about the complexity of the concept itself. If you want to say that "agentiness" is a K-simple concept, perhaps you should demonstrate that by explicating a precise computational definition for an agent detector, and show that it doesn't fail on any conceivable edge-cases.
Saying that it's important doesn't mean it's simple. "For an AGI to be successful it is going to have to be good at reducing entropy globally. Thus reducing entropy globally must have low Kolmogorov complexity."
Saying that it's important doesn't mean it's simple.
You're confusing the intuitive notion of "simple" with "low Kolmogorov complexity". For example, the Mandelbrot set is "complicated" in the intuitive sense, but has low Kolmogorov complexity since it can be constructed by a simple process.
...What do you mean by "short referent?" Yes, it will likely be an often-used concept, so the internal symbol signifying the concept is likely to be short, but that says absolutely nothing about the complexity of the concept its
Another month, another rationality quotes thread. The rules are: