jacob_cannell comments on Efficient Cross-Domain Optimization - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (36)
Of course - this is correct. An AI system, like intelligence in general, is an algorithm and is thus governed by computational complexity theory and the physics of computation.
Code length is one fundemental quantitative measure (as in kolmogorv complexity), important in information theory, but it is not directly related nor to be confused with primary physical computational quantities such as space and time. Any pattern can be compressed - trading off time for space (expending energy to conserve mass).
The computational effeciency of one's intelligence algorithm is important, but effeciency is not the same as power, whether one is talking about heat engines or computational systems. Effeciency in computation is a measure of how much computation you get out for how much matter and energy you put in.
Intelligence, in typical english usage, does not connotate an effeciency measure - it connotates a power measure. If you have a super-computer AI that can think at a 3rd grade level, and you have a tiny cell phone AI that uses 1000 times less resources but thinks at a 2nd grade level, we'd still refer to the super-computer AI as being more intelligent, regardless of how effecient it is.
Intelligence is a computational power measure, but it is not a single scalar - it has temporal and spatial components (speed, depth, breadth, etc).
I think "powerful generalized optimization" is closer to what you want, but one may also want to distinguish between static and dynamic intelligence (hard-coded vs adaptive). I'd also say that intelligence is a form of optimization, but optimization is a broader term. There are many computational optimization processes, most of which one would be hard pressed to call 'intelligent'.