I agree with wedrifid here. We don't seem to have a valid argument showing that "an upper bound on the complexity of a friendly superintelligence would be the total information content of all human brains". I would like to point out that if the K-complexity of friendly superintelligence is greater than that, then there is no way for us to build a friendly superintelligence except by luck (i.e., most Everett branches are doomed to fail to build a friendly superintelligence) or by somehow exploiting uncomputable physics.
The most simple, able to self-improve "seed" for a superintelligence must be how complex?
Give your (wild) estimation or a pure guess in the terms of bits.
Do you reckon it is 1000 bits enough? At least 1000000 is required? More than 10^20 bits?
I wonder what your approximate numbers are.
Thank you!