Yes, I agree. An upper bound on the complexity of a friendly superintelligence would be the total information content of all human brains, but you could probably compress that a lot.
False. The upper bound on the complexity of a Friendly superintelligence is [(total information content of all brains) + (minimum complexity of a what it takes to identify a superintelligence with a defined goal of deriving its objective from a set of agents according to some mechanism that represents what it would mean to be 'friendly' to them)].
ie. Just having all the information content of all human brains is not enough. You can't avoid defining Friendliness in the search program.
Technically you can cheat by using the information in human brains to create upload-based superintelligences along the lines of Stuart's proposal, make them do the research for you, etc., so it seems likely to me that the upper bound should hold... but I appreciate your point and agree that my comment was wrong as stated.
The most simple, able to self-improve "seed" for a superintelligence must be how complex?
Give your (wild) estimation or a pure guess in the terms of bits.
Do you reckon it is 1000 bits enough? At least 1000000 is required? More than 10^20 bits?
I wonder what your approximate numbers are.
Thank you!