The problems of the world the way the way it is right now and the incentives of the people in power as per the current structure does not seem optimal to me.
There are so many obvious things that could be done that are not being done right now. for eg. Competition in the space of governments. Proposing solutions to many present problems of the world does not require a superintelligence. Economists do that everyday. But untangling the entire mess of incentives, power and leverage so that these formerly simple, but now complicated, solutions could be implemented requires a superintelligence.
This super intelligence needs to be benevolent today and tomorrow. I have not found a better goal structure than CEV which can maintain this benevolence. Singinst has openly written that they are open to better goal systems. If I find something better, I will move my support there.
I agree.
I'm aware that there are problems with CEV (mainly: we're probably not going to have enough time to figure out how to actually implement it before the Singularity, and the CEV is biased to exclude only the volition of humanity, which means that there may be a risk of the CEV allowing arbitrary amounts of cruelty to entities that don't qualify as "human")
Anyway, I'm aware that there are problems with CEV, but I still don't know of any better plan.
Because of the extreme difficulty of actually implementing CEV, I am tempted to advocate the b...
It has been claimed on this site that the fundamental question of rationality is "What do you believe, and why do you believe it?".
A good question it is, but I claim there is another of equal importance. I ask you, Less Wrong...
What are you doing?
And why are you doing it?