How did you reach that conclusion? To me it seems very unlikely. For example it seems that there's a good chance the AGI will have something called "utility function". So we can start thinking of what is the correct utility function for a FAI even if we don't know how to build an optimizer around it. We can study problems like decision theory to better understand the domain on the utility function. etc.
It's not clear at all that AGI will have a utility function. But furthermore, bolting a complex, friendly utility function onto whatever AI architecture we come up with will probably be a very difficult feat of engineering, which can't even begin until we actually have that AI architecture.
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.
Thread started before the end of the last thread to ecourage Monday as first day.