I presently feel that SIAI is blocking itself by apparently believing that solving the FAI problem is blocked on any or all of the following:
- Newcomb's problem
I thought SIAI consensus was that Newcomb's problem was solved, and not a block at all?
- Dealing with people who have non-instrumental concerns about what is done with simulations of them, beyond saying "don't care about that"
It's not so much that they feel they have to deal with those people as that they are those people.
(Haven't read further yet.)
atucker wants to save the world.
ciphergoth wants to save the world.
Dorikka wants to save the world.
Eliezer_Yudkowsky wants to save the world.
I want to save the world.
Kaj_Sotala wants to save the world.
lincolnquirk wants to save the world.
Louie wants to save the world.
paulfchristiano wants to save the world.
Psy-Kosh wants to save the world.
Clearly the list I've given is incomplete. I imagine most members of the Singularity Institute belong here; otherwise their motives are pretty baffling. But equally clearly, the list will not include everyone.
What's my point? My point is that these people should be cooperating. But we can't cooperate unless we know who we are. If you feel your name belongs on this list then add a top-level comment to this thread, and feel free to add any information about what this means to you personally or what plans you have. Or it's enough just to say, "I want to save the world".
This time, no-one's signing up for anything. I'm just doing this to let you know that you're not alone. But maybe some of us can find somewhere to talk that's a little quieter.