fubarobfusco comments on What happens when your beliefs fully propagate - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (78)
There's another possible scenario: The AI Singularity isn't far, but it is not very near, either. AGI is a generation or more beyond our current understanding of minds, and FAI is a generation or more beyond our current understanding of values. We're making progress; and current efforts are on the critical path to success — but that success may not come during our lifetimes.
Since this is a possible scenario, it's worth having insurance against it. And that means making sure that the next generation are competent to carry on the effort, and themselves survive to make it.
Cultivating a culture of rationality, awareness of existential risks, etc. is surely valuable for that purpose, too.
Good point, thanks.