malo comments on A cynical explanation for why rationalists worry about FAI - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (179)
I think the last sentence here is a big leap. Why is this a more plausible explanation then the idea that aspiring rationalist simply find AI-risk and FAI compelling. Furthermore, since this community was founded by someone who is deeply interested in both topics, members who are attracted to the rationality side of this community get a lot of exposure to the AI-risk side. As such, if we accept the premiss that AI-risk is a topic that aspiring rationalists are more likely to find interesting than a random member of the general public, then it's not surprising that many end up thinking/caring about it after being exposed to this community.
You seem to attempt to justify this last sentence of the quoted text with the following:
I would respond to this by saying that thinking/caring about AI-risk ≠ working on AI-risk. I imagine there are also lots of people who think about the risks of asteroid impacts, but aren't working on solving them, and wouldn't claim they are. Also, this paragraph could be interpreted a saying that, people who claim to be doing work on AI-risk (e.g., SI) aren't actually doing any work. It would be one thing to claim the work is misdirected, but to claim they aren't working hard (to me) seems misinformed or disingenuous.
Which then leads into the following:
I think a more accurate characterization of SI's stance would be that there are lots of important philosophical and mathematical problems that if solved will increase the likely hood of a positive Singularity, and that those doing what you call the “gritty engineering” haven't properly considered the risks. Your statement seems to trivialize this work, and you state Holden's criticism as evidence. What specifically in this “debate”—including the responses from SI—lead you to believe that SI's approach is “withdrawn from reality.”