Dolores1984 comments on A cynical explanation for why rationalists worry about FAI - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (179)
So... you just mean that in order to build AI, we're going to have to solve AI, and it's hard? I'm not sure the weakened version you're stating here is useful.
We certainly don't have to actually, formally solve the SI problem in order to build AI.
I really doubt an AI-like hack even looks like one, if you don't arrive on it by way of maths.
I am saying it is statistically unlikely to get GAI without maths, and a thermodynamic miracle to get FAI without math. However, my personal intuits are the GAI isn't as hard as, say, some of the other intractable problems we know of, like P =? NP, the Reimann Hypothesis, and other famous problems.
Only Uploads offer a true alternative.