Zubon comments on Rationality Quotes Thread July 2015 - Less Wrong

5 Post author: elharo 01 July 2015 11:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (86)

You are viewing a single comment's thread. Show more comments above.

Comment author: Zubon 09 July 2015 03:52:18AM 3 points [-]

And when your surpassing creations find the answers you asked for, you can't understand their analysis and you can't verify their answers. You have to take their word on faith —-

—- Or you use information theory to flatten it for you, to squash the tesseract into two dimensions and the Klein bottle into three, to simplify reality and pray to whatever Gods survived the millennium that your honorable twisting of the truth hasn't ruptured any of its load-bearing pylons. ...

I've never convinced myself that we made the right choice. I can cite the usual justifications in my sleep, talk endlessly about the rotational topology of information and the irrelevance of semantic comprehension. But after all the words, I'm still not sure. I don't know if anyone else is, either. Maybe it's just some grand consensual con, marks and players all in league. We won't admit that our creations are beyond us...

Maybe the Singularity happened years ago. We just don't want to admit we were left behind.

-- Siri Keeton explains what a "synthesist" does in Blindsight by Peter Watts, page 35-37

Blindsight is an amazingly Less Wrong book, with much discussion of epistemology and cognitive failures, starting with the title of the book. It is some of the hardest science fiction in existence, with a 22-page "Notes and References" section walking through 144 citations for the underlying science.

Pushing a related quote to a comment... Pushing discussion to another comment...

Comment author: Zubon 09 July 2015 03:53:01AM 0 points [-]

This being Less Wrong, this might be the point where you bring up whether P=NP and that solutions are often much easier to verify than compute. Easier does not necessarily mean easy or even within human cognitive capabilities. And if it does in whatever example comes to mind, just keep pushing to harder problems until we need not only tools to solve the problem but also meta-tools to tell us what our tools are telling us. And you can keep pushing that meta. (Did I mention that Blindsight is a very Less Wrong book?)

We trust our tools because we trust the process we used to develop our tools, and we trust the previous generation of tools used to develop those tools and processes, and we trust... At some point, you look at the edifice of knowledge and realize your life depends on a lot of interdependencies, and that can be scary.

And then I trust Google Maps to get me most places, because I know it has a much better direction sense than me and it knows things like construction and traffic conditions.