You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

KatjaGrace comments on Superintelligence 5: Forms of Superintelligence - Less Wrong Discussion

12 Post author: KatjaGrace 14 October 2014 01:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (112)

You are viewing a single comment's thread. Show more comments above.

Comment author: KatjaGrace 14 October 2014 02:10:12AM 1 point [-]

There may be a distinction to be made between an agent who could do any intellectual task if they carried out the right procedure, and an agent who can figure out for themselves which procedure to perform. While most humans could implement a turing machine of some kind if they were told how, and wanted to, it's not obvious they could arrange this from their current state.

Comment author: SteveG 14 October 2014 02:29:02AM 1 point [-]

That's a separate topic from error rate, which I still want help with, but also interesting.

Figuring out what procedure to perform is a kind of design task.

Designing includes:

-Defining goals and needs -Defining a space of alternatives -Searching a space of alternatives, hopefully with some big shortcuts -Possibly optimizing -Testing and iteration

Design is something that people fail at, over and over. They are successful enough of the time to build civilizations.

I feel that design is a fundamental element of quality and collective intelligence. I would love to sort through it in more detail.