You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

turchin comments on The AI That Pretends To Be Human - Less Wrong Discussion

1 Post author: Houshalter 02 February 2016 07:39PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (69)
Tags: agi ai fai

Comments (69)

You are viewing a single comment's thread. Show more comments above.

Comment author: turchin 02 February 2016 08:43:31PM 0 points [-]

We can't judge based on behaviour that some one is superintelligent or not.

Comment author: Houshalter 02 February 2016 09:24:56PM 0 points [-]

Yes we can. Superintelligences have abilities that normal intelligences do not.

Imagine a game of chess. A good AI will make vastly different moves than a bad AI or a human. More skilled players would easily be detectable. They would make very different moves.

Comment author: turchin 02 February 2016 09:33:43PM 1 point [-]

But in some games it is better to look more stupid in the begging. Like poker, espionage and AI box experiment.

Comment author: Houshalter 03 February 2016 03:24:12AM -1 points [-]

An AI that is indistinguishable from a human (to an even greater superintelligent AI) is not dangerous, because humans are not dangerous. Just like a chess master that is indistinguishable from a regular player wouldn't win many games.

Comment author: turchin 03 February 2016 10:27:05AM 1 point [-]

It may be indistinguishable until it gets our of the building. Recent movie Ex Machine had such plot.

Comment author: Houshalter 03 February 2016 02:03:58PM 0 points [-]

The AI doesn't want to escape from the building. It's utility function is basically to mimic humans. It's a terminal value, not a subgoal.

Comment author: turchin 03 February 2016 03:20:33PM -1 points [-]

But most humans would like to escape from any confinement

Comment author: _rpd 02 February 2016 08:49:12PM 0 points [-]

I wonder if this is true in general. Have you read a good discussion on detecting superintelligence?

Comment author: turchin 02 February 2016 08:55:59PM 0 points [-]

Can't remember ad hoc; but if superintelligence is able to do anything, it could easily pretend to be more stupid than it is. May be only "super super intelligence" could solve him. But it also may depend of the length of the conversation. If it say just Yes or No once, we can't decide, if it say longer sequences we could conclude something, but for any length of sentences is maximum level of intelligence that could be concluded from it.

Comment author: _rpd 02 February 2016 10:48:10PM 0 points [-]

The opportunities for detecting superintelligence would definitely be rarer if the superintelligence is actively trying to conceal the status.

What about in the case where there is no attempted concealment? Or even weaker, where the AI voluntary submits to arbitrary tests. What tests would we use?

Presumably we would have a successful model of human intelligence by that point. It's interesting to think about what dimensions of intelligence to measure. Number of variables simultaneously optimized? Optimization speed? Ability to apply nonlinear relationships? Search speed in a high dimensional, nonlinear solution space? I guess it is more the ability to generate appropriate search spaces in the first place. Something much simpler?

Comment author: turchin 02 February 2016 10:58:18PM 0 points [-]

Probably winning humans in ALL known domains, including philosophy, poetry, love, power.

Comment author: _rpd 02 February 2016 11:04:19PM 0 points [-]

Although we use limited proxies (e.g., IQ test questions) to estimate human intelligence.

Comment author: turchin 02 February 2016 11:10:32PM 0 points [-]

limited proxies - yes, well said. also I would add solving problems which humans were unable to solve for long: aging, cancer, star travel, word peace, resurrection of dead.

Comment author: _rpd 02 February 2016 11:40:27PM 0 points [-]

I mean, the ability to estimate the abilities of superintelligences appears to be an aspect of reliable Vingean reflection.

Comment author: turchin 02 February 2016 11:45:08PM *  0 points [-]

Or we could ask these AI to create the scale. We could use also its size to estimate power, like number on neurons. But real test needs to be powerful as well as universal optimization problem, something like ability to crack complex encryption or Go game.

Comment author: turchin 02 February 2016 11:44:36PM 0 points [-]

I created a list of steps or milestones of the future AI and we could use similar list to estimate level of current super AI.

  1. AI autopilot. Tesla has it already.
  2. AI home robot. All prerequisites are available to build it by 2020 maximum. This robot will be able to understand and fulfill an order like ‘Bring my slippers from the other room’. On its basis, something like “mind-brick” may be created, which is a universal robot brain able to navigate in natural space and recognize speech. Then, this mind-brick can be used to create more sophisticated systems.
  3. AI intellectual assistant. Searching through personal documentation, possibility to ask questions in a natural language and receive wise answers. 2020-2030.
  4. AI human model. Very vague as yet. Could be realized by means of a robot brain adaptation. Will be able to simulate 99% of usual human behavior, probably, except for solving problems of consciousness, complicated creative tasks, and generating innovations. 2030.
  5. AI as powerful as an entire research institution and able to create scientific knowledge and get self-upgraded. Can be made of numerous human models. 100 simulated people, each working 100 times faster than a human being, will be probably able to create AI capable to get self-improved faster, than humans in other laboratories can do it. 2030-2100

5a Self-improving threshold. AI becomes able to self-improve independently and quicker than all humanity 5b Consciousness and qualia threshold. AI is able not only pass Turing test in all cases, but has experiences and has understanding why and what it is.

  1. Mankind-level AI. AI possessing intelligence comparable to that of the whole mankind. 2040-2100

  2. AI with the intelligence 10 – 100 times bigger than that of the whole mankind. It will be able to solve problems of aging, cancer, solar system exploration, nanorobots building, and radical improvement of life of all people. 2050-2100

  3. Jupiter brain – huge AI using the entire planet’s mass for calculations. It can reconstruct dead people, create complex simulations of the past, and dispatch von Neumann probes. 2100-3000

  4. Galactic kardashov level 3 AI. Several million years from now.

  5. All-Universe AI. Several billion years from now

Powered by Reddit Powered by Reddit